Haystack Blog

Rita Fernandes Neves Senior Solution Architect - AI at NVIDIA

Bilge Yucel Developer Relations Engineer

Optimize RAG Applications with Document Reranking Using Haystack With NVIDIA NeMo Retriever

Bilge Yucel Developer Relations Engineer

Announcing Advent of Haystack 2024 🎄

Join the Festive AI Fun!

Stefano Fiorucci NLP Engineer

Create a Swarm of Agents

Easy creation of multi-agent systems

Malte Pietsch Co-Founder & CTO

Bilge Yucel Developer Relations Engineer

Announcing Studio: Your Development Environment for Haystack

Build, deploy, and test Haystack pipelines with ease

Moshe Berchansky AI Research Engineer at Intel Labs

Bilge Yucel Developer Relations Engineer

Building a Multimodal Nutrition Agent

Use fastRAG and Haystack to build an agent that can process text and image data

Tuana Celik

Anshul Jindal Senior Solution Architect - Cloud Services at NVIDIA

Meriem Bendris Senior Solution Architect - AI at NVIDIA

Design Haystack AI Applications Visually in deepset Studio with NVIDIA NIM

Tuana Celik

Advanced RAG: Query Decomposition & Reasoning

Decompose queries that are multiples in disguise and have an LLM reason about the final answer.

David Batista Senior NLP Engineer

Improving Retrieval with Auto-Merging

Learn about the Hierarchical Document Splitter and Auto-Merging to improve retrieved context

Tuana Celik

Announcing Our New Short Course with DeepLearning.AI

Enroll in "Building AI Applications with Haystack"

Tuana Celik

Advanced RAG: Query Expansion

Expand keyword queries to improve recall and provide more context to RAG.

Peter Izsak Research Scientist and Team Lead at Intel Labs

Bilge Yucel Developer Relations Engineer

CPU-Optimized Embedding Models with fastRAG and Haystack

Discover how to use optimized embedding models on CPUs to reduce latency, and improve throughput of retrieval and indexing

Madeesh Kannan Lead NLP Engineer

Sebastian Husch Lee Solution Engineering Tech Lead

Mixedbread 🤝 deepset: Announcing our New German/English Embedding Model

Learn about the new open-source German/English embedding model by deepset and Mixedbread

David Batista Senior NLP Engineer

Benchmarking Haystack Pipelines for Optimal Performance

Step-by-step instructions to evaluate and optimize your RAG pipeline's performance

Stefano Fiorucci NLP Engineer

RAG Evaluation with Prometheus 2

Prometheus 2 is a SOTA open-source model trained specifically for evaluation. Learn about how it works, and how to evaluate RAG pipelines with it.

Anshul Jindal Senior Solution Architect - Cloud Services at NVIDIA

Meriem Bendris Senior Solution Architect - AI at NVIDIA

Tuana Celik

Tilde Thurium

Building RAG Applications with NVIDIA NIM and Haystack on K8s

How to self-host and orchestrate NVIDIA NIMs for Haystack RAG pipelines in Kubernetes.

Tilde Thurium

Monitor and trace your Haystack pipelines with Langfuse

With the new Langfuse integration, it's easier than ever to have visibility into how your pipelines are performing.

David Batista Senior NLP Engineer

Bilge Yucel Developer Relations Engineer

Advanced Retrieval: Extract Metadata from Queries to Improve Retrieval

Use LLMs to extract metadata from queries to use as filters that improve retrieval in RAG applications.

Tuana Celik

Chatting with SQL Databases 3 Ways

Using Haystack to talk to SQL in natural language

Misra Turp Developer Educator @AssemblyAI

Bilge Yucel Developer Relations Engineer

Level up Your RAG Application with Speaker Diarization

Leverage speaker labels with AssemblyAI and Haystack

Malte Pietsch Co-Founder & CTO

Hosted or self-hosted RAG? Full flexibility with NVIDIA NIM integration in Haystack 2.0

New integrations with microservices from the NVIDIA AI Enterprise software platform, including NVIDIA NIM and NeMo Retriever, now allow you to iterate even faster across your RAG development cycle

Massimiliano Pippi Core Engineering Lead

Tuana Celik

Haystack 2.0: The Composable Open-Source LLM Framework

Meet Haystack 2.0, a more flexible, customizable LLM framework

David Batista Senior NLP Engineer

Optimizing Retrieval with HyDE

See how you can easily incorporate HyDE into Haystack RAG pipelines to optimize retrieval

Tilde Thurium

Announcing the Astra DB Haystack Integration

Learn how to use the new Astra DB integrations for Haystack 2.0 in your RAG pipelines.

Bilge Yucel Developer Relations Engineer

PDF-Based Question Answering with Amazon Bedrock and Haystack

Create a generative QA application tailored for PDF files using Amazon Bedrock

Tilde Thurium

Using Jina Embeddings v2 with Haystack 2.0 pipelines to summarize legal documents

Learn how to use the Jina v2 Embedding models in a RAG pipeline with our new Haystack integration.

Bilge Yucel Developer Relations Engineer

Highlights of 2023

A Year of Growth: Highlights from 2023 for Haystack and our Community

Tilde Thurium

Building a Healthcare Chatbot with Mixtral 8x7b, Haystack, and PubMed

Learn how to create a custom medical chatbot using PubMed and Mixtral 8x7B for keyword and answer generation

Tuana Celik

Tilde Thurium

Silvano Cerza Senior Software Engineer

Gemini Models with Google Vertex AI Integration for Haystack

Multi-Modal components and function calling with the new Gemini integrations for Haystack

Tuana Celik

Use Gradient Models with Haystack Pipelines

Introducing the new Haystack Integration, allowing you to easily fine-tune and deploy models on the Gradient platform which you can use in Haystack pipelines

Tuana Celik

Massimiliano Pippi Core Engineering Lead

Introducing Haystack 2.0-Beta and Advent of Haystack

Have a look into our first commitment to what will eventually become Haystack 2.0

Michel Bartels NLP Engineer

Bijay Gurung Solution Engineer

Isabelle Nguyen Technical Content Writer

Using Generative AI to Query Large BI Tables: Our Findings

We evaluated different LLM-based approaches to text-to-SQL

Sara Zanzottera Open Source Engineer

RAG Pipelines From Scratch

Let's build a simple RAG Pipeline with Haystack 2.0 by just connecting three components: a Retriever, a PromptBuilder and a Generator.

Bilge Yucel Developer Relations Engineer

Multilingual Generative Question Answering with Haystack and Cohere

Build a RAG pipeline for multilingual hotel reviews using Cohere models and Haystack

Stefano Fiorucci NLP Engineer

Tuana Celik

Guide to Using Zephyr Models to Generate Answers on Your Data

Learn how to use the new Zephyr models in Haystack 2.0 pipelines with the upcoming HuggingFaceLocalGenerator

Tuana Celik

Customizing RAG Pipelines to Summarize Latest Hacker News Posts with Haystack 2.0 Preview

Take a look at how we are changing Haystack for advanced LLM pipelines, with an example that uses a custom component to fetch the latest Hacker News posts

Isabelle Nguyen Technical Content Writer

Kristof Herrmann Software Engineer

Deploying RAG to Production

How to go from a working prototype to a retrieval augmented generative AI system in production: an overview for data scientists

Tuana Celik

Talk to YouTube Videos with Haystack Pipelines

Use Whisper to provide YouTube videos as context for retrieval augmented generation

Vladimir Blagojevic Senior Software Engineer

Talk to Haystack Docs: Creating a Domain-Focused Q&A RAG Pipeline with WebRetriever

How to create a domain-focused Question and Answering (Q&A) system using Haystack's WebRetriever and RAG pipeline

Tuana Celik

Generative Documentation Q&A with Weaviate and Haystack

A guide to building a retrieval augmented generative pipeline for referenced documentation search.

Vladimir Blagojevic Senior Software Engineer

Enhancing RAG Pipelines in Haystack: Introducing DiversityRanker and LostInTheMiddleRanker

How the latest rankers optimize LLM context window utilization in Retrieval-Augmented Generation (RAG) pipelines

Isabelle Nguyen Technical Content Writer

Hybrid Document Retrieval

Why use one retriever when you can have two?

Bilge Yucel Developer Relations Engineer

Shaping Haystack 2.0

Details of the upcoming Haystack version and how you can give feedback

Isabelle Nguyen Technical Content Writer

Question Answering in the Cockpit

How Airbus used Haystack to build a combined table and text QA system for pilots, aircraft maintenance workers, and others

Isabelle Nguyen Technical Content Writer

Good Listener: How Memory Enables Conversational Agents

...and how we've implemented it in Haystack

Tuana Celik

Sara Zanzottera Open Source Engineer

Share and Use Prompts with PromptHub

A new tool to pull in prompts into your Haystack PromptNode, share them, and collaborate

Isabelle Nguyen Technical Content Writer

What Is a Large Language Model (LLM)?

An introduction to LLMs and how you can use them in your own applications with Haystack

Isabelle Nguyen Technical Content Writer

The Beginner's Guide to LLM Prompting

How to engineer your natural language prompts to get the best answers from a large language model

Massimiliano Pippi Core Engineering Lead

Run Haystack Pipelines in production with Ray Serve

A guide to scale Haystack pipelines for production with Ray Serve

Bilge Yucel Developer Relations Engineer

Generative vs. Extractive Language Models

Which one is right for your use case?

Jasper Schwenzow Solution Engineer

How to Prevent Prompt Injections: An Incomplete Guide

Learn how to prevent prompt injections leveraging our new open-source model and dataset.

Kristof Herrmann Software Engineer

Scaling NLP indexing pipelines with KEDA and Haystack — Part 1: The Application

Enabling retrieval-augmented generative question answering with LLMs

Kristof Herrmann Software Engineer

Scaling NLP indexing pipelines with KEDA and Haystack — Part 2: The Deployment

Enabling retrieval-augmented generative question answering with LLMs

Bilge Yucel Developer Relations Engineer

Kacper Lukawski Developer Advocate at Qdrant

New DocumentStore Integration for Haystack: QdrantDocumentStore

Learn about QdrantDocumentStore, its advantages, and how to use it with Haystack.

Kristof Herrmann Software Engineer

Writing Professional Python Logs

Best Practices and Essential Tips for Effective Python Logging in Your Projects

Tuana Celik

Introducing Agents in Haystack: Make LLMs resolve complex tasks

LLMs can now make use of the right tools to resolve complex queries and tasks

Bilge Yucel Developer Relations Engineer

Announcing the Haystack Blog

A place for the community to learn more about Haystack, NLP, open source development and more!

Isabelle Nguyen Technical Content Writer

Build a Search Engine with GPT-3

Combine the power of large language models with a corpus of your choice to generate natural-sounding answers that are grounded in facts

Tuana Celik

The Definitive Guide to BERT Models

The BERT language model greatly improved the standard for language models. This article explains BERT’s history and the language models derived from it.

Tuana Celik

How to Build a Semantic Search Engine in Python

Search your large collection of documents in the most effective way using open source tools

Andrey A

When and How to Train Your Own Language Model

You’ll almost never have to train a language model from scratch.

Tuana Celik

What is a Language Model?

What are they used for? Where can you find them? And what kind of information do they actually store?

Andrey A

What Is Text Vectorization? Everything You Need to Know

A guide to the history and the role of text vectorization in semantic search systems