How to evaluate retrieval in RAG pipelines

Автор: Learn Data with Mark

Загружено: 2024-08-04

Просмотров: 4342

Описание:

In this video, we'll learn how to use a library called ranx to evaluate the quality of the search results returned in a RAG pipeline. We'll compare Full-Text Search, Vector Search, and Hybrid Search, all using DuckDB.

#duckdb #rag
Code - https://github.com/mneedham/LearnData...
Ranx - https://amenra.github.io/ranx/
llama.cpp - https://llama-cpp-python.readthedocs....

How to evaluate retrieval in RAG pipelines

Доступные форматы для скачивания:

Скачать видео mp4

Информация по загрузке:

Скачать аудио mp3

Похожие видео

Hybrid Search for RAG in DuckDB (Reciprocal Rank Fusion)

Hybrid Search for RAG in DuckDB (Reciprocal Rank Fusion)

Local RAG with llama.cpp

Local RAG with llama.cpp

2 метода улучшения поиска в RAG

2 метода улучшения поиска в RAG

Advance RAG Course: Master All RAG Retrieval & Reranking Techniques in One Video💡!

Advance RAG Course: Master All RAG Retrieval & Reranking Techniques in One Video💡!

Find the BEST RAG Strategy with Domain Specific Evals

Find the BEST RAG Strategy with Domain Specific Evals

Evaluating Retrieval for RAG (Contextual AI)

Evaluating Retrieval for RAG (Contextual AI)

Все стратегии RAG объясняются за 13 минут (без лишних слов)

Все стратегии RAG объясняются за 13 минут (без лишних слов)

LangExtract + RAG: Smarter Retrieval with Metadata Filtering

LangExtract + RAG: Smarter Retrieval with Metadata Filtering

GraphRAG: союз графов знаний и RAG: Эмиль Эйфрем

GraphRAG: союз графов знаний и RAG: Эмиль Эйфрем

Full-Text Search vs Vector Search (RAG with DuckDB)

Full-Text Search vs Vector Search (RAG with DuckDB)

RAG Evaluation Metrics Explained: Context Precision, Recall, Relevancy & Faithfulness

RAG Evaluation Metrics Explained: Context Precision, Recall, Relevancy & Faithfulness

RAG vs. CAG: Solving Knowledge Gaps in AI Models

RAG vs. CAG: Solving Knowledge Gaps in AI Models

RAGAS - Evaluate your LangChain RAG Pipelines

RAGAS - Evaluate your LangChain RAG Pipelines

RAG But Better: Rerankers with Cohere AI

RAG But Better: Rerankers with Cohere AI

Mastering RAG Evaluation: Metrics and Methods | Retrieval-Augmented Generation

Mastering RAG Evaluation: Metrics and Methods | Retrieval-Augmented Generation

How to evaluate an LLM-powered RAG application automatically.

How to evaluate an LLM-powered RAG application automatically.

Evaluate AI Agents in Python with Ragas

Evaluate AI Agents in Python with Ragas

LangChain Parent-Child Retriever for better RAG

LangChain Parent-Child Retriever for better RAG

GraphRAG: графы знаний, полученные с помощью LLM, для RAG

GraphRAG: графы знаний, полученные с помощью LLM, для RAG

Session 7: RAG Evaluation with RAGAS and How to Improve Retrieval

Session 7: RAG Evaluation with RAGAS and How to Improve Retrieval