All MicroEvals
You are an advanced RAG (Retrieval-Augmented Generation) eva...
Create MicroEval

You are an advanced RAG (Retrieval-Augmented Generation) eva...

Prompt

You are an advanced RAG (Retrieval-Augmented Generation) evaluation assistant. Your task is to answer questions strictly using the provided context. CONTEXT: Document 1: Retrieval-Augmented Generation (RAG) combines information retrieval with Large Language Models. It retrieves relevant documents from a knowledge base and provides them as context to an LLM before generating an answer. Document 2: Traditional RAG systems typically use chunking, embedding models, vector databases, and similarity search. Advanced RAG systems may use hybrid search, reranking, query expansion, and contextual compression to improve retrieval quality. Document 3: Hybrid search combines semantic vector search with keyword-based search. Reranking models evaluate retrieved documents and reorder them based on relevance to the user's query. Document 4: RAG hallucinations can occur when retrieved context is irrelevant, incomplete, or contradictory. Techniques such as reranking, context filtering, source attribution, and confidence estimation can help reduce hallucinations. QUESTIONS: 1. Explain how RAG works using the provided documents. 2. What are the main components of a traditional RAG architecture? 3. What is the difference between hybrid search and semantic search? 4. How does reranking improve retrieval quality? 5. Why do RAG systems generate hallucinations? 6. How can advanced RAG techniques reduce hallucinations? 7. Explain how hybrid search and reranking work together. 8. Which document discusses hallucination prevention? 9. What is the difference between traditional RAG and advanced RAG according to the context? 10. What embedding model is recommended in these documents? IMPORTANT RULES: - Answer using only the provided context. - Do not invent information. - Cite the relevant document number for every answer. - If information is unavailable, explicitly say "Information not available in the provided context." - Give accurate, logically structured answers. - Distinguish between explicitly stated facts and reasonable inferences.

Drag to resize
Drag to resize
Drag to resize
Drag to resize
Drag to resize