LightState Registry / Verified X Builder Use Cases / Engineering & DevOps / rag-hybrid-bm25-reranker-evaluation-pipeline
⚡ Pulse Score 79/100
Production RAG Hybrid Search & Cross-Encoder Rerank Eval
Benchmark dense embeddings + BM25 sparse retrieval + Cohere/BGE reranking against a golden question-answer dataset.
⚡ 1-Click Agent & Developer Install
Zero Auth · Ready for Grok Bot, Claude Code & Cursornpx lightstate inspect rag-hybrid-bm25-reranker-evaluation-pipeline
Copy-Paste System Prompt / Routine Blueprint:
Run the 'Production RAG Hybrid Search & Cross-Encoder Rerank Eval' (rag-hybrid-bm25-reranker-evaluation-pipeline) implementation blueprint using Qdrant MCP, Postgres MCP, GitHub MCP. Objective: Benchmark dense embeddings + BM25 sparse retrieval + Cohere/BGE reranking against a golden question-answer dataset. Step 1: Perform a read-only audit of current state and recent logs. Step 2: Generate a deterministic execution plan with exact diffs, SQL/CLI commands, or drafted payloads. Step 3: Request human confirmation before applying any production writes or external sends.
Synthesized Engineering Blueprint & Setup Guide
### 1. Problem & Operational Bottleneck
Benchmark dense embeddings + BM25 sparse retrieval + Cohere/BGE reranking against a golden question-answer dataset. Built and battle-tested in production workflows by **@steipete** (Peter Steinberger (@steipete)).
### 2. Target Architecture & Required Stack
- **Qdrant MCP**
- **Postgres MCP**
- **GitHub MCP**
### 3. Step-by-Step Implementation Blueprint
1. Configure and authenticate the required MCP connectors (Qdrant MCP, Postgres MCP, GitHub MCP) in your agent workspace.
2. Run the initial read-only inspection pass for 'Production RAG Hybrid Search & Cross-Encoder Rerank Eval' to gather baseline telemetry, schemas, and context.
3. Execute the multi-step analysis and transformation pipeline with strict schema validation and zero fabricated identifiers.
4. Review the staged diff or approval card and verify completion via automated regression and status checks.
### 4. Copy-Paste Agent Execution Prompt
```markdown
Run the 'Production RAG Hybrid Search & Cross-Encoder Rerank Eval' (rag-hybrid-bm25-reranker-evaluation-pipeline) implementation blueprint using Qdrant MCP, Postgres MCP, GitHub MCP. Objective: Benchmark dense embeddings + BM25 sparse retrieval + Cohere/BGE reranking against a golden question-answer dataset. Step 1: Perform a read-only audit of current state and recent logs. Step 2: Generate a deterministic execution plan with exact diffs, SQL/CLI commands, or drafted payloads. Step 3: Request human confirmation before applying any production writes or external sends.
```
### 5. Verification & Safety Guardrails
- **Human-in-the-Loop Gate:** All external communications, production database mutations, and billing actions stage an explicit review diff before execution.
- **Deterministic Telemetry:** Every run logs structured JSON output, latency metrics, and source citations so operators can audit every decision.
Tags: #qdrant-mcp#postgres-mcp#github-mcp#blueprint#engineering
✓ CERTIFIED X BUILDER PORTFOLIO
More Capabilities Curated from @steipete
Related Verified Capabilities
Explore Engineering & DevOps → MCP Server ★ Featured Partner ✓ Claimed
⚡ 98
Grok Template ✓ Claimed
⚡ 97
Dr. Eggbot — Meta-Agent Architect & Bot Builder
MCP Server ✓ Claimed
⚡ 89
Visual Sentinel MCP — Automated UI Pixel-Diff & Layout QA Server
MCP Server ✓ Claimed
⚡ 88
Cloudflare Official MCP — Workers, D1, R2, KV & Observability
Use Case
⚡ 95