Hybrid Vector + BM25 Full-Text Search & Reranking RAG Skill

Build high-precision Retrieval-Augmented Generation (RAG) pipelines combining dense vector embeddings, sparse BM25 keyword matching, Reciprocal Rank Fusion

---
name: rag-hybrid-search
description: Build high-precision Retrieval-Augmented Generation (RAG) pipelines combining dense vector embeddings, sparse BM25 keyword matching, Reciprocal Rank Fusion (RRF), and cross-encoder reranking. Use when working with Hybrid Search, Reciprocal Rank Fusion, Vector DB, Citations.
triggers:
  - rag hybrid search
  - hybrid search
  - reciprocal rank fusion
---

# Hybrid Vector + BM25 Full-Text Search & Reranking RAG Skill

## 1. When to Use This Skill
Load `skill-rag-hybrid-search` whenever an engineering or operations task involves **Hybrid Search, Reciprocal Rank Fusion, Vector DB, Citations**. Specifically:
- Build high-precision Retrieval-Augmented Generation (RAG) pipelines combining dense vector embeddings, sparse BM25 keyword matching, Reciprocal Rank Fusion (RRF), and cross-encoder reranking.
- Designing, reviewing, or debugging production configurations without guesswork or deprecated flags.
- Running deterministic pre-flight and post-execution verification checks before reporting completion.

## 2. Prerequisites & Required Environment
- **Target Stack:** Hybrid Search, Reciprocal Rank Fusion, Vector DB, Citations
- **Permissions:** Read-only inspection by default; ask for explicit confirmation before executing destructive mutations or production deployments.
- **Reference Repository:** `https://qdrant.tech/documentation/`

## 3. Step-by-Step Execution Playbook
1. **Context & Configuration Discovery:**
   Inspect existing project manifests (`package.json`, `wrangler.jsonc`, schema files, or environment declarations) before proposing changes. Never overwrite existing bindings or credentials blindly.
2. **Deterministic Implementation:**
   Apply the canonical patterns for **Hybrid Search**:
   - Enforce strict schema/type validation at every external boundary.
   - Include explicit error handling, structured logging, and idempotency keys on all mutating calls.
   - Keep secrets in environment variables or secret stores—never hardcode tokens in source files.
3. **Verification & Regression Gate:**
   Run the verification commands below and inspect both exit codes and output payloads before marking the task complete.

## 4. Reference Commands & CLI Workflow
```bash
npx lightstate inspect qdrant-mcp
```

## 5. Edge Cases & Anti-Hallucination Guardrails
- **Zero Unverified Claims:** Never claim a deployment, migration, or API call succeeded without inspecting the command output or HTTP status code.
- **Rollback Readiness:** Always record the previous state or migration version so changes can be reverted cleanly if downstream health checks fail.

Synthesized Engineering Blueprint & Setup Guide