RAG & Vector Search in Production

Chunking, embeddings, hybrid search, re-ranking and evaluation — build a retrieval layer that holds up under real queries.

⏰ 6 weeks🎯 Standard🧩 Certificate🖥 Any device · our GPUs
Generated from this course

🎯 About this course

Most RAG demos fall apart on real documents and real users. This course teaches the engineering that fixes that. You will design chunking that preserves context, build a vector store from first principles, add BM25 and rank fusion, re-rank and filter by permission, and — most importantly — measure everything with recall@k, MRR and nDCG.

The final unit teaches grounding: numbered sources, citation verification, confidence thresholds and prompt-injection defences. Labs are dependency-light and auto-graded, and the applied studio has you improve a real handbook-QA pipeline with an experiment log.

Who it is for

Engineers who already call LLM APIs and now need retrieval that works at scale.

What makes it different

Every technique is paired with a metric and a failure analysis, not just a code recipe.

By the end you will be able to

  • Design chunking strategies that preserve context and metadata, and justify chunk size with measurements.
  • Explain embeddings, similarity metrics and exact versus approximate search, and build a working vector store with metadata filtering.
  • Implement hybrid retrieval combining BM25 and vector search with rank fusion.
  • Apply re-ranking, MMR and retrieval-time access control to raise precision without leaking restricted content.
  • Build retrieval evaluation sets and compute recall@k, MRR and nDCG to compare and tune retrievers.
  • Ground answers with verified citations and calibrated "I don't know" behaviour, and defend against prompt injection in retrieved text.
  • Deliver a measured, permission-aware RAG pipeline with an experiment log documenting each improvement.
Curriculum

Topics covered

Core topics 6 topics

  • Chunking strategies and trade-offs
    In production, chunking decisions interact with your indexing pipeline's cost and your re-indexing story — changing chunk size means re-embedding your whole corpus…
  • Embeddings and vector stores
    At production scale, the vector store choice — managed service vs. self-hosted, exact vs.
  • Hybrid keyword + vector search
    Running hybrid search in production means operating two retrieval systems — a search index and a vector index — and a fusion step, which is real infrastructure to…
  • Re-ranking and metadata filtering
    Re-ranking adds a model call, or a cross-encoder inference, to your retrieval path — budget the added latency explicitly and consider caching or batching if it becomes a…
  • Building a retrieval evaluation set
    In production, refresh your retrieval eval set from real query logs regularly, with PII handled correctly, so it stays representative of what users actually ask.
  • Citations and “I don't know” handling
    Production systems should log which chunks were cited for every answer so you can audit and improve retrieval later, and should have a measured, monitored rate of "I…
Hands-on

Applied lab: a production-grade retrieval pipeline

  • Guided lab: build and measure a retrieval pipeline
    Index a real handbook, run hybrid retrieval, measure it, fix the worst failures and ship grounded answers.
Course at a glance

See how this course is built

Where the time goes

Longer spokes mean more hours on that module.

Course roadmap click a step

Try a lesson0 / 3

Sample questions from this course. Your progress is kept only in your browser.

Week by week

Drag the slider, or press play, to walk through the course and see what you will have built by each week.

Week 1 of 6
Wk 1–2

Index and retrieve

You produceA working RAG pipeline over a supplied corpus
Wk 3–4

Better retrieval

You produceHybrid search plus re-ranking, measured against a labelled set
Wk 5–6

Evaluation and hardening

You produceA retrieval evaluation report and a documented service

What you'll build

Hybrid retrieval pipeline

Chunking, vector + BM25 retrieval with fusion, re-ranking/MMR and metadata filters.

Retrieval evaluation set and experiment log

A 40+ question evaluation set including unanswerable questions, and a log of measured improvements.

Measured, grounded RAG service

A cited-answer service with refusal gating, permission filtering and a written cost/latency analysis.

Why take this course

  • Measure retrieval with recall@k, MRR and nDCG — not vibes
  • Hybrid search and re-ranking that fix real failures
  • Permission-safe retrieval and prompt-injection awareness
  • Auto-graded labs that need no API key or GPU

You will build

  • A structure-aware chunker that keeps metadata for citations
  • An in-memory vector store with cosine search and filters
  • BM25 plus reciprocal rank fusion from scratch
  • A retrieval evaluation harness and an experiment log
  • A citation verifier and refusal gate

What you can do afterwards

  • Diagnose and fix retrieval failures with evidence
  • Ship RAG that cites sources and refuses when unsure
  • Explain retrieval trade-offs to product and security stakeholders
Career fit

🧭 Where this fits

Roles whose screened skills map to this course, and the skills it lets you show.

LLM / Generative-AI Engineer

This course covers skills employers screen for in this role.

See pay bands & learning path →

Skills you will build

  • Retrieval & vector search in production
  • Retrieval evaluation & grounded citations
  • Retrieval-augmented generation, vector search
How to take it

💳 Delivery & fees

One course, four ways to attend. Fees are per course, in rupees excluding 18% GST (the GST-inclusive amount is shown too) with Canadian-dollar fees alongside.

Self-paced

₹7,500

+ 18% GST · ₹8,850 all-in

CA$1,450 + applicable tax (Canada)

Programme ₹6,500 + infrastructure & GPU labs ₹1,000

≈ ₹1,250 per week ex-GST over 6 weeks

  • Full recorded library
  • Browser GPU lab
  • All project briefs
  • Mentor review add-on
Most popular

Live online

₹18,500

+ 18% GST · ₹21,830 all-in

CA$3,650 + applicable tax (Canada)

Programme ₹16,100 + infrastructure & GPU labs ₹2,400

≈ ₹3,083 per week ex-GST over 6 weeks

  • Everything in self-paced
  • Scheduled live classes
  • 1:8 mentor code review
  • Cohort + capstone review
  • Up to 3 instalments

Hybrid — weekend

₹20,500

+ 18% GST · ₹24,190 all-in

CA$4,000 + applicable tax (Canada)

Programme ₹17,800 + infrastructure & GPU labs ₹2,700

≈ ₹3,417 per week ex-GST over 6 weeks

  • Recorded weekday lessons
  • Live weekend sessions
  • Full mentor review
  • Cohort + capstone
  • Up to 3 instalments

Live in-person

₹24,500

+ 18% GST · ₹28,910 all-in

CA$4,750 + applicable tax (Canada)

Programme ₹21,300 + infrastructure & GPU labs ₹3,200

≈ ₹4,083 per week ex-GST over 6 weeks

  • Everything in live online
  • Classroom instruction
  • On-site mentor time
  • In-person study group
  • Up to 3 instalments

Your fee includes our GPU lab infrastructure — no cloud credits to buy. See how we compare, with sources →

Ready when you are

Apply for this course

Tell us the format you prefer and we'll confirm the next cohort date and your fee on a short call.

Apply for this course