Architecture

How the portfolio thinks

Two surfaces, same product language as Ops: the always-on Bedrock RAG path, and the approval-gated ephemeral EKS LangGraph lab.

Architecture surface

Public Experience

  • Visitor Browser[agentic]

    public website entrypoint

  • Portfolio Ops Panel[agentic]

    Ask · Inspect · Evaluate

  • Eval Badge[agentic]

    47 / 50 passing

Edge + API

  • CloudFront Edge[agentic]

    one public hostname for every surface

  • Query API[agentic]

    answer + inspect + traceId

  • Eval API[agentic]

    runs + summary

  • Trace API[agentic]

    trace by id + drill-in

  • Core APIs[agentic]

    ingest + docs

Thin Agent Layer

  • Orchestrator[agentic]

    thin workflow, not a giant agent

  • Retrieval Tool[agentic]

    RAG is one tool

  • Self-Check[agentic]

    LLM-as-judge grounding

  • Guard + Fan-out[agentic]

    grounding guardrail · profile fan-out

  • Concept Router[agentic]

    abstract terms → project evidence

Knowledge + Models

  • Hybrid Embed[agentic]

    Titan dense + BM25 sparse query path

  • Hybrid Retrieval[agentic]

    RRF fusion + score floor

  • Qdrant[agentic]

    hybrid collection

  • Answer Model[agentic]

    final answer + inspect payload

State + Storage

  • Quota Push (IoT Core)

    MQTT/WSS retained · live

  • Upload + Meta[agentic]

    core corpus state

  • Session Store[agentic]

    thread memory only

  • Trace Store[agentic]

    query-level artifacts

Evals + Traces

  • Trace Builder[agentic]

    step-by-step answer trace

  • Eval Runner[agentic]

    scheduled and on-demand

  • Golden Query Suite[agentic]

    Narrow Gate, Mara Voss, webhook pipeline

  • Threshold Judge[agentic]

    source, retrieval, answer, latency

  • Eval Results[agentic]

    public pass/fail history

Baseline mode traces the single-shot RAG path; Agentic mode is the live bounded loop, plan → retrieve → self-check → answer, with the grounding guardrail, the deterministic profile fan-out, and a concept router that bridges abstract questions (race conditions, idempotency) to the right project evidence. Broad profile answers are now forced to stand on project evidence rather than an indexed biography shortcut. Uploads are session-scoped: retrieved only for the visitor who added them. Retrieval is hybrid today: Titan dense embeddings plus BM25 sparse vectors fused in Qdrant with a calibrated confidence floor.

Cloud infrastructure

AWS · multi-region · serverless

The same system drawn with the official AWS Architecture Icons, the real services, regions, and request flow behind the demo, with the denial-of-wallet guardrails called out.

Genuine AWS Architecture Icons · multi-region serverless RAG
Portfolio RAG cloud architectureBrowser to Vercel to CloudFront with AWS WAF, splitting to streaming Lambdas in ap-south-1 and a core HTTP API in ap-south-2, backed by Amazon Bedrock and Qdrant for models and DynamoDB, S3 and SSM Parameter Store for state.Portfolio RAG - Cloud ArchitectureMulti-region serverless RAG behind one hostname · api.arupdas.comCLIENT · EDGEus-east-1VisitorbrowserVercelNext.js · arupdas.comAWS WAFrate limit · 100 / 5 min · IPCloudFrontapi.arupdas.comAWS Budgets$5 / day backstopStreaming · Lambda Function URLsap-south-1 · MumbaiCore API · HTTP API Gatewayap-south-2 · Hyderabadresponse-stream · agentic loop · per-IP + global quotaQuery/querySearchReady/search-readyIngest/ingestDelete/documents-deleteHTTP API Gatewayhealth · corpus · docs · quotasCorpusDocsSearchSeed/query · /search-ready · /ingest · /documents-deleteall routesSTATE · STORAGEap-south-2DynamoDB · Rate+Metaquotas (global + per-IP) · doc metaDynamoDB · Sessionschat thread historyS3 · Uploadsephemeral visitor files · TTLSSM Parameter StoreQdrant key · SecureStringstate I/OMODELS · RETRIEVALBedrock + QdrantBedrock · Titan v2dense embeddingsQdranthybrid vectors · us-east-1Bedrock · Nova Progeneration + tool-use · us-east-1hybrid querycontextembed + sparse querystream answerGUARDRAILSWAF rate rule · per-IP quota · global daily quota · per-call token caps · $5/day budgetRequest path → · state & model I/O ┄ · Service marks: AWS Architecture Icons (Bedrock recreated to match)

The diagram shows what the system is. These records cover why: the alternatives I rejected and the costs I took on, each verifiable in the live system.

AboutEMpathWritingProductionConnect