Grounded LLM

What's in v0.4.0

• Tenant isolation — API-key binding, membership enforce, hashed keys, closed /metrics
• Verify 2.0 — lexical faithfulness (warn/enforce) + optional NLI hook
• RAG quality — e5 prefixes, incremental reindex, Recall@k / nDCG / citation precision
• Multi-replica SaaS — tenants, quotas, admin users in Postgres; Redis rate limit
• Release gate — CI → Trivy → cosign + SBOM; Helm NetworkPolicy / PDB
• SDKs — Python + TypeScript/JavaScript clients
• Local inference — Ollama / vLLM profiles; Redis response cache; gRPC Retriever
• Quality gate — 99 retrieval eval cases in CI

Guide: Changelog · LLM providers

What makes it a standard

• Grounded Spec v1 — normative API contract
• RFC-0001 — «Grounded-compatible» definition
• Conformance suite — run against any deployment
• Public benchmark — 99 retrieval + adversarial eval

Quick start

git clone https://github.com/kantik001/grounded-llm.git
cd grounded-llm
cp .env.example .env
# Optional local LLM: LLM_PROVIDER=ollama + docker compose --profile ollama up -d --build
docker compose up -d --build

pip install -r conformance/requirements.txt
python -m conformance spec

Full guide: Deploy · LLM providers · SDK

Tagged images on GHCR: ghcr.io/kantik001/grounded-llm-server:0.4.0 · -python · -webapp

Check compatibility

# Offline (OpenAPI)
python -m conformance spec

# Live server
python -m conformance check --url http://localhost:8080

# JSON output for CI
python -m conformance spec --json

Official template packs

• hr · domain default · eval default_en
• it_support · domain it_support · eval it_support
• legal_faq · domain legal_faq · eval legal_faq

All packs · registry: packs/registry.yaml

Strategy & roadmap

Standard strategy · Ecosystem · Roadmap · RFC process