Authority page
Local LLM serving in India: benchmark methodology
Ollama, vLLM and local inference guidance without unsupported synthetic benchmark numbers.
The historical draft contained performance numbers compiled from mixed sources. Those numbers are not migrated as BestAIAgent.in benchmark facts.
A future India benchmark should publish hardware, model, quantization, concurrency, prompt set, software version, power measurement and raw outputs before declaring a performance winner.
For now, this page acts as a reproducibility checklist and links to verified Indian model cards.
Verified Indian model cards
- Sarvam-30B — verified
- Sarvam-105B — verified
- OpenHathi-7B-Hi-v0.1-Base — verified
- Airavata — verified
- Krutrim-2-Instruct — verified
- Bark — verified
- Whisper — verified
- Faster-Whisper — verified
- WhisperX — verified
- Silero Models — verified
- MiniCPM 3B — verified
- Intern 7B — verified
- DeepSeek-V2 — verified
- ChatGLM — verified
- StarCoder2 — verified
- Zephyr — verified