All benchmarks
AI4Bharat · India · Released 2024-05

IndicTrans2 / AI4Bharat Suite

Open translation and understanding models from IIT Madras covering all 22 scheduled Indian languages.

Access
open
Context
4,096 tokens
Modalities
text
Languages
22 Indian languages

Benchmark scores

MMLU
N/A
Massive Multitask Language Understanding
GPQA
N/A
Graduate-level science QA (Diamond)
HumanEval
N/A
Python code completion
SWE-bench
N/A
Real GitHub issue resolution (Verified)
LiveCodeBench
N/A
Contamination-free coding
AIME
N/A
American Invitational Mathematics Exam
MMMU
N/A
Multimodal college-level reasoning
MATH
N/A
Competition-level math word problems

Scores as reported by the vendor or leading public leaderboards. "N/A" means the score has not been publicly disclosed for this metric.

Explain like I'm 5

Open research models for translating and understanding Indian languages.

Key features
  • Fully open
  • 22 languages
  • Translation + STT + TTS
Strengths
  • Open license
  • Broad Indic coverage
Limitations
  • Not a chat LLM

Best for

TranslationSpeech research

Related models