IBM Granite 4.2 3B

Leaderboards

Where IBM Granite 4.2 3B sits among the top 20 in each category.

By task

Scored from votes on each kind of prompt alone, on the same 1,000-point scale.

Test results

Every test IBM Granite 4.2 3B has a published result on, out of 100%, with its rank among the models that took it.

• GPQA

  #188 / 256

  Graduate-level science questions written to be hard to look up.

  54.8%

  Self-reported

• MMLU-Pro

  #102 / 142

  Broad knowledge and reasoning across 14 subjects, ten answer choices each.

  67.8%

  Self-reported

• AIME 2025

  #78 / 123

  Competition maths problems from the 2025 American Invitational Mathematics Exam.

  78.3%

  Self-reported

• LiveCodeBench v6

  #42 / 67

  LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.

  69.7%

  Self-reported

• IFBench

  #21 / 44

  Instruction Following Benchmark evaluating model's ability to follow complex instructions

  74.3%

  Self-reported

• SciCode

  #30 / 30

  SciCode is a research coding benchmark curated by scientists that challenges language models to code solutions for scientific problems. It contains 338 subproblems decomposed from 80 challenging main problems across 16 natural science sub-fields including mathematics, physics, chemistry, biology, and materials science. Problems require knowledge recall, reasoning, and code synthesis skills.

  24.1%

  Self-reported

• HMMT25

  #20 / 28

  Harvard-MIT Mathematics Tournament 2025 - A prestigious student-organized mathematics competition for high school students featuring two tournaments (November 2025 at MIT and February 2026 at Harvard) with individual tests, team rounds, and guts rounds

  66.7%

  Self-reported

• BFCL-V4

  #16 / 21

  Berkeley Function Calling Leaderboard V4 (BFCL-V4) evaluates LLMs on their ability to accurately call functions and APIs, including simple, multiple, parallel, and nested function calls across diverse programming scenarios.

  52.4%

  Self-reported

• Arena-Hard v2

  #19 / 19

  Arena-Hard-Auto v2 is a challenging benchmark consisting of 500 carefully curated prompts sourced from Chatbot Arena and WildChat-1M, designed to evaluate large language models on real-world user queries. The benchmark covers diverse domains including open-ended software engineering problems, mathematics, creative writing, and technical problem-solving. It uses LLM-as-a-Judge for automatic evaluation, achieving 98.6% correlation with human preference rankings while providing 3x higher separation of model performances compared to MT-Bench. The benchmark emphasizes prompt specificity, complexity, and domain knowledge to better distinguish between model capabilities.

  35.0%

  Self-reported

• TAU3-Bench

  #7 / 8

  TAU3-Bench is a benchmark for evaluating general-purpose agent capabilities, testing models on multi-turn interactions with simulated user models, retrieval, and complex decision-making scenarios.

  45.8%

  Self-reported

• ProfBench

  #4 / 4

  ProfBench evaluates models on professional-domain reasoning and knowledge-work tasks, including search-augmented question answering across expert fields.

  32.1%

  Self-reported

• RULER 128k

  #4 / 4

  RULER 128k evaluates the official 13-task RULER v1 suite at a 131072-token context budget.

  55.3%

  Self-reported

• RULER 64k

  #4 / 4

  RULER 64k evaluates the official 13-task RULER v1 suite at a 65536-token context budget.

  67.5%

  Self-reported