Claude Sonnet 5.5

Leaderboards

Where Claude Sonnet 5.5 sits among the top 20 in each category.

By task

Scored from votes on each kind of prompt alone, on the same 1,000-point scale.

Test results

Every test Claude Sonnet 5.5 has a published result on, out of 100%, with its rank among the models that took it.

• SWE-Bench Pro

  #2 / 63

  Harder, longer software engineering tasks from real codebases.

  81.3%

  Self-reported · In the coding score

• DeepSWE 1.1

  #18 / 52

  DeepSWE 1.1 evaluates software engineering agents using the mini-swe-agent harness.

  71.0%

  Self-reported · In the coding score

• SWE-bench Multilingual

  #2 / 50

  A multilingual benchmark for issue resolving in software engineering that covers Java, TypeScript, JavaScript, Go, Rust, C, and C++. Contains 1,632 high-quality instances carefully annotated from 2,456 candidates by 68 expert annotators, designed to evaluate Large Language Models across diverse software ecosystems beyond Python.

  90.3%

  Self-reported

• Terminal-Bench 4.0

  #1 / 31

  Terminal-Bench 4.0 evaluates AI agents on real-world work in terminal and command-line containerized environments across 66 tasks, with emphasis on science-adjacent and frontier engineering problems. Relative to earlier Terminal-Bench releases, 4.0 increases timeouts and adaptively raises RAM/CPU on selected tasks to reduce harness and resource confounds.

  70.6%

  Self-reported · In the coding score· In the agents score

• AutomationBench

  #9 / 27

  AutomationBench is a tool-use benchmark that evaluates AI agents on automating real-world workflows, testing their ability to orchestrate tools and complete multi-step automation tasks.

  44.7%

  Self-reported · In the agents score

• FrontierCode 1.1

  #5 / 24

  FrontierCode 1.1 evaluates whether coding-agent changes are mergeable, using unit tests, maintainer-defined rubrics, and verifiers. Runs flagged for unfair internet use receive a zero score.

  52.1%

  Self-reported · In the coding score

• HealthBench Professional

  #1 / 20

  HealthBench Professional evaluates model capability and safety for clinician use cases using real clinician-style chats and physician-authored grading rubrics.

  69.2%

  Self-reported

• Program Bench

  #3 / 18

  Program Bench evaluates code-generation agents by asking them to recreate a program's behavior from only a compiled binary and documentation. It spans 200 tasks from small CLI tools to large systems such as FFmpeg and SQLite, with submissions judged against more than 248,000 fuzz-generated behavioral tests.

  79.7%

  Self-reported · In the coding score

• HealthBench

  #1 / 15

  An open-source benchmark for measuring performance and safety of large language models in healthcare, consisting of 5,000 multi-turn conversations evaluated by 262 physicians using 48,562 unique rubric criteria across health contexts and behavioral dimensions

  65.4%

  Self-reported

• Legal Agent Benchmark

  #2 / 15

  The Legal Agent Benchmark (LAB) is Harvey's open-source benchmark for evaluating AI agents on complex, long-horizon legal work. Tasks are scored under an all-pass standard against expert-curated rubrics, where a task passes only if every required rubric criterion (facts, conclusions, citations, structure, and analytical moves) passes.

  11.7%

  Self-reported

• Humanity's Last Exam (no tools, text-only)

  #2 / 14

  Text-only Humanity's Last Exam variant evaluated without tool use.

  56.9%

  Self-reported

• OfficeQA Pro

  #7 / 13

  OfficeQA Pro evaluates AI models on professional knowledge-work questions and tasks drawn from real office workflows, including document analysis, spreadsheet reasoning, and information synthesis across business domains.

  65.6%

  Self-reported

• Terminal-Bench-Science 0.1

  #3 / 10

  Terminal-Bench-Science 0.1 is a Stanford-led community benchmark of 70 tasks drawn from scientific research workflows across the life, physical, earth, mathematical, and engineering sciences. Tasks are authored and reviewed by scientists and researchers; scores are typically reported as accuracy with relatively large standard error due to strongly bimodal per-task outcomes.

  59.9%

  Self-reported

• BenchCAD

  #1 / 8

  BenchCAD is a benchmark for programmatic CAD reasoning built from 17,900 execution-verified CadQuery programs spanning 106 industrial part families, roughly half anchored to real ISO, DIN, EN, ASME, and IEC specification tables. It decomposes CAD capability into matched tasks; the Vision2Code task requires models to generate CadQuery code from multi-view renders, scored by voxel IoU against the reference geometry.

  74.7%

  Self-reported

• BenchCAD (with Python tool)

  #1 / 8

  BenchCAD variant evaluated with access to a Python tool for programmatic CAD reasoning.

  96.3%

  Self-reported

• BioMysteryBench

  #3 / 8

  BioMysteryBench evaluates a model's ability to reason through challenging molecular biology problems, reporting performance on a hard subset and on the subset of problems solved by human experts.

  89.2%

  Self-reported

• Global-MMLU

  #2 / 8

  A comprehensive multilingual benchmark covering 42 languages that addresses cultural and linguistic biases in evaluation, with improved translation quality and culturally sensitive question subsets.

  92.1%

  Self-reported

• Chartography

  #1 / 7

  Chartography evaluates professional chart understanding with 100 expert-written tasks drawn from real charts across science, engineering, finance, manufacturing, supply chain, and healthcare.

  90.2%

  Self-reported

• OSWorld 2.1 (partial)

  #2 / 7

  Partial-credit computer-use score on OSWorld 2.1, as reported in the Claude Sonnet 5.5 release. Separate from OSWorld 2.0 and strict completion scores.

  80.1%

  Self-reported

• SWE-Bench Multimodal

  #3 / 7

  SWE-Bench Multimodal extends SWE-Bench to evaluate language models on software engineering tasks that involve visual inputs such as screenshots, UI mockups, and diagrams alongside code understanding.

  54.3%

  Self-reported

• AA-Briefcase v1.1

  #2 / 6

  AA-Briefcase v1.1 evaluates multi-hour professional office work and reports Elo scores. Kept separate from unversioned AA-Briefcase results.

  60.4%

  Self-reported

• FrontierSWE V2

  #2 / 6

  FrontierSWE V2 evaluates agents on open-ended technical projects and reports mean@5. Kept separate from FrontierSWE V1 dominance-score results, which are not comparable.

  61.9%

  Self-reported

• GDPval-AA 2.1

  #3 / 6

  Version 2.1 of the Artificial Analysis GDPval evaluation of professional knowledge work, reported as an Elo rating.

  61.5%

  Self-reported

• Humanity's Last Exam (with tools)

  #2 / 6

  Full multimodal Humanity's Last Exam evaluated with tool use enabled, distinct from its text-only subset.

  64.5%

  Self-reported

• OSWorld 2.1 (strict)

  #1 / 6

  Strict pass rate on OSWorld 2.1: fraction of tasks where every graded checkpoint is satisfied. Separate from the OSWorld 2.1 partial-credit score and from OSWorld 2.0.

  43.5%

  Self-reported

• Toolathlon-Verified

  #1 / 6

  Verified Toolathlon evaluation of agent tool-use capability, as reported in the MiMo-V2.6 release.

  77.8%

  Self-reported

• ArXivMath

  #2 / 5

  ArXivMath is a final-answer benchmark of research-level mathematics maintained by MathArena. Problems are extracted monthly from recent arXiv paper abstracts, then filtered through automated and manual checks to ensure they are self-contained, non-trivial, and verifiable. Because problems are drawn from active research, the benchmark is more realistic and more closely connected to mathematical research than contest or olympiad benchmarks.

  86.8%

  Self-reported

• Chartography (no tools)

  #3 / 4

  Chartography visual chart recognition evaluated without tools, distinct from tool-assisted results.

  61.6%

  Self-reported

• CursorBench 4.0

  #2 / 3

  CursorBench 4.0 evaluates coding agents on long-horizon coding tasks from real Cursor sessions. Version 4.0 adds longer-horizon tasks; scores are not comparable with CursorBench 3.2.

  55.5%

  Self-reported

• FrontierCode 1.1 (Extended)

  #1 / 3

  FrontierCode 1.1 Extended subset: agentic coding tasks graded for mergeable patches, reported separately from the Main subset.

  64.4%

  Self-reported

• LatchBio SingleCellBench

  #2 / 3

  LatchBio SingleCellBench tests analysis of single-cell RNA sequencing data across problems spanning standard workflows such as labeling cell types, finding differentially expressed genes, and correcting batch effects.

  59.1%

  Self-reported

• LatchBio SpatialBench Verified

  #1 / 3

  LatchBio SpatialBench Verified tests analysis of spatial transcriptomics data across externally validated problems, requiring the model to answer biological questions about the sample from analysis results.

  72.5%

  Self-reported

• MILU

  #2 / 3

  Multi-task Indic Language Understanding (MILU) covers 11 languages—10 Indic languages (Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Odia, Punjabi, Tamil, and Telugu) and English—and tests culturally grounded knowledge comprehension.

  91.6%

  Self-reported

• OfficeQA

  #2 / 3

  OfficeQA is a Databricks public benchmark that evaluates end-to-end grounded reasoning over a large corpus of historical U.S. Treasury Bulletin documents. Models must locate relevant tables across the corpus and perform precise numerical reasoning over them.

  76.9%

  Self-reported

• Biomedical image analysis

  #1 / 2

  Biomedical image analysis: quantitative analyses of biomedical images using domain tools.

  72.2%

  Unverified

• HealthBench Professional (raw)

  #1 / 2

  HealthBench Professional score before length adjustment. Distinct from the length-adjusted HealthBench Professional catalog metric.

  77.1%

  Unverified

• Medicinal Chemistry (ADME)

  #1 / 2

  Medicinal chemistry ADME evaluation: 504 questions asking which real drug-discovery compounds have the highest or lowest measured absorption, distribution, or metabolism-related property.

  65.3%

  Unverified

• Morphology-to-molecule matching

  #2 / 2

  Axiom Bio morphology-to-molecule matching: match multi-channel cell imaging data from a human liver in-vitro assay to shuffled molecule-dose perturbations.

  25.0%

  Unverified

• PhysicianBench

  #1 / 2

  PhysicianBench is a public benchmark of 100 physician tasks carried out in an electronic health record (EHR), measuring agentic clinical task completion.

  63.2%

  Unverified

• Protein Design — Library Ranking

  #1 / 2

  Protein design Library Ranking task: prioritize protein designs for experimental testing.

  54.8%

  Unverified

• Protein Design — Sequence Generation

  #1 / 2

  Protein design Sequence Generation task: generate novel protein sequences conditioned on design constraints.

  51.0%

  Unverified

• Protocols Troubleshooting

  #1 / 2

  Molecular biology Protocols Troubleshooting variant: detect and fix issues in laboratory protocols.

  67.3%

  Unverified

• Protocols Understanding (V2)

  #1 / 2

  Protocols Understanding (V2) (Benchling): given a real laboratory protocol, answer a practical question about applying or adapting it.

  66.6%

  Unverified

• ArXivMath (with tools)

  #1 / 1

  ArXivMath final-answer accuracy with a code-execution sandbox (no internet), distinct from the without-tools setting.

  95.2%

  Unverified

• BioMysteryBench (Human Difficult)

  #1 / 1

  BioMysteryBench Human Difficult subset: problems that human experts did not solve, separate from the Human Solvable subset.

  44.7%

  Unverified

• De novo protein binder design

  #1 / 1

  De novo protein binder design: for each of 15 protein targets, design a set of 30 miniprotein binders within a fixed 24-hour wall-clock budget given the target structure.

  82.3%

  Unverified

• HealthBench (raw)

  #1 / 1

  HealthBench score before length adjustment. Distinct from the length-adjusted HealthBench catalog metric.

  69.4%

  Unverified