Skip to content

Qwen apache_2_0 Released Nov 28, 2024 Updated

QwQ-32B-Preview

ToolsGuide Scores, rankings, test results and price.

Model summary

  • Text #315 / 416

    145 / 1,000

    ToolsGuide Score· votes 116, tests 191

  • Price per 1M tokens

    No listed price

Summary

QwQ-32B-Preview is Qwen's model, released Nov 28, 2024. It's ranked in 1 category and does best at text: #315 of 416, with a ToolsGuide Score of 145 against a median of 235.

It has published results on 4 tests.

Specifications

Creator
Qwen
Licence
apache_2_0
Released
Nov 28, 2024
Context window
–
Input price
–
Output price
–
Tests reported
4
Settings ranked
qwq-32b-preview

Model comparison

Against the ten best text models.

Text score

ToolsGuide Score out of 1,000 · Higher is better

Input price

USD per 1M input tokens · Lower is better

Leaderboards

Where QwQ-32B-Preview sits among the top 20 in each category.

Text

#315 of 416 · ToolsGuide Score out of 1,000, where 1,000 is a flawless model

Full text leaderboard →

By task

Scored from votes on each kind of prompt alone, on the same 1,000-point scale.

Against its nearest rivals

Text prompts by kind · ToolsGuide Score from votes · hover for values

Text

qwq-32b-preview · hover a bar for its rank

Test results

Every test QwQ-32B-Preview has a published result on, out of 100%, with its rank among the models that took it.

  • GPQA

    #168 / 256

    Graduate-level science questions written to be hard to look up.

    65.2%

    Self-reported

  • LiveCodeBench

    #48 / 76

    LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code. It continuously collects new problems from programming contests (LeetCode, AtCoder, CodeForces) and evaluates four different scenarios: code generation, self-repair, code execution, and test output prediction. Problems are annotated with release dates to enable evaluation on unseen problems released after a model's training cutoff.

    50.0%

    Self-reported

  • AIME 2024

    #47 / 54

    American Invitational Mathematics Examination 2024, consisting of 30 challenging mathematical reasoning problems from AIME I and AIME II competitions. Each problem requires an integer answer between 0-999 and tests advanced mathematical reasoning across algebra, geometry, combinatorics, and number theory. Used as a benchmark for evaluating mathematical reasoning capabilities in large language models at Olympiad-level difficulty.

    50.0%

    Self-reported

  • MATH-500

    #26 / 34

    MATH-500 is a subset of the MATH dataset containing 500 challenging competition mathematics problems from AMC 10, AMC 12, AIME, and other mathematics competitions. Each problem includes full step-by-step solutions and spans multiple difficulty levels across seven mathematical subjects including Prealgebra, Algebra, Number Theory, Counting and Probability, Geometry, Intermediate Algebra, and Precalculus.

    90.6%

    Self-reported