DeepHermes 3 - Mistral 24B Preview (Non-reasoning)
Nous ResearchMistral
Release Date
2025-03-13
Parameters
—
Context Length
—
Modalities
—
Capability Radar
21
general
20
coding
28
reasoning
26
scienceest.
26
agents
60
multimodal
Science uses a reasoning proxy when dedicated science benchmarks are unavailable.
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 353 | 21.0 | AA |
| General Ranking | 408 | 25.0 | AA |
| Math Reasoning | 263 | 31.0 | AA |
| Science | 404 | 26.0 | AA |
Benchmark Scores (LLM Stats)
Biology
GPQA
71.2%SR
Code
LiveCodeBench
63.6%SR
Creativity
Arena Hard
58.3%SR
Finance
MMLU-Pro
78.0%SR
General
MMMU-Pro
60.0%SR
IFBench
48.0%SR
Language
COLLIE
62.9%SR
Long Context
AA-LCR
71.2%SR
Math
AIME 2025
83.8%SR
AA Evaluation Indices
Intelligence Index5.3
Math 5000.6
Mmlu Pro0.6
Gpqa0.4
Scicode0.2
Livecodebench0.2
Aime0.0
Hle0.0
LLM Stats Category Scores
Legal80
Math80
Finance80
Healthcare80
Language70
Long Context70
Physics70
Reasoning70
Biology70
Chemistry70
Multimodal60
General60
Code60
Creativity60
Vision60
Writing60
Instruction Following50
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
Provider Price Ranking
2 providers
Cheapest: ChutesMost Expensive: NanoGPT
ProviderInputOutput
1ChutesCheapest
$0.0245
$0.0978
2NanoGPT
$0.3
$0.3
Compare pricing across different API providers for this model.