DeepHermes 3 - Mistral 24B Preview (Non-reasoning)
Nous ResearchMistral
Release Date
2025-03-13
Parameters
—
Context Length
—
Modalities
—
Capability Radar
21
general
20
coding
28
reasoning
26
science
26
agents
0
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 412 | 21.0 | AA |
| General Ranking | 467 | 25.0 | AA |
| Science | 467 | 25.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))No benchmark data available
AA Evaluation Indices
(Artificial Analysis)Intelligence Index(Artificial Analysis)5.0
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))0.6
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))0.6
Gpqa(NYU + Cohere + Anthropic (2023))0.4
Scicode(UIUC + Argonne National Lab (2024))0.2
Livecodebench(UC Berkeley + MIT + Cornell (2024))0.2
Aime(MAA (Mathematical Association of America))0.0
Hle(Center for AI Safety + Scale AI (2025))0.0
LLM Stats Category Scores
(LLM Stats (zeroeval))No category score data available
Pricing
Input PriceFree
Output PriceFree
Blended Price (3:1)Free
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
No provider data available