Skip to main content

Hermes 4 - Llama-3.1 405B (Non-reasoning)

Nous ResearchLlama
Release Date
2025-08-27
Parameters
Context Length
Modalities

Capability Radar

27
general
50
coding
22
reasoning
37
scienceest.
80
agents
0
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking269
34.0
AA
General Ranking330
33.0
AA
Math Reasoning320
15.0
AA
Science303
38.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA50.5%SR

Code

HumanEval88.4%SR

Finance

MMLU86.0%SR
MMLU-Pro68.9%SR

General

IFEval92.1%SR
MBPP EvalPlus87.6%SR
BFCL v277.3%SR

Math

MGSM91.1%SR
MATH77.0%SR

AA Evaluation Indices

Math Index
15.3
Intelligence Index
8.8
Mmlu Pro
0.7
Livecodebench
0.5
Gpqa
0.5
Ifbench
0.3
Scicode
0.3
Tau2
0.3
Lcr
0.2
Aime 25
0.2
Terminalbench Hard
0.1
Hle
0.0

LLM Stats Category Scores

Instruction Following
90
Structured Output
90
Code
90
Language
80
Legal
80
Math
80
Reasoning
80
Finance
80
Healthcare
80
Tool Calling
80
General
70
Physics
50
Biology
50
Chemistry
50

Pricing

Input Price$1 / 1M tokens
Output Price$3 / 1M tokens
Blended Price (3:1)$1.5 / 1M tokens

Speed

Tokens/sec42.2
Time to First Token0.78s
Time to Answer0.78s

Provider Price Ranking

Provider Price Ranking

1 providers

ProviderInputOutput
1Nous ResearchPRIMARY
$1
$3

Compare pricing across different API providers for this model.

External Sources