Skip to main content

Hermes 4 - Llama-3.1 405B (Reasoning)

Nous ResearchLlama
Release Date
2025-08-27
Parameters
Context Length
Modalities

Capability Radar

31
general
59
coding
70
reasoning
44
scienceest.
80
agents
0
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking243
40.0
AA
General Ranking316
34.0
AA
Math Reasoning120
70.0
AA
Science238
45.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA50.5%SR

Code

HumanEval88.4%SR

Finance

MMLU86.0%SR
MMLU-Pro68.9%SR

General

IFEval92.1%SR
MBPP EvalPlus87.6%SR
BFCL v277.3%SR

Math

MGSM91.1%SR
MATH77.0%SR

AA Evaluation Indices

Math Index
69.7
Intelligence Index
9.0
Mmlu Pro
0.8
Gpqa
0.7
Aime 25
0.7
Livecodebench
0.7
Ifbench
0.3
Scicode
0.3
Tau2
0.2
Lcr
0.2
Terminalbench Hard
0.1
Hle
0.1

LLM Stats Category Scores

Instruction Following
90
Structured Output
90
Code
90
Language
80
Legal
80
Math
80
Reasoning
80
Finance
80
Healthcare
80
Tool Calling
80
General
70
Physics
50
Biology
50
Chemistry
50

Pricing

Input Price$1 / 1M tokens
Output Price$3 / 1M tokens
Blended Price (3:1)$1.5 / 1M tokens

Speed

Tokens/sec39.9
Time to First Token0.85s
Time to Answer50.94s

Provider Price Ranking

Provider Price Ranking

1 providers

ProviderInputOutput
1Nous ResearchPRIMARY
$1
$3

Compare pricing across different API providers for this model.

External Sources