Skip to main content

Hermes 4 - Llama-3.1 70B (Reasoning)

Nous ResearchLlama
Release Date
2025-08-27
Parameters
Context Length
131K
Modalities
text

Capability Radar

31
general
58
coding
69
reasoning
45
scienceest.
80
agents
0
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking298
29.0
AA
General Ranking315
34.0
AA
Math Reasoning121
69.0
AA
Science212
47.0
AA

Benchmark Scores (LLM Stats)

Biology

GPQA50.5%SR

Code

HumanEval88.4%SR

Finance

MMLU86.0%SR
MMLU-Pro68.9%SR

General

IFEval92.1%SR
MBPP EvalPlus87.6%SR
BFCL v277.3%SR

Math

MGSM91.1%SR
MATH77.0%SR

AA Evaluation Indices

Math Index
68.7
Intelligence Index
10.0
Mmlu Pro
0.8
Gpqa
0.7
Aime 25
0.7
Livecodebench
0.7
Scicode
0.3
Ifbench
0.3
Tau2
0.2
Hle
0.1
Lcr
0.1
Terminalbench Hard
0.0

LLM Stats Category Scores

Instruction Following
90
Structured Output
90
Code
90
Language
80
Legal
80
Math
80
Reasoning
80
Finance
80
Healthcare
80
Tool Calling
80
General
70
Physics
50
Biology
50
Chemistry
50

Pricing

Input Price$0.13 / 1M tokens
Output Price$0.4 / 1M tokens
Blended Price (3:1)$0.198 / 1M tokens

Speed

Tokens/sec87.0
Time to First Token0.66s
Time to Answer23.65s

Provider Price Ranking

Provider Price Ranking

2 providers

Cheapest: Nous ResearchMost Expensive: NanoGPT
ProviderInputOutput
1Nous ResearchPRIMARY
$0.13
$0.4
2NanoGPT
$0.25
$1.5

Compare pricing across different API providers for this model.

External Sources