Hermes 3 - Llama-3.1 70B
Nous ResearchLlamaOpen WeightApache 2.0 · Commercial OK
Description
Hermes 3 70B is Nous Research's flagship instruction-following model, fine-tuned for advanced reasoning, creative writing, and complex task completion. It features exceptional instruction adherence and strong performance across multiple domains.
Release Date
2024-08-15
Parameters
70.0B
Context Length
131K
Modalities
text
Capability Radar
21
general
19
coding
25
reasoning
29
science
23
agents
0
multimodal
Rankings
| Domain | #Rank | Score | Source |
|---|---|---|---|
| Code Ranking | 501 | 20.0 | AA |
| General Ranking | 535 | 24.0 | AA |
| Science | 566 | 20.0 | AA |
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Chat
MT-Bench
8.99 / 100SR
General
MMLU
79.1%SR
TruthfulQA
63.3%SR
Instruction Following
IFBench
81.2%SR
Language
BoolQ
88.0%SR
MMLU-Pro
47.2%SR
Math
MATH
20.8%SR
Reasoning
HellaSwagAI2 (2019)
88.2%SR
PIQA
84.4%SR
Winogrande
83.2%SR
ARC-E
83.0%SR
BBH
67.8%SR
GPQANYU + Cohere + Anthropic (2023)
66.1%SR
ARC-C
65.5%SR
AGIEval
56.2%SR
MuSR
50.7%SR
OpenBookQA
49.4%SR
AA Evaluation Indices
(Artificial Analysis)Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))57.1
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))53.8
Gpqa(NYU + Cohere + Anthropic (2023))40.1
Livecodebench(UC Berkeley + MIT + Cornell (2024))18.8
Intelligence Index(Artificial Analysis)6.0
Hle(Center for AI Safety + Scale AI (2025))4.0
Aime(MAA (Mathematical Association of America))2.3
LLM Stats Category Scores
(LLM Stats (zeroeval))Chat9
Roleplay9
Communication9
Creativity9
Reasoning1
General1
Instruction Following80
Physics80
Language70
Biology70
Chemistry70
Legal60
Finance60
Healthcare60
Math50
Pricing
Input Price$0.7 / 1M tokens
Output Price$0.7 / 1M tokens
Blended Price (3:1)$0.7 / 1M tokens
Speed
Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s
Provider Price Ranking
Provider Price Ranking
4 providers
Cheapest: DeepInfraMost Expensive: Kilo Gateway
ProviderInputOutput
1DeepInfraCheapest
$0
$0
2Nous ResearchPRIMARY
$0.7
$0.7
3OpenRouter
$0.7
$0.7
4Kilo Gateway
$0.7
$0.7
Compare pricing across different API providers for this model.