Hermes 3 405B
Nous ResearchOpen WeightApache 2.0 · Commercial OK
Description
Hermes 3 is a cutting-edge language model that offers advanced capabilities in roleplaying, reasoning, and conversation. It's a fine-tuned version of the Llama-3.1 405B foundation model, designed to align with user needs and provide powerful control. Key features include reliable function calling, structured output, generalist assistant capabilities, and improved code generation. Hermes 3 is competitive with Llama-3.1 Instruct models, with its own strengths and weaknesses.
Release Date
2024-10-09
Parameters
405.0B
Context Length
131K
Modalities
text
Capability Radar
1
general
0
coding
70
reasoning
77
scienceest.
49
agents
0
multimodal
Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.
Rankings
No ranking data available
Benchmark Scores (LLM Stats)
(LLM Stats (zeroeval))Chat
MT-Bench
8.93 / 100SR
General
MMLU
85.0%SR
Language
BoolQ
88.9%SR
MMLU-Pro
54.1%SR
Reasoning
HellaSwagAI2 (2019)
90.2%SR
Winogrande
86.3%SR
ARC-E
86.2%SR
PIQA
86.0%SR
BBH
75.4%SR
ARC-C
69.5%SR
AGIEval
61.8%SR
OpenBookQA
48.8%SR
MuSR
48.3%SR
AA Evaluation Indices
(Artificial Analysis)No AA evaluation data available
LLM Stats Category Scores
(LLM Stats (zeroeval))Chat9
Roleplay9
Communication9
Creativity9
Reasoning1
General1
Physics90
Language80
Legal70
Math70
Finance70
Healthcare70
Pricing
Input Price$0 / 1M tokens
Output Price$0 / 1M tokens
Blended Price (3:1)$0 / 1M tokens
Speed
No speed data available
Provider Price Ranking
Provider Price Ranking
4 providers
Cheapest: Nous ResearchMost Expensive: Kilo Gateway
ProviderInputOutput
1Nous ResearchPRIMARY
$0
$0
2DeepInfra
$0
$0
3OpenRouter
$1
$1
4Kilo Gateway
$1
$1
Compare pricing across different API providers for this model.