Llama 3.1 Instruct 405B
MetaLlama오픈 웨이트Llama 3.1 Community License
설명
Llama 3.1 405B Instruct is a large language model optimized for multilingual dialogue use cases. It outperforms many available open source and closed chat models on common industry benchmarks. The model supports 8 languages and has a 128K token context length.
출시일
2024-07-23
파라미터
405.0B
컨텍스트 길이
—
모달리티
text
능력 레이더
27
general
30
coding
23
reasoning
34
science
70
agents
0
multimodal
랭킹
벤치마크 점수 (LLM Stats)
(LLM Stats (zeroeval))Biology
GPQANYU + Cohere + Anthropic (2023)
50.7%자체 보고
Code
HumanEvalOpenAI (2021)
89.0%자체 보고
Gorilla Benchmark API Bench
35.3%자체 보고
Finance
MMLU (CoT)
88.6%자체 보고
MMLU
87.3%자체 보고
MMLU-Pro
73.3%자체 보고
General
ARC-C
96.9%자체 보고
MBPP EvalPlus
88.6%자체 보고
IFEvalGoogle Research (2023)
88.6%자체 보고
BFCL
88.5%자체 보고
Multipl-E HumanEval
75.2%자체 보고
Multipl-E MBPP
65.7%자체 보고
Nexus
58.7%자체 보고
Math
GSM8k
96.8%자체 보고
Multilingual MGSM (CoT)
91.6%자체 보고
DROP
84.8%자체 보고
MATH
73.8%자체 보고
Reasoning
API-Bank
92.0%자체 보고
AA 평가 지수
(Artificial Analysis)Intelligence Index(Artificial Analysis)8.3
Math Index(Artificial Analysis)3.0
Mmlu Pro(TIGER-Lab (Univ. of Waterloo, Toronto, CMU, 2024))0.7
Math 500(OpenAI (2024), subset of Hendrycks et al. MATH (2021))0.7
Gpqa(NYU + Cohere + Anthropic (2023))0.5
Ifbench(Google Research (2023))0.4
Livecodebench(UC Berkeley + MIT + Cornell (2024))0.3
Scicode(UIUC + Argonne National Lab (2024))0.3
Lcr(Artificial Analysis)0.2
Aime(MAA (Mathematical Association of America))0.2
Tau2(Sierra + U Toronto + Vector Institute (2025))0.2
Terminalbench Hard(Stanford × Laude Institute (2026))0.1
Hle(Center for AI Safety + Scale AI (2025))0.0
Aime 25(MAA (Mathematical Association of America))0.0
LLM Stats 카테고리 점수
(LLM Stats (zeroeval))Math90
Structured Output90
Instruction Following90
Legal80
Reasoning80
Language80
Finance80
General80
Healthcare80
Tool Calling70
Code60
Physics50
Biology50
Chemistry50
가격
입력 가격무료
출력 가격무료
혼합 가격 (3:1)무료
속도
토큰/초0.0
첫 토큰 지연0.00s
첫 응답 지연0.00s
공급자 가격 순위
프로바이더 데이터가 없습니다