Skip to main content

Qwen2 7B Instruct

Alibaba Cloud / Qwen TeamQwenOpen WeightApache 2.0 · Commercial OK

Description

Qwen2-7B-Instruct is an instruction-tuned language model with 7 billion parameters, supporting a context length of up to 131,072 tokens.

Release Date
2024-07-23
Parameters
7.6B
Context Length
Modalities

Capability Radar

60
general
60
coding
60
reasoning
26
scienceest.
60
agents
0
multimodal

Science is estimated from LLM Stats science scores or reasoning when no dedicated science benchmarks are available.

Rankings

No ranking data available

Benchmark Scores (LLM Stats)

(LLM Stats (zeroeval))

Biology

GPQANYU + Cohere + Anthropic (2023)25.3%SR

Code

HumanEvalOpenAI (2021)79.9%SR
EvalPlus0.70 / 100SR
LiveCodeBench26.6%SR

Communication

MT-Bench0.84 / 100SR

Creativity

AlignBench72.1%SR

Finance

MMLU70.5%SR
MMLU-Pro44.1%SR
TheoremQA25.3%SR

General

C-Eval77.2%SR
MBPP0.67 / 100SR
MultiPL-E59.1%SR

Math

GSM8k82.3%SR
MATH49.6%SR

AA Evaluation Indices

(Artificial Analysis)

No AA evaluation data available

LLM Stats Category Scores

(LLM Stats (zeroeval))
Roleplay
80
Communication
80
Creativity
80
Writing
70
Legal
60
Math
60
Reasoning
60
Language
60
General
60
Healthcare
60
Code
60
Finance
50
Physics
30
Biology
30
Chemistry
30

Pricing

No pricing data available

Speed

No speed data available

Provider Price Ranking

No provider data available

External Sources