Skip to main content

Command-R (Mar '24)

CohereCommand
Release Date
2024-03-12
Parameters
Context Length
128K
Modalities
text

Capability Radar

12
general
5
coding
11
reasoning
16
scienceest.
80
agents
0
multimodal

Science uses a reasoning proxy when dedicated science benchmarks are unavailable.

Rankings

Domain#RankScoreSource
Code Ranking473
5.0
AA
General Ranking495
13.0
AA
Math Reasoning344
6.0
AA
Science486
13.0
AA

Benchmark Scores (LLM Stats)

Agents

Cohere Agentic Question Answering65.0%SR
Cohere Memory Usage Quality54.0%SR
Cohere Data Analysis45.0%SR
Terminal-Bench Hard25.0%SR

Biology

SciCode38.0%SR

Communication

Tau2 Telecom85.0%SR

General

MMMU75.1%SR
IFBench74.0%SR
MMMU-Pro63.0%SR

Language

MT-AIME 202586.0%SR
WMT24++81.0%SR

Math

AIME 202590.0%SR
MathVista80.6%SR

Multimodal

CharXiv-D88.0%SR
CharXiv-R52.7%SR

AA Evaluation Indices

Intelligence Index
2.1
Mmlu Pro
0.3
Gpqa
0.3
Math 500
0.2
Scicode
0.1
Hle
0.0
Livecodebench
0.0
Aime
0.0

LLM Stats Category Scores

Structured Output
90
Language
80
Healthcare
80
Communication
80
Tool Calling
80
Instruction Following
70
Math
70
Multimodal
70
Reasoning
70
General
70
Vision
70
Physics
40
Biology
40
Chemistry
40
Code
40

Pricing

Input Price$0.5 / 1M tokens
Output Price$1.5 / 1M tokens
Blended Price (3:1)$0.75 / 1M tokens

Speed

Tokens/sec0.0
Time to First Token0.00s
Time to Answer0.00s

Provider Price Ranking

Provider Price Ranking

1 providers

ProviderInputOutput
1Cohere
$0.15
$0.6

Compare pricing across different API providers for this model.

External Sources