Nova Pro

AmazonAmazonProprietary

Description

Amazon Nova Pro is a highly-capable multimodal model with state-of-the-art performance across text, image, and video understanding. It excels at core capabilities like language understanding, mathematical reasoning, and multimodal tasks while offering industry-leading speed and cost efficiency.

Date de sortie

2024-12-03

Paramètres

—

Longueur du contexte

300K

Modalités

image, text

Radar de capacités

general

coding

reasoning

scienceest.

agents

multimodal

Science utilise un proxy de raisonnement lorsque les benchmarks scientifiques dédiés ne sont pas disponibles.

Classements

Domaine	#Rang	Score	Source
Agents & Tools	29	64.0	LS
Code Ranking	345	20.0	AA
General Ranking	348	32.0	AA
Math Reasoning	298	22.0	AA
Multimodal Ranking	12	88.0	LS
Science	369	29.0	AA

Scores de benchmarks (LLM Stats)

Agents

MM-Mind2Web

63.7%Aut.

Biology

GPQA

46.9%Aut.

Code

HumanEval

89.0%Aut.

Economics

FinQA

77.2%Aut.

CRAG

50.3%Aut.

Finance

MMLU

85.9%Aut.

Frontend Development

VisualWebBench

79.7%Aut.

General

ARC-C

94.8%Aut.

IFEval

92.1%Aut.

BFCL

68.4%Aut.

MMMU

61.7%Aut.

Grounding

GroundUI-1K

81.4%Aut.

Image To Text

DocVQA

93.5%Aut.

TextVQA

81.5%Aut.

Language

Translation en→Set1 COMET22

89.1%Aut.

Translation Set1→en COMET22

89.0%Aut.

BBH

86.9%Aut.

VATEX

77.8%Aut.

Translation Set1→en spBleu

44.4%Aut.

Translation en→Set1 spBleu

43.4%Aut.

SQuALITY

19.8%Aut.

Long Context

EgoSchema

72.1%Aut.

LVBench

41.6%Aut.

Math

GSM8k

94.8%Aut.

DROP

85.4%Aut.

MATH

76.6%Aut.

Multimodal

ChartQA

89.2%Aut.

Indices d'évaluation AA

Intelligence Index

13.5

Coding Index

11.0

Math Index

7.0

Math 500

0.8

Mmlu Pro

0.7

Gpqa

0.5

Ifbench

0.4

Livecodebench

0.2

Scicode

0.2

Lcr

0.2

Tau2

0.1

Aime

0.1

Aime 25

0.1

Terminalbench Hard

0.1

Hle

0.0

Scores par catégorie LLM Stats

Structured Output

Code

Image To Text

Instruction Following

Legal

Math

Reasoning

Tool Calling

Vision

Finance

General

Healthcare

Language

Multimodal

Agents

Economics

Frontend Development

Biology

Chemistry

Physics

Long Context

Summarization

Tarification

Prix d'entrée$0.8 / 1M tokens

Prix de sortie$3.2 / 1M tokens

Prix mixte (3:1)$1.4 / 1M tokens

Vitesse

Tokens/sec0.0 tokens/s

Délai du premier token0.00s

Temps de réponse0.00s

Fournisseurs disponibles

(Unités internes LS)

Aucune donnée de fournisseur disponible

Sources externes

LLM Stats