跳转到主要内容

Phi-3.5-mini-instruct

MicrosoftPhi开源权重MIT · 商用许可

描述

Phi-3.5-mini-instruct is a 3.8B-parameter model that supports up to 128K context tokens, with improved multilingual capabilities across over 20 languages. It underwent additional training and safety post-training to enhance instruction-following, reasoning, math, and code generation. Ideal for environments with memory or latency constraints, it uses an MIT license.

发布日期
2024-08-23
参数规模
3.8B
上下文长度
支持模态
text

能力雷达图

60
general
60
coding
60
reasoning
26
science估算
60
agents
0
multimodal

缺少专门科学评测时,Science 由 LLM Stats 科学得分或推理能力估算。

排行榜排名

暂无排名数据

基准测试分数 (LLM Stats)

(LLM Stats (zeroeval))

Biology

GPQANYU + Cohere + Anthropic (2023)30.4%自报

Code

RepoQA77.0%自报
HumanEvalOpenAI (2021)62.8%自报

Creativity

Social IQa74.7%自报
Arena Hard37.0%自报

Finance

MMLU69.0%自报
TruthfulQA64.0%自报
MMLU-Pro47.4%自报

General

ARC-C84.6%自报
PIQA81.0%自报
OpenBookQA79.2%自报
MBPP0.70 / 100自报
MMMLU55.4%自报

Language

BoolQ78.0%自报
MEGA XStoryCloze73.5%自报
BIG-Bench Hard69.0%自报
Winogrande68.5%自报
MEGA XCOPA63.1%自报
MEGA TyDi QA62.2%自报
MEGA MLQA61.7%自报
MEGA UDPOS46.5%自报
SQuALITY24.3%自报

Long Context

RULER84.1%自报
Qasper41.9%自报
GovReport25.9%自报
QMSum21.3%自报
SummScreenFD16.0%自报

Math

GSM8k86.2%自报
MATH48.5%自报
MGSM47.9%自报

Reasoning

HellaSwagAI2 (2019)69.4%自报

AA 评测指数

(Artificial Analysis)

暂无 AA 评测数据

LLM Stats 分类评分

(LLM Stats (zeroeval))
Psychology
70
Reasoning
70
Legal
60
Math
60
Physics
60
Language
60
Finance
60
General
60
Healthcare
60
Code
60
Creativity
60
Long Context
50
Writing
40
Biology
30
Chemistry
30
Summarization
20

定价

暂无定价数据

速度

暂无速度数据

供应商价格排行

暂无提供商数据

外部链接