Models / Microsoft/ Phi 4

Phi 4

Microsoft · released Dec 11, 2024 · microsoft/phi-4

Input: text. Output: text.InputOutput
Type
Open weightsMIT License
Params
14.7B
Context
16K

about 12K words of context

Our take

Written Aug 2, 2026

Microsoft's Phi-4 is a 14.7-billion-parameter text-only model from late 2024 with a permissive MIT licence. It is now clearly behind 2026 peers in both quality and request limit, but it is cheap.

Who should pick it

Use this only for legacy pipelines already built on Phi-4 that value stability over quality, or ultra-cheap bulk text processing where a 16,384-token request limit suffices and the quality bar is low. Skip it for new projects or anything requiring vision or a long context.

The case for it

  • Permissive MIT licence and low price.

The case against it

  • Lowest measured chat quality in our tracked set.
  • Tiny request limit by 2026 standards: 16,384 tokens versus 262,144 for current small models.
  • Text-only; no vision input, unlike current small-model peers.
00

How good is it?

IntelligencePuzzles, maths, exam questions

1 of 5

Arena Text (overall)135th of 143 · 1256.2

Arena Hard Prompts 133rd of 143Arena Maths 124th of 139GPQA Diamond 2nd of 16MMLU-Pro 5th of 16

CodingWriting and fixing code on its own

1 of 5

Arena Coding131st of 143 · 1306.4

Arena Coding is the only board that has scored it for this.

AgenticPlanning, calling tools, staying on task

not measured

Nobody we watch has scored Phi 4 for this. We would take the rating from Arena Agent (IPS).

WritingWe do not rate this

Scored, not ratedThe placings are on the right.

Two boards come close and neither tests writing: Arena Creative Writing asks people which of two replies they prefer, and LiveBench Language tests whether a model understood a passage. So we show where Phi 4 placed and give it no mark out of five.

Arena Creative Writing 135th of 143 · 1210.3
Also scored, on boards we give no mark for
Arena Instruction Following 133rd of 143IFEval 16th of 16

These tests check whether a model follows instructions — a precondition for all the work above, but not a measure of how well that work is done, which is why they get no rating.

Every published score for this model9 scoresEvery figure we hold, from 9 boards, with who ran it and a link to the source — including the boards no rating above is built on.
GPQA Diamondreasoning
20.8independentsource ↗
IFEvalchat
5.9independentsource ↗
1306.4independentsource ↗
1277.7independentsource ↗
1264.9independentsource ↗
1256.2independentsource ↗
MMLU-Proreasoning
47.6independentsource ↗
01

Can you run it yourself?

Fits in memory
weights load entirely on the card
Spills to system RAM
some weights offload; much slower
Too large
will not load even with offload
est
size is calculated; the verdict could change by 10%

Comfortable fit

A card many people ownFits in memory

GeForce RTX 4090 · 24 GB

Weights at Q4_K_M9.1 / 24 GBmeasured
Spare memory11.9 GB spare
Usable context16K of 16K
Decode speed91 tok/sest

Room to spare. 11.9 GB spare means a 10% error in the size would not change the answer.

One step upFits in memory

GeForce RTX 5090 · 32 GB

Weights at Q4_K_M9.1 / 32 GBmeasured
Spare memory19.9 GB spare
Usable context16K of 16K
Decode speed161 tok/sest

Room to spare. 19.9 GB spare means a 10% error in the size would not change the answer.

On a MacFits in memory

Apple M1 (8-core GPU) · 16 GB

Weights at Q4_K_M9.1 / 16 GBmeasured
Spare memory1.1 GB spare
Usable context4K of 16K
Decode speed5 tok/sest

Room to spare. 1.1 GB spare means a 10% error in the size would not change the answer.

Your hardware
Checking your profile…

Memory use by level

Against a 24 GB card.

14B-Q4_K_M
9.1 GBmeasured
Fits in memory
F16
29.3 GBmeasured
Spills to system RAM
Q4_K_M
recommended
9.1 GBmeasured
Fits in memory
Q5_K_M
10.9 GBest
Fits in memory
Q8_0
15.6 GBmeasured
Fits in memory

Check against your own machine → · All 71 devices, with every size →

02

Or rent it from someone else

Cheapest published offer

Cheapest of 3 live listings. Picked at the widest standard context we hold, within one quantisation slice, so the numbers beside it are a price one host actually charges.

per 1M tokens
$0.070 in / $0.14 out
Context served
16K
Throughput
Not measured
Current provider offers with price, context and prompt-privacy answers
ProviderIn / out per 1M tokensContextThroughputTrains on promptsLogs promptsZero retention
OpenRouter$0.070 / $0.1416Knot measuredUnknownUnknownUnknown
DeepInfrabfloat16$0.070 / $0.1416Knot measuredUnknownUnknownUnknown
DeepInfrabf16$0.070 / $0.1416K79 tok/sNoNoConfirmed

Across the 3 listings we hold: 1 say they do not train on prompts, 0 say they do and 2 do not say. 1 appear in the zero-retention registry we check; the rest are unknown to us rather than confirmed either way.

What each host's API supports

From the parameter list each endpoint publishes. Streaming is omitted: nothing we hold reports it, for any model.

Supported
Not supported
Not published
host gave no parameter list
API features per host
ProviderTool callingJSON outputStrict schema
OpenRouter
DeepInfrabfloat16
DeepInfrabf16

Tool calling: 0 of 3 listings say yes, 2 say no, 1 publishes no parameter list. JSON output: 2 of 3 listings say yes, 1 publishes no parameter list. Strict schema: 2 of 3 listings say yes, 1 publishes no parameter list.

03

When we formed this view

Dates behind this page

Aug 3, 2026BenchmarkScored 20.8 on GPQA Diamondleaderboard
Aug 3, 2026BenchmarkScored 5.9 on IFEvalleaderboard
Aug 3, 2026BenchmarkScored 47.6 on MMLU-Proleaderboard
Aug 2, 2026BenchmarkScored 1306.4 on Arena Codingleaderboard
Aug 2, 2026BenchmarkScored 1210.3 on Arena Creative Writingleaderboard
Aug 2, 2026BenchmarkScored 1277.7 on Arena Hard Promptsleaderboard
Aug 2, 2026BenchmarkScored 1245.4 on Arena Instruction Followingleaderboard
Aug 2, 2026BenchmarkScored 1264.9 on Arena Mathsleaderboard
Aug 2, 2026BenchmarkScored 1256.2 on Arena Text (overall)leaderboard
Jul 26, 2026ListedListed on LLMapfirst indexed by our pipeline

Prices last checked 3d ago

What we do not know about this model yet

  • 1 of 3 listings publish no parameter list, so what their API accepts is unknown to us.
  • Nothing we hold says whether an endpoint streams, so we do not show it either way.
  • 2 of 3 listings do not say whether they train on prompts.
  • We hold no cached-input rate for any of its listings.
04

Licence and identifiers

What the licence allowsMIT License, what it allows commercially, and the identifiers you need to pull this model — its Hugging Face repo, our slug and a machine-readable card.

Licence

MIT License

permissiveCommercial use allowed

Fully permissive: do anything with attribution. No patent grant, unlike Apache-2.0.

Identifiers

Hugging Face
microsoft/phi-4
Architecture
Dense
Modality record
text->text
Catalogue slug
microsoft-phi-4

Machine-readable model card (omc.json) →

Something wrong on this page? Tell us