Models / OpenAI/ GPT-4o (2024-05-13)

GPT-4o (2024-05-13)

OpenAI · released May 13, 2024

Input: text, images and documents. Output: text.InputOutput
Type
Proprietary
Input
$5.00
Output
$15.00
Cached
Not published

List price · per 1M tokens · OpenAI at 128K context · source ↗

Our take

Written Aug 3, 2026

GPT-4o is OpenAI's multimodal flagship from May 2024 that accepts text, images and files. It remains widely hosted with uniform pricing across providers, and its strongest measured category is coding rather than maths or creative writing.

Who should pick it

Choose this when you need OpenAI's proven multimodal stack with broad benchmark coverage, or for coding tasks where it scores highest relative to its own other categories. Pick OpenAI's own hosting if throughput matters most. Skip it if you need price competition between providers, if maths-heavy work dominates your workload, or if you want to self-host or run the model locally.

The case for it

  • Broad benchmark coverage across six Arena categories, each with two independent evaluation dates.
  • Coding is the standout measured category, scoring 23.3 points above its own overall text score.
  • Fastest throughput on OpenAI's own infrastructure, roughly double the rate measured on Azure.

The case against it

  • Maths is the weakest measured category, sitting 41.2 points below its own coding score.
  • No price competition across providers — every tracked host charges the same rate.
  • Throughput on Azure is roughly half the direct rate, so infrastructure choice matters.
00

How good is it?

IntelligencePuzzles, maths, exam questions

2 of 5

Arena Text (overall)105th of 143 · 1345.9

Arena Hard Prompts 110th of 143Arena Maths 112th of 139

CodingWriting and fixing code on its own

1.5 of 5

Arena Coding111th of 143 · 1369.2

Arena Coding is the only board that has scored it for this.

AgenticPlanning, calling tools, staying on task

Scored, not ratedSWE-bench Verified · 29th of 39 · 38.8via Agentless-1.5

GPT-4o (2024-05-13) is not on Arena Agent (IPS), which is where the rating would come from, so there is no rating here. It is on SWE-bench Verified, in 29th of 39 with 38.8.

WritingWe do not rate this

Scored, not ratedThe placings are on the right.

Two boards come close and neither tests writing: Arena Creative Writing asks people which of two replies they prefer, and LiveBench Language tests whether a model understood a passage. So we show where GPT-4o (2024-05-13) placed and give it no mark out of five.

Arena Creative Writing 88th of 143 · 1337.4
Also scored, on boards we give no mark for
Arena Instruction Following 105th of 143

These tests check whether a model follows instructions — a precondition for all the work above, but not a measure of how well that work is done, which is why they get no rating.

Every published score for this model7 scoresEvery figure we hold, from 7 boards, with who ran it and a link to the source — including the boards no rating above is built on.
1369.2independentsource ↗
1337.3independentsource ↗
1304.8independentsource ↗
1345.9independentsource ↗
38.8via Agentless-1.5independentsource ↗
01

Or rent it from someone else

Cheapest published offer

Why this differs from the header. The strip above quotes OpenAI's own list price. This is the cheapest live offer at the widest standard context we hold, whoever is serving it — a reseller undercutting a lab is ordinary commerce, not an error.

per 1M tokens
$5.00 in / $15.00 out
Context served
128K
Throughput
Not measured
Current provider offers with price, context and prompt-privacy answers
ProviderIn / out per 1M tokensContextThroughputTrains on promptsLogs promptsZero retention
OpenRouter$5.00 / $15.00128Knot measuredUnknownUnknownUnknown
Microsoft Azure AI$5.00 / $15.00128K62 tok/sNoNoConfirmed
OpenAI$5.00 / $15.00128K4K out177 tok/sNoYesunknown periodUnknown

Across the 3 listings we hold: 2 say they do not train on prompts, 0 say they do and 1 do not say. 1 appear in the zero-retention registry we check; the rest are unknown to us rather than confirmed either way.

What each host's API supports

From the parameter list each endpoint publishes. Streaming is omitted: nothing we hold reports it, for any model.

Supported
Not supported
Not published
host gave no parameter list
API features per host
ProviderTool callingJSON outputStrict schema
OpenRouter
Microsoft Azure AI
OpenAI

Tool calling: 3 of 3 listings say yes. JSON output: 3 of 3 listings say yes. Strict schema: 3 of 3 listings say yes.

02

Models people weigh against GPT-4o (2024-05-13)

03

When we formed this view

Dates behind this page

Aug 2, 2026BenchmarkScored 1369.2 on Arena Codingleaderboard
Aug 2, 2026BenchmarkScored 1337.4 on Arena Creative Writingleaderboard
Aug 2, 2026BenchmarkScored 1337.3 on Arena Hard Promptsleaderboard
Aug 2, 2026BenchmarkScored 1325.4 on Arena Instruction Followingleaderboard
Aug 2, 2026BenchmarkScored 1304.8 on Arena Mathsleaderboard
Aug 2, 2026BenchmarkScored 1345.9 on Arena Text (overall)leaderboard
Jul 26, 2026ListedListed on LLMapfirst indexed by our pipeline
Oct 28, 2024BenchmarkScored 38.8 via Agentless-1.5 on SWE-bench Verifiedleaderboard
May 13, 2024AnnouncedGPT-4o (2024-05-13) announced by OpenAI

Prices last checked 9d ago

What we do not know about this model yet

  • Nothing we hold says whether an endpoint streams, so we do not show it either way.
  • 1 of 3 listings do not say whether they train on prompts.
  • We hold no cached-input rate for any of its listings.
04

Licence and identifiers

What the licence allowsWe hold no licence record for this model. Inside are the identifiers you need to pull it — its Hugging Face repo where we have one, our slug and a machine-readable card.

Licence

Commercial API terms. We hold no licence record for this model, so there is nothing to summarise here.

Identifiers

Modality record
text+image+file->text
Catalogue slug
openai-gpt-4o-2024-05-13

Machine-readable model card (omc.json) →

Something wrong on this page? Tell us