Provider guide
Where to run Llama 3.1 70B Instruct
3 live listings tracked — output prices vary 1.8× between the cheapest and most expensive host, so the provider choice matters as much as the model choice.
FASTEST MEASURED
23 tok/s
measured throughput · $0.72 input / $0.72 output per million tokens
OpenRouterCHEAPEST$0.40 in/1M$0.40 out/1M—131K—30 min agoAmazon Bedrockzero-retention$0.72 in/1M$0.72 out/1M23 tok/s131K—29 min agoDeepInfraturbo tier$0.40 in/1M$0.40 out/1M21 tok/s131Kfp829 min ago
DeepInfraFull specs, hardware verdicts and benchmarks on the Llama 3.1 70B Instruct model page →