Can I run Qwen2.5 Coder 32B Instruct on Radeon RX 7900 XTX?

This one is close. The answer rests on a file size we calculated from the parameter count rather than measured. A 10% error in that size changes the verdict, so treat it as a maybe and test before you buy.

20.7 GB of weights, plus 2.4 GB for the software that runs it and the smallest conversation it can hold, comes to 23.1 GB against the 22.8 GB this 24 GB device leaves free.

Qwen2.5 Coder 32B Instruct is hosted by 2 providers from $1.00 per 1M output tokens (Cloudflare Workers AI).Compare providers →