Models /Hunyuan A13B Instruct /Can I run it?
Compatibility check

Can I run Hunyuan A13B Instruct on L40S?

Partially — with CPU offload.best quant:
Decode speed
—
Usable context
—
Memory
48 GB
Spills to system RAM
Spills to system RAM
Too large
What is quantisation? →
Plan B — rent it

Hunyuan A13B Instruct is hosted by 2 providers from $0.57 per 1M output tokens (OpenRouter).Compare providers →

Hunyuan A13B Instruct
80.4B / 13B · full specs & benchmarks →
L40S
48 GB · everything it runs →