LL
Map
Models
Hardware
Providers
Benchmarks
Guides
News
Insights
Search…
⌘K
Menu
Models
Hardware
Providers
Benchmarks
Guides
News
Insights
Models
/
Hy-MT2-7B
/
Can I run it?
Compatibility check
Can I run Hy-MT2-7B on Arc B580?
Yes — it runs.
best quant:
Q4_K_M
Decode speed
56 tok/s
est
Usable context
8K
Memory
12 GB
Q4_K_M
Fits in memory
56 tok/s
est
· 8K ctx
Q5_K_M
Fits in memory
48 tok/s
est
· 8K ctx
Q8_0
Fits in memory
est
32 tok/s
est
· 4K ctx
What is quantisation? →
Hy-MT2-7B
8B · full specs & benchmarks →
Arc B580
12 GB · everything it runs →