Compatibility check
Can I run ReMM SLERP 13B on GeForce RTX 5070 Ti?
Yes — it runs.best quant: Q4_K_M
Decode speed
91 tok/sest
Usable context
4K
Memory
16 GB
Q4_K_MFits in memory91 tok/sest · 4K ctx
Q5_K_MFits in memory78 tok/sest · 4K ctx
Q8_0Spills to system RAM