Compatibility check
Can I run Niagara 19m Batch.en on GeForce RTX 3090?
Yes — it runs.best quant:
Decode speed
61757 tok/sest
Usable context
262K
Memory
24 GB
Fits in memory61757 tok/sest · 262K ctx
Fits in memory52640 tok/sest · 262K ctx
Fits in memory35238 tok/sest · 262K ctx