- More robust VRAM calculation
- The updated formula better handles edge cases -
DeepSeek-R1
andMistral-22B-v0.2
- providing more accurate results.
- The updated formula better handles edge cases -
- UI: Use total (not free) VRAM for layers calculation when a model is loaded.
- Fix KeyError: 'gpu_layers' when loading existing model settings (#6991). Thanks, @mamei16.