github oobabooga/text-generation-webui v3.3.2
v3.3.2: Patch release

latest releases: v3.12, v3.11, v3.10...
3 months ago
  • More robust VRAM calculation
    • The updated formula better handles edge cases - DeepSeek-R1 and Mistral-22B-v0.2 - providing more accurate results.
  • UI: Use total (not free) VRAM for layers calculation when a model is loaded.
  • Fix KeyError: 'gpu_layers' when loading existing model settings (#6991). Thanks, @mamei16.

Don't miss a new text-generation-webui release

NewReleases is sending notifications on new releases.