louisgv/local.ai v0.5.2

on GitHub

What's Changed

• feat: Added Nous Hermes to known models by @LLukas22 in #53
• feat: GPU inferencing, cuda for linux/windows/mac intel, metal for mac aarch64 by @louisgv in #56
• fix: Inference on thread view will stop when swapping between route
• fix: Properly terminate prompt feeding when stream stopped
• feat: Inference status text/status comment
• fix: add CUDA setup for linux and windows by @louisgv in #59
• fix: disable gpu toggle if no GPU is available by @louisgv in #63

NOTE: GPU inferencing is only available to Mac Metal (M1/M2) ATM, see #61

New Contributors

• @LLukas22 made their first contribution in #53

Full Changelog: v0.4.0...v0.5.2