Details
lora: count lora nodes in graph_max_nodes (#18469)
-
lora: count lora nodes in graph_max_nodes
-
3 nodes per weight
-
4 nodes
-
keep track n_lora_nodes from llama_model
-
fix assert
-
rm redundant header
-
common: load adapters before context creation
-
use 6 nodes
macOS/iOS:
Linux:
Windows:
- Windows x64 (CPU)
- Windows arm64 (CPU)
- Windows x64 (CUDA 12) - CUDA 12.4 DLLs
- Windows x64 (CUDA 13) - CUDA 13.1 DLLs
- Windows x64 (Vulkan)
- Windows x64 (SYCL)
- Windows x64 (HIP)
openEuler: