4 Commits

Author	SHA1	Message	Date
Michael Yang	6de5d032e1	implement loading ggml lora adapters through the modelfile	2023-08-10 09:23:39 -07:00
Michael Yang	d791df75dd	check memory requirements before loading	2023-08-10 09:23:11 -07:00
Michael Yang	020a3b3530	disable gpu for q5_0, q5_1, q8_0 quants	2023-08-10 09:23:11 -07:00
Michael Yang	fccf8d179f	partial decode ggml bin for more info	2023-08-10 09:23:10 -07:00