4 Commits

Author	SHA1	Message	Date
Jeffrey Morgan	c336693f07	calculate overhead based number of gpu devices (#1875)	2024-01-09 15:53:33 -05:00
Daniel Hiltgen	a2ad952440	Fix windows system memory lookup ... This refines the gpu package error handling and fixes a bug with the system memory lookup on windows.	2024-01-03 08:50:01 -08:00
Daniel Hiltgen	d966b730ac	Switch windows build to fully dynamic ... Refactor where we store build outputs, and support a fully dynamic loading model on windows so the base executable has no special dependencies thus doesn't require a special PATH.	2024-01-02 15:36:16 -08:00
Daniel Hiltgen	35934b2e05	Adapted rocm support to cgo based llama.cpp	2023-12-19 09:05:46 -08:00