jeans/ollama
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

ollamarunner: Don't panic for unimplemented features at runtime.

Browse Source 
It's ok to fail on startup but we shouldn't panic during runtime
based on user input. Downgrade the panic to a warning.
This commit is contained in:
Jesse Gross 2025-03-08 18:48:32 -08:00 committed by Jesse Gross
parent 4100ed7bdd
commit 4614fafae0
1 changed files with 3 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
runner/ollamarunner/runner.go
View File

@ -436,10 +436,9 @@ func (s *Server) processBatch() error {
// if done processing the prompt, generate an embedding and return // if done processing the prompt, generate an embedding and return
if seq.embeddingOnly { if seq.embeddingOnly {
// TODO(jessegross): Embedding support // TODO(jessegross): Embedding support
// s.removeSequence(i, "") slog.Warn("generation of embedding outputs not yet supported")
// continue s.removeSequence(i, "")
continue
panic("generation of embedding outputs not yet supported")
} }
// sample a token // sample a token