We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 30f4a0b commit 3345ddbCopy full SHA for 3345ddb
README.md
@@ -129,6 +129,10 @@ models:
129
ghcr.io/ggerganov/llama.cpp:server
130
--model '/models/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M.gguf'
131
132
+ # use a custom command to stop the model when swapping. By default
133
+ # this is SIGTERM on POSIX systems, and taskkill on Windows systems
134
+ cmdStop: docker stop dockertest
135
+
136
# Groups provide advanced controls over model swapping behaviour. Using groups
137
# some models can be kept loaded indefinitely, while others are swapped out.
138
#
0 commit comments