abysssol
bf91b72c06
nixos/ollama: remove linuxPackages override
...
`linuxPackages.nvidia_x11` is no longer used by the `ollama` package.
2024-07-01 04:50:19 -04:00
Pol Dellaiera
f6727a9e3e
nixos/ollama: add loadModels config option
...
Allows users to download model files upon service startup,
instead of at the first use of the model, improving percieved startup latency.
2024-06-26 15:11:37 -04:00
abysssol
42c70e2923
nixos/ollama: add option for HSA_OVERRIDE_GFX_VERSION
...
There are several GPUs that ROCm doesn't officially support but
will work correctly if ROCm is directed to treat the GPU as a different
one that is supported and has a similar architecture.
This can be done by setting `HSA_OVERRIDE_GFX_VERSION`.
Ollama has documentation on this topic: https://github.com/ollama/ollama/blob/main/docs/gpu.md#amd-radeon
2024-06-22 13:13:08 -04:00
Pol Dellaiera
c54890e226
nixos/ollama: update port option, use types.port
2024-06-05 08:05:18 +02:00
Pol Dellaiera
cb8670469b
nixos/ollama: add openFirewall option
2024-06-05 07:09:13 +02:00
abysssol
428e60cad9
nixos/ollama: split listenAddress into host and port
...
breaking change; do not backport
2024-05-25 21:22:15 -04:00
abysssol
552eb75964
nixos/ollama: add options to bypass sandboxing
2024-04-18 10:52:20 -04:00
abysssol
f53ced0368
nixos/ollama: set service working directory to home
2024-04-17 03:07:00 -04:00
abysssol
4508b59900
nixos/ollama: update documentation
2024-04-13 19:52:08 -04:00
abysssol
18a5476aa7
nixos/ollama: add options to override HOME and OLLAMA_MODELS
2024-04-07 22:56:43 -04:00
abysssol
b5e7a05bb7
nixos/ollama: add option to set environment variables
2024-03-14 04:21:36 -04:00
abysssol
8720397720
nixos/ollama: replace incorrect use of overrideAttrs
...
The bug prevents nixos from compiling
if the ollama service is built with cuda enabled.
2024-02-28 17:15:30 -05:00
abysssol
5c143f0366
nixos/ollama: override kernelPackages with nvidia driver
...
Instead of setting linuxPackages to a singleton set with nvidia_x11,
override the system's kernelPackages with the nvidia driver.
This is more semantically correct, though doesn't change any behavior.
2024-02-27 18:51:54 -05:00
abysssol
b8d8c1f207
nixos/ollama: add option for hardware acceleration
2024-02-25 15:57:58 -05:00
Marcus Ramberg
8d956b1725
nixos/ollama: Add listenAddress
2024-01-21 00:27:07 +01:00
Jonas Heinrich
67a799c40f
nixos/ollama: init
2023-12-29 15:19:55 +01:00
