Nvidia GPU not used in ML
Below is my docker-compose file, i've tried rerunning docker compose up -d but that seems to just give errors in powershell (below) with my docker-compose.yml files
the changes are reflected in my hwaccel.ml.yml
25 Replies
:wave: Hey @!,
Thanks for reaching out to us. Please carefully read this message and follow the recommended actions. This will help us be more effective in our support effort and leave more time for building Immich :immich:.
References
- Container Logs:
docker compose logs docs
- Container Status: docker ps -a docs
- Reverse Proxy: https://immich.app/docs/administration/reverse-proxy
- Code Formatting https://support.discord.com/hc/en-us/articles/210298617-Markdown-Text-101-Chat-Formatting-Bold-Italic-Underline#h_01GY0DAKGXDEHE263BCAYEGFJA
Checklist
I have...
1. :ballot_box_with_check: verified I'm on the latest release(note that mobile app releases may take some time).
2. :ballot_box_with_check: read applicable release notes.
3. :ballot_box_with_check: reviewed the FAQs for known issues.
4. :ballot_box_with_check: reviewed Github for known issues.
5. :ballot_box_with_check: tried accessing Immich via local ip (without a custom reverse proxy).
6. :ballot_box_with_check: uploaded the relevant information (see below).
7. :ballot_box_with_check: tried an incognito window, disabled extensions, cleared mobile app cache, logged out and back in, different browsers, etc. as applicable
(an item can be marked as "complete" by reacting with the appropriate number)
Information
In order to be able to effectively help you, we need you to provide clear information to show what the problem is. The exact details needed vary per case, but here is a list of things to consider:
- Your docker-compose.yml and .env files.
- Logs from all the containers and their status (see above).
- All the troubleshooting steps you've tried so far.
- Any recent changes you've made to Immich or your system.
- Details about your system (both software/OS and hardware).
- Details about your storage (filesystems, type of disks, output of commands like fdisk -l and df -h).
- The version of the Immich server, mobile app, and other relevant pieces.
- Any other information that you think might be relevant.
Please paste files and logs with proper code formatting, and especially avoid blurry screenshots.
Without the right information we can't work out what the problem is. Help us help you ;)
If this ticket can be closed you can use the /close command, and re-open it later if needed.more context:
most recent powershell output with current file:
PS Microsoft.PowerShell.Core\FileSystem::\wsl.localhost\docker-desktop\home\happy\docker\immich-app> docker compose up -d
services.env_file must be a mapping
partial ml log:
please post "errors after errors"
its the powershell output
does a .env file exist?
yes
can you run
docker compose down && docker compose up -dPS Microsoft.PowerShell.Core\FileSystem::\wsl.localhost\docker-desktop\home\happy\docker> (docker compose down) -and (docker compose up -d)
no configuration file provided: not found
False
PS Microsoft.PowerShell.Core\FileSystem::\wsl.localhost\docker-desktop\home\happy\docker> docker compose down ; docker compose up -
no configuration file provided: not found
no configuration file provided: not found
I'm not sure what zone.identifier is. Also you modified your docker compose file directly, why not use the extends function as was built-in to the original compose file?
im getting my information off of https://immich.app/docs/features/ml-hardware-acceleration
interesting, that should work
or im completely misunderstanding what it's saying
can you share the output of
docker pswait
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
3165137a8d13 ghcr.io/immich-app/immich-server:release "tini -- /bin/bash s…" 8 hours ago Up 8 hours (healthy) 0.0.0.0:2283->2283/tcp immich_server
a00010384f62 redis:6.2-alpine "docker-entrypoint.s…" 8 hours ago Up 8 hours (healthy) 6379/tcp immich_redis
25534f7386f2 tensorchord/pgvecto-rs:pg14-v0.2.0 "docker-entrypoint.s…" 8 hours ago Up 8 hours (healthy) 5432/tcp immich_postgres
cf57be9a58b3 ghcr.io/immich-app/immich-machine-learning:release "tini -- python -m i…" 8 hours ago Up 7 hours (healthy) immich_machine_learning
how is it up 8 hours ago if you ran
docker compose down?
perhaps you have multiple immich instanceslet me try running compose down individually
PS Microsoft.PowerShell.Core\FileSystem::\wsl.localhost\docker-desktop\home\happy\docker\immich-app> docker compose down
services.volumes must be a mapping
it gives me a variety of "must be a mapping" results
services.(image/env_file/volumes/restart/container_name)
could always try a system reboot
ill give that a go after the asset upload, will update
thanks
restarted
still on cpu based
mustn be a mapping error still occuring
Successfully submitted, a tag has been added to inform contributors. :white_check_mark:
docker logs immich_machine_learningset up both transcoding and ml, logs for ml now display both cuda and cpu
[04/12/25 07:17:01] INFO Setting execution providers to
['CUDAExecutionProvider', 'CPUExecutionProvider'],
in descending order of preference
[04/12/25 07:17:04] INFO Loading detection model 'antelopev2' to memory
[04/12/25 07:17:04] INFO Setting execution providers to
['CUDAExecutionProvider', 'CPUExecutionProvider'],
in descending order of preference
[04/12/25 07:17:06] INFO Loading recognition model 'antelopev2' to memory
[04/12/25 07:17:06] INFO Setting execution providers to
['CUDAExecutionProvider', 'CPUExecutionProvider'],
in descending order of preference
now cpu is peaking somehow