I
Immich•2y ago
Floflobel

jobs not working

Hello, I've installed immich via Docker and I'm trying to run all the jobs to get all my photos. The problem is that my jobs stop for no reason. I seem to have a lot of errors in the logs but I'm not sure how to solve the problem.
47 Replies
bo0tzz
bo0tzz•2y ago
What do the containers' logs say?
Floflobel
FloflobelOP•2y ago
I don't know if you want logs from another container. I have provided you with the logs of immich_microservices Version : 1.85.0
Daniel
Daniel•2y ago
@jrasm91 I think this is the same like #4873, no?
Immich
Immich•2y ago
[ISSUE] [BUG] Unable to play motion photos from One UI 6 (Android 14) (#4873)
Daniel
Daniel•2y ago
@Floflobel Do you by any chance also use a samsung phone and are running android 14?
Floflobel
FloflobelOP•2y ago
Nop I use iPhone and I think I don't have any picture from Android in my current setup
Daniel
Daniel•2y ago
Hmm. Is it possible for you to share any of the affected motion photos? More datapoints may be helpful here. Or if that's not easily possible, could you find an affected asset and provide the results of exiftool?
Floflobel
FloflobelOP•2y ago
I have the impression that the .mov files are corrupted because when I run them I get nothing back. But if I run another one, everything's fine. I'll try to delete them first. I see Warning : Truncated 'mdat' data
ExifTool Version Number : 12.16
File Name : 19-07-26 14-01-02 1711.mov
Directory : /srv/data/box/nextcloud-data/Floflobel/files/Photos/2019/07
File Size : 264 MiB
File Modification Date/Time : 2019:07:30 03:25:57+02:00
File Access Date/Time : 2023:11:08 23:48:04+01:00
File Inode Change Date/Time : 2021:10:04 17:41:43+02:00
File Permissions : rw-r--r--
File Type : MOV
File Type Extension : mov
MIME Type : video/quicktime
Major Brand : Apple QuickTime (.MOV/QT)
Minor Version : 0.0.0
Compatible Brands : qt
Media Data Size : 302867563
Media Data Offset : 36
Warning : Truncated 'mdat' data
ExifTool Version Number : 12.16
File Name : 19-07-26 14-01-02 1711.mov
Directory : /srv/data/box/nextcloud-data/Floflobel/files/Photos/2019/07
File Size : 264 MiB
File Modification Date/Time : 2019:07:30 03:25:57+02:00
File Access Date/Time : 2023:11:08 23:48:04+01:00
File Inode Change Date/Time : 2021:10:04 17:41:43+02:00
File Permissions : rw-r--r--
File Type : MOV
File Type Extension : mov
MIME Type : video/quicktime
Major Brand : Apple QuickTime (.MOV/QT)
Minor Version : 0.0.0
Compatible Brands : qt
Media Data Size : 302867563
Media Data Offset : 36
Warning : Truncated 'mdat' data
After deleting I tried to continue the jobs to scan the library but it doesn't seem to work. It shows me this, then stops and goes back to zero. I can't see anything in the logs of the "immich_microservices" container.
Floflobel
FloflobelOP•2y ago
No description
Floflobel
FloflobelOP•2y ago
I'll try to re-scan everything. Now I have these errors after I delete corrupt .mov: Full rescan of the library not working
[Nest] 7 - 11/09/2023, 11:00:26 AM ERROR [JobService] Error: ffprobe exited with code 1
ffprobe version 6.0-Jellyfin Copyright (c) 2007-2023 the FFmpeg developers
built with gcc 12 (Debian 12.2.0-14)
configuration: --prefix=/usr/lib/jellyfin-ffmpeg --target-os=linux --extra-version=Jellyfin --disable-doc --disable-ffplay --disable-ptx-compression --disable-static --disable-libxcb --disable-sdl2 --disable-xlib --enable-lto --enable-gpl --enable-version3 --enable-shared --enable-gmp --enable-gnutls --enable-chromaprint --enable-libdrm --enable-libass --enable-libfreetype --enable-libfribidi --enable-libfontconfig --enable-libbluray --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libopenmpt --enable-libdav1d --enable-libwebp --enable-libvpx --enable-libx264 --enable-libx265 --enable-libzvbi --enable-libzimg --enable-libfdk-aac --arch=amd64 --enable-libsvtav1 --enable-libshaderc --enable-libplacebo --enable-vulkan --enable-opencl --enable-vaapi --enable-amf --enable-libvpl --enable-ffnvcodec --enable-cuda --enable-cuda-llvm --enable-cuvid --enable-nvdec --enable-nvenc
libavutil 58. 2.100 / 58. 2.100
libavcodec 60. 3.100 / 60. 3.100
libavformat 60. 3.100 / 60. 3.100
libavdevice 60. 1.100 / 60. 1.100
libavfilter 9. 3.100 / 9. 3.100
libswscale 7. 1.100 / 7. 1.100
libswresample 4. 10.100 / 4. 10.100
libpostproc 57. 1.100 / 57. 1.100
/srv/nextcloud-data/Floflobel/files/Photos/2019/07/19-07-26 14-01-02 1711.mov: No such file or directory
at ChildProcess.<anonymous> (/usr/src/app/node_modules/fluent-ffmpeg/lib/ffprobe.js:233:22)
at ChildProcess.emit (node:events:514:28)
at ChildProcess._handle.onexit (node:internal/child_process:294:12)
[Nest] 7 - 11/09/2023, 11:00:26 AM ERROR [JobService] Object:
{
"id": "be066c80-c875-4fe5-a121-f32a82372862"
}
[Nest] 7 - 11/09/2023, 11:00:26 AM ERROR [JobService] Error: ffprobe exited with code 1
ffprobe version 6.0-Jellyfin Copyright (c) 2007-2023 the FFmpeg developers
built with gcc 12 (Debian 12.2.0-14)
configuration: --prefix=/usr/lib/jellyfin-ffmpeg --target-os=linux --extra-version=Jellyfin --disable-doc --disable-ffplay --disable-ptx-compression --disable-static --disable-libxcb --disable-sdl2 --disable-xlib --enable-lto --enable-gpl --enable-version3 --enable-shared --enable-gmp --enable-gnutls --enable-chromaprint --enable-libdrm --enable-libass --enable-libfreetype --enable-libfribidi --enable-libfontconfig --enable-libbluray --enable-libmp3lame --enable-libopus --enable-libtheora --enable-libvorbis --enable-libopenmpt --enable-libdav1d --enable-libwebp --enable-libvpx --enable-libx264 --enable-libx265 --enable-libzvbi --enable-libzimg --enable-libfdk-aac --arch=amd64 --enable-libsvtav1 --enable-libshaderc --enable-libplacebo --enable-vulkan --enable-opencl --enable-vaapi --enable-amf --enable-libvpl --enable-ffnvcodec --enable-cuda --enable-cuda-llvm --enable-cuvid --enable-nvdec --enable-nvenc
libavutil 58. 2.100 / 58. 2.100
libavcodec 60. 3.100 / 60. 3.100
libavformat 60. 3.100 / 60. 3.100
libavdevice 60. 1.100 / 60. 1.100
libavfilter 9. 3.100 / 9. 3.100
libswscale 7. 1.100 / 7. 1.100
libswresample 4. 10.100 / 4. 10.100
libpostproc 57. 1.100 / 57. 1.100
/srv/nextcloud-data/Floflobel/files/Photos/2019/07/19-07-26 14-01-02 1711.mov: No such file or directory
at ChildProcess.<anonymous> (/usr/src/app/node_modules/fluent-ffmpeg/lib/ffprobe.js:233:22)
at ChildProcess.emit (node:events:514:28)
at ChildProcess._handle.onexit (node:internal/child_process:294:12)
[Nest] 7 - 11/09/2023, 11:00:26 AM ERROR [JobService] Object:
{
"id": "be066c80-c875-4fe5-a121-f32a82372862"
}
up 😦
Alex Tran
Alex Tran•2y ago
The space in the filename might cause issue
Floflobel
FloflobelOP•2y ago
No this file doesn't exist anymore because I deleted it
Alex Tran
Alex Tran•2y ago
can you try run the option to remove offline files then try this again?
Floflobel
FloflobelOP•2y ago
Where is this option ? Into "Repair" tab ? I see OFFLINE PATHS (10) but I don't know how I can fix. "Repair all" opton cannot be trigger.
Alex Tran
Alex Tran•2y ago
in the library setup menu
Alex Tran
Alex Tran•2y ago
No description
Floflobel
FloflobelOP•2y ago
Thank you for your help, now I have this error when I try to run GENERATE THUMBNAILS :
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Unable to run job handler (thumbnailGeneration/generate-jpeg-thumbnail): Error: VipsJpeg: Premature end of JPEG file
VipsJpeg: Premature end of JPEG file
VipsJpeg: Premature end of JPEG file
VipsJpeg: Corrupt JPEG data: found marker 0xd9 instead of RST6
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Error: VipsJpeg: Premature end of JPEG file
VipsJpeg: Premature end of JPEG file
VipsJpeg: Premature end of JPEG file
VipsJpeg: Corrupt JPEG data: found marker 0xd9 instead of RST6
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Object:
{
"id": "2d8b540f-be6a-4bb7-8154-5a1ad44d5c8c"
}

[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Unable to run job handler (thumbnailGeneration/generate-jpeg-thumbnail): Error: VipsJpeg: Corrupt JPEG data: found marker 0xd9 instead of RST0
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Error: VipsJpeg: Corrupt JPEG data: found marker 0xd9 instead of RST0
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Object:
{
"id": "2481318a-c4c0-4808-bb8d-46b86eca13f9"
}

[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Unable to run job handler (thumbnailGeneration/generate-jpeg-thumbnail): Error: VipsJpeg: Corrupt JPEG data: found marker 0xd9 instead of RST7
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Error: VipsJpeg: Corrupt JPEG data: found marker 0xd9 instead of RST7
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Object:
{
"id": "037a840f-3848-4de5-a791-d26687547bb2"
}
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Unable to run job handler (thumbnailGeneration/generate-jpeg-thumbnail): Error: VipsJpeg: Premature end of JPEG file
VipsJpeg: Premature end of JPEG file
VipsJpeg: Premature end of JPEG file
VipsJpeg: Corrupt JPEG data: found marker 0xd9 instead of RST6
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Error: VipsJpeg: Premature end of JPEG file
VipsJpeg: Premature end of JPEG file
VipsJpeg: Premature end of JPEG file
VipsJpeg: Corrupt JPEG data: found marker 0xd9 instead of RST6
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Object:
{
"id": "2d8b540f-be6a-4bb7-8154-5a1ad44d5c8c"
}

[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Unable to run job handler (thumbnailGeneration/generate-jpeg-thumbnail): Error: VipsJpeg: Corrupt JPEG data: found marker 0xd9 instead of RST0
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Error: VipsJpeg: Corrupt JPEG data: found marker 0xd9 instead of RST0
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Object:
{
"id": "2481318a-c4c0-4808-bb8d-46b86eca13f9"
}

[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Unable to run job handler (thumbnailGeneration/generate-jpeg-thumbnail): Error: VipsJpeg: Corrupt JPEG data: found marker 0xd9 instead of RST7
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Error: VipsJpeg: Corrupt JPEG data: found marker 0xd9 instead of RST7
[Nest] 7 - 11/14/2023, 9:17:15 PM ERROR [JobService] Object:
{
"id": "037a840f-3848-4de5-a791-d26687547bb2"
}
How I can found the files cause this error ?
Alex Tran
Alex Tran•2y ago
are you using the AIO image?
Floflobel
FloflobelOP•2y ago
Nop docker-compose from the official repository
Alex Tran
Alex Tran•2y ago
what version are you on? Do you know where are those pictures were importing from initially?
Floflobel
FloflobelOP•2y ago
v1.86.0 now Yes, all the images are imported from personal photos on my phone (always an iPhone), but it's possible that some images from other devices have been included. For your information, last night I relaunched a complete scan of the library, not just missing
Alex Tran
Alex Tran•2y ago
it looks like those images was somehow corrupted when imported so Immich cannot read it to generate the thumbnail
Floflobel
FloflobelOP•2y ago
All images come from a read-only folder. How can I know which images are corrupt, as not all of them are? In the log I can see the id but I don't know what it refers to.
Alex Tran
Alex Tran•2y ago
Are you seeing all images not showing up on the web or just some?
Floflobel
FloflobelOP•2y ago
Yesterday, before I relaunched the full scan, all the images seemed to be displayed correctly, as far as I could see. Today, none of them appear. I'm willing to start again from scratch if necessary.
Alex Tran
Alex Tran•2y ago
perhaps something is wrong with the mount point?
Floflobel
FloflobelOP•2y ago
No description
Alex Tran
Alex Tran•2y ago
I mean from within the container can you see those files?
Floflobel
FloflobelOP•2y ago
immich_microservices:
root@c5afdc9bd5a6:/usr/src/app# ls -lha /srv/nextcloud-data/Floflobel/files/Photos
total 455K
drwxr-xr-x 18 www-data www-data 21 Jan 4 2023 .
drwxr-xr-x 12 www-data www-data 12 May 11 2023 ..
drwxr-xr-x 5 www-data www-data 5 Sep 18 2020 2010
drwxr-xr-x 11 www-data www-data 11 Sep 18 2020 2011
drwxr-xr-x 9 www-data www-data 9 Sep 18 2020 2012
drwxr-xr-x 11 www-data www-data 11 Sep 18 2020 2013
drwxr-xr-x 7 www-data www-data 7 Sep 18 2020 2014
drwxr-xr-x 3 www-data www-data 3 Apr 17 2018 2015
drwxr-xr-x 14 www-data www-data 14 Nov 6 2022 2016
drwxr-xr-x 14 www-data www-data 14 Apr 17 2018 2017
drwxr-xr-x 14 www-data www-data 14 Dec 1 2018 2018
drwxr-xr-x 15 www-data www-data 15 Apr 8 2020 2019
drwxr-xr-x 14 www-data www-data 14 Dec 22 2020 2020
drwxr-xr-x 14 www-data www-data 14 Dec 1 2021 2021
drwxr-xr-x 14 www-data www-data 14 Dec 1 2022 2022
drwxr-xr-x 13 www-data www-data 13 Nov 1 06:22 2023
root@c5afdc9bd5a6:/usr/src/app# ls -lha /srv/nextcloud-data/Floflobel/files/Photos
total 455K
drwxr-xr-x 18 www-data www-data 21 Jan 4 2023 .
drwxr-xr-x 12 www-data www-data 12 May 11 2023 ..
drwxr-xr-x 5 www-data www-data 5 Sep 18 2020 2010
drwxr-xr-x 11 www-data www-data 11 Sep 18 2020 2011
drwxr-xr-x 9 www-data www-data 9 Sep 18 2020 2012
drwxr-xr-x 11 www-data www-data 11 Sep 18 2020 2013
drwxr-xr-x 7 www-data www-data 7 Sep 18 2020 2014
drwxr-xr-x 3 www-data www-data 3 Apr 17 2018 2015
drwxr-xr-x 14 www-data www-data 14 Nov 6 2022 2016
drwxr-xr-x 14 www-data www-data 14 Apr 17 2018 2017
drwxr-xr-x 14 www-data www-data 14 Dec 1 2018 2018
drwxr-xr-x 15 www-data www-data 15 Apr 8 2020 2019
drwxr-xr-x 14 www-data www-data 14 Dec 22 2020 2020
drwxr-xr-x 14 www-data www-data 14 Dec 1 2021 2021
drwxr-xr-x 14 www-data www-data 14 Dec 1 2022 2022
drwxr-xr-x 13 www-data www-data 13 Nov 1 06:22 2023
Yes everything is ok with the mounting point (sorry I didn't have time to send the command to check if mountpoint is ok 🙂 ) same on immich_server it's works
Floflobel
FloflobelOP•2y ago
No description
Floflobel
FloflobelOP•2y ago
Yes, it looks like an access problem, but everything seems fine. I think I have a good part of my photos in offline paths mode. I have a backup from yesterday before the full rescan, I'll try to restore it and restart the jobs.
Alex Tran
Alex Tran•2y ago
Woo strange Are you using CIFS mount?
Floflobel
FloflobelOP•2y ago
Hum I think no, I have this complexe set-up : ZFS dataset > mount on my physical server > mount into an LXD container > mount into my immich Docker containers
Alex Tran
Alex Tran•2y ago
I think this is pretty standard, you are using Promox I assume?
Floflobel
FloflobelOP•2y ago
No, everything is done manually and globally managed by ansible
Alex Tran
Alex Tran•2y ago
nice Try mount a small subset of your gallery to test first
Floflobel
FloflobelOP•2y ago
good idea 🙂
Floflobel
FloflobelOP•2y ago
Floflobel
FloflobelOP•2y ago
Everything went fine on my old files until 2020 and then I let it run until 2023 and it started again with the same mistake. For the record, I started from scratch and deleted all my dockers and data.
Daniel
Daniel•2y ago
Could you try figuring out the what assets these ids belong to and specifically remove those?
Daniel
Daniel•2y ago
So basically use the first query and instead of originalFileName you use id
Floflobel
FloflobelOP•2y ago
With pleasure, I was just wondering how to find the asset that's causing the problem.
Daniel
Daniel•2y ago
Ah nice. I hope the guide helps with that then. If you've got any questions, feel free to ask :)
Floflobel
FloflobelOP•2y ago
Everything's ok now! Thank you very much for all your help! I don't know if there's a way to "close" but I've added the smiley ✅
Daniel
Daniel•2y ago
Nice. Well done! I can close this if you like

Did you find this page helpful?