Immich•2y ago

1536 files stuck in `upload/`

I have a bunch of images stuck in the upload/ folder. I have tried running STORAGE TEMPLATE MIGRATION but it has no effect. I'm not sure what additional information I can provide to assist debugging.

18 Replies

Alex Tran•2y ago

Is this the new Immich installation or have you used this instance in the past? You can include the microservices log

solomonOP•2y ago

i setup immich a few weeks ago but haven't really used it much i'm using the community All-In-One image

Alex Tran•2y ago

Hmm then we cannot help you much here Do you see any log?

solomonOP•2y ago

i do see this from a bit earlier today:

[Nest] 155  - 05/10/2023, 1:50:17 PM   ERROR [ExpressAdapter] Premature close
Error [ERR_STREAM_PREMATURE_CLOSE]: Premature close
    at new NodeError (node:internal/errors:387:5)
    at ServerResponse.onclose (node:internal/streams/end-of-stream:145:30)
    at ServerResponse.emit (node:events:525:35)
    at Socket.onServerResponseClose (node:_http_server:275:23)
    at Socket.emit (node:events:525:35)
    at TCP.<anonymous> (node:net:301:12)
migrating-time: 830.239ms
migrating-time: 665.526ms

[Nest] 155  - 05/10/2023, 1:50:17 PM   ERROR [ExpressAdapter] Premature close
Error [ERR_STREAM_PREMATURE_CLOSE]: Premature close
    at new NodeError (node:internal/errors:387:5)
    at ServerResponse.onclose (node:internal/streams/end-of-stream:145:30)
    at ServerResponse.emit (node:events:525:35)
    at Socket.onServerResponseClose (node:_http_server:275:23)
    at Socket.emit (node:events:525:35)
    at TCP.<anonymous> (node:net:301:12)
migrating-time: 830.239ms
migrating-time: 665.526ms

vikrant82•2y ago

I had same issues with bunch of my pictures. Turned out the exif data around dates was corrupted. You can run exiftool to fix exif data and reimport

Alex Tran•2y ago

Hmm this error can be ignored as it is not related to uploading Is there any other logs prior to that? especially if it related to the time you run the backup sequence?

solomonOP•2y ago

there is no log from running STORAGE TEMPLATE MIGRATION

Alex Tran•2y ago

My recommendation is to start from scratch with the docker-compose installation method so we can better support you

solomonOP•2y ago

yeah i think thats the right move

Alex Tran•2y ago

Let me know if that installation method also causing the same issue

solomonOP•2y ago

will do, thank you I seem to be having the same issue with some files:

➜ tree upload 
upload
└── b0784c0c-de06-498b-b5f7-acf23ea51a26
    ├── 1c46db1e-2c4d-44f9-ad18-c62a9bc5decd.mp4
    ├── 86b4d895-9e86-4971-a7d0-db104f7117ba.mp4
    ├── 8d779d95-5ed2-4e9d-84fe-2a1c6fb9d54c.jpg
    ├── 90ba48e1-46f7-4ee8-af77-12ef5f3d467c.jpg
    ├── a541c287-5a17-4cc1-a6cc-5c46d01dc47d.mp4
    ├── b274c68e-e3d0-438a-8f50-9425a4b6dad2.jpg
    ├── b65f9b05-d9db-400b-97de-c1185a470fd9.mp4
    ├── bc6c42d8-43bb-48b8-9d1a-2d22de5139b9.mp4
    └── d14b537b-ceed-4fbf-b1fc-5f8ab88aabeb.jpg

1 directory, 9 files

➜ tree upload 
upload
└── b0784c0c-de06-498b-b5f7-acf23ea51a26
    ├── 1c46db1e-2c4d-44f9-ad18-c62a9bc5decd.mp4
    ├── 86b4d895-9e86-4971-a7d0-db104f7117ba.mp4
    ├── 8d779d95-5ed2-4e9d-84fe-2a1c6fb9d54c.jpg
    ├── 90ba48e1-46f7-4ee8-af77-12ef5f3d467c.jpg
    ├── a541c287-5a17-4cc1-a6cc-5c46d01dc47d.mp4
    ├── b274c68e-e3d0-438a-8f50-9425a4b6dad2.jpg
    ├── b65f9b05-d9db-400b-97de-c1185a470fd9.mp4
    ├── bc6c42d8-43bb-48b8-9d1a-2d22de5139b9.mp4
    └── d14b537b-ceed-4fbf-b1fc-5f8ab88aabeb.jpg

1 directory, 9 files

the docker logs report some thumbnail generation failures but im not sure if they correlate to these files

solomonOP•2y ago

message.txt

solomonOP•2y ago

the hashes don't match @Alex I tested all the mp4 files stuck in upload/ with ffmpeg and they appear to be broken. I'm wondering if those are failed uploads from when my phone screen locked during backup? Should it be safe to delete them from upload/?

rrz•2y ago

I also have a lot of video files which are obviously broken piling up in my uploads folder...

solomonOP•2y ago

It would be great to be able to identify if those files are safe to delete and if they are duplicates of successfully imported videos.

Noah•2y ago

I have the same question - I have a bunch of 30GB+ video files that failed uploading partway with the CLI, and now they're just sitting in the uploads/ folder. I want to delete them, but I'm worried I'll corrupt the DB (by deleting files that the DB references without the DB knowing). Any guidance, @Alex ? Happy to post logs.

Alex Tran•2y ago

if they are half way file you should be good to delete them

Noah•2y ago

Thanks!

Gaming

Programming

1536 files stuck in `upload/`

Did you find this page helpful?