Volumes and tmp storage space
I'm working on an Adonisjs v6 project that's a media app handling large video files, most of the files will be manageable 150-200mb or less, but in the outside chance that user's try to upload significantly larger files multiple gb, would I have to use a volume, and then I'm limited by the volume restrictions by my account tier? 5gb what are my options for processing file uploads on the server?
I'm using S3 for long term storage, but Adonis has built in validators for multipart file uploads and if possible I'd like to keep the upload code as simple as possible for now, and also, that leaves the door open to do some processing and validation with ffmpeg if I wanted. I know s3 presigned urls are also an option later on, but was wondering if anyone had any insights into working with large files on railway deployments
Solution:Jump to solution
Hobby users get a soft limit of 100GB for the ephemeral storage, so you are good there
11 Replies
Project ID:
N/AN/A
Volumes should be used specifically for data you want to stick around between deploys, eg. long term storage
since you already have a long term storage solution, you shouldn't need volumes for storing video
Depends on what your app is doing tbh. If it's processing the video and sending it back, then you shouldn't need volumes
sorry, I'm super late but hello fellow adam, so If I send a 5gb file to my app to process then upload to S3 I should be good? I'm still gonna test out on my own but was just curious if you knew
reading this it sounds like it's good but should be a fun test project, I'll report back after I have a chance to try!
Solution
Hobby users get a soft limit of 100GB for the ephemeral storage, so you are good there
This is fantastic, that solves a massive headache for me
one thing to note would be that there is a limit of 5 minutes for http requests, aka if an upload takes longer than 5 minutes the connection is dropped
that is also very good to know, would something like TUS be able to get around that? I'm also using inertia/vue so I'd need to figure out there too if I'd have to modify the request code at all
thats chunked uploads? if so, yes thats exactly what you want to use!
perfect! thanks for the help and quick responses too!
no problem!