Filament•14mo ago

Queue FileUpload(s) for large data (videos/images)

I have run into a situation that I have searched far and wide but can't see an answer for. Imagine you need to upload a 100MB video to your S3 bucket via the FileUpload component. This will upload say up to 80MB to S3 before the server gateway response times out with a 504. Instead of having this happen directly in the request, is there an obvious way we can queue uploads and job them from this component? Or chunk the uploads somehow? I've tried doing this locally by sending the following snippet to the job, but I'm hit with serialization errors that are related to both the $file and $component.

$this->saveUploadedFileUsing(static function (BaseFileUpload $component, TemporaryUploadedFile $file): ?string {
    try {
        if (!$file->exists()) {
            return null;
        }
    } catch (UnableToCheckFileExistence $exception) {
        return null;
    }

    // dispatch rest of logic in job
    Job::dispatch($file, $component);

    // Error: Serialization of 'Closure' is not allowed

$this->saveUploadedFileUsing(static function (BaseFileUpload $component, TemporaryUploadedFile $file): ?string {
    try {
        if (!$file->exists()) {
            return null;
        }
    } catch (UnableToCheckFileExistence $exception) {
        return null;
    }

    // dispatch rest of logic in job
    Job::dispatch($file, $component);

    // Error: Serialization of 'Closure' is not allowed

Not a whizz kid with Livewire, so if anyone can help out that would be amazing. I imagine this is a problem a lot of people have run into, any answers appreciated.

4 Replies

Josh777OP•14mo ago

Hey @Ricardo Sawir, I've been doing some digging and came across your PR https://github.com/filamentphp/filament/pull/7036 Looks really good! Are you still waiting on this Livewire PR to be merged before proceeding? https://github.com/livewire/livewire/pull/5959

GitHub

Add chunk uploads support to FileUpload by sawirricardo · Pull Requ...

Chunk Uploads can be useful when the end users are required to upload files bigger than the server's capacity limit. This PR adds chunk upload functionality, using FilePond's chunking confi...

GitHub

Add multipart upload to Livewire's FileUpload by sawirricardo · Pul...

Review the contribution guide first at: https://laravel-livewire.com/docs/2.x/contribution-guide 1️⃣ Is this something that is wanted/needed? Did you create a discussion about it first? #5917 2️⃣ D...

Ricardo Sawir•14mo ago

If you use s3, you can set livewire temporary upload to s3 instead of local before I tried to make a pr uses chunk upload, but it was a bit hacky since I uses multipleUpload... and it also relies to local only driver

macy•12mo ago

Hi @Josh777, Did you find a way out for the same?

Ivan K•12mo ago

How about that?

Gaming

Programming

Queue FileUpload(s) for large data (videos/images)