JQuery File Upload to NGINX/PHP server fails when over 1.5GB

Question

I'm uploading large files using JQuery File Upload to an NGINX server with the PHP backend. The upload works for files up to and around 2GB but larger files around 6 or 8GB reach the end but show the following error message

The uploaded file was only partially uploaded

enter image description here

I've updated my nginx.conf:

http {
        sendfile           on;
        keepalive_timeout  65;

        server {
 ...
                client_max_body_size 20000000M;

 ...
        }
}

And my php.ini for php-fpm:

memory_limit = 512000000M

upload_max_filesize = 0 

post_max_size = 200000M

max_execution_time = 4320000

max_input_time = 4320000

The file upload take under an hour to complete in all cases.

Here is Chrome's Inspect Element output:

enter image description here

Hן Ben I suspect your php.ini settings - can you describe which server are you using CMS maybe? try adding a ini get to all the critical settings to be sure they are followed by your server just before the upload starts. — Shlomi Hassid
– Shlomi Hassid, Commented Mar 17, 2014 at 0:03
Also try using ini_set() before the file upload and uncrease limitations for session.gc_maxlifetime, session.cookie_lifetime, session.cache_expire. Last thing try setting a limitation to upload_max_filesize that is not unlimited. — Shlomi Hassid
– Shlomi Hassid, Commented Mar 17, 2014 at 0:09
I've added in ini_set('session.gc_maxlifetime', 9999999999999999); ini_set('session.cookie_lifetime', 9999999999999999); ini_set('session.cache_expire', 9999999999999999); and set upload_max_filesize to 500000000M but see the same error. — Ben
– Ben, Commented Mar 17, 2014 at 13:40
Really curious, how do you accurately test a 2.0 GB file upload in development without waiting hours?? — Michael Butler
– Michael Butler, Commented Mar 20, 2014 at 1:19

prady00 · Accepted Answer · 2014-03-12 14:38:07Z

0

This is nothing to do with php.ini or jquery uploader.

Just monitor your system resources closely to get close to the solution:

uploaded files are saved in temp folders (monitor this closely).
Your system RAM resource.
Your system storage capacity.

Beside these possibilities, check if your host/environment truncate long POST requests (by time or amount of data travelled)

answered Mar 12, 2014 at 14:38

prady00

7511 gold badge6 silver badges17 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Ben Over a year ago

Thanks prady the server resources are fine. I might try changing the tmp folder but it's strange that it works for files as large as 1.6GB

Ben Over a year ago

Do timeout and keepalive_timeout setting effect large uploads?

prady00 Over a year ago

Yes, they do try making them -1 ;)

Dmitry Seleznev · Accepted Answer · 2014-03-14 15:16:03Z

0

There was issue in PHP 5.3 while uploading file with size more than 2gb. It was solved in PHP 5.4 if i am not mistaken.

answered Mar 14, 2014 at 15:16

Dmitry Seleznev

9657 silver badges7 bronze badges

1 Comment

Ben Over a year ago

I'm running PHP 5.4.25 on the server.

Chris Gunawardena · Accepted Answer · 2014-03-21 06:03:36Z

0

Have you tried to upload a file using a plain form? eg:

<form action="upload_file.php" method="post"
enctype="multipart/form-data">
<label for="file">Filename:</label>
<input type="file" name="file" id="file"><br>
<input type="submit" name="submit" value="Submit">
</form>

Also I would try to setup a nginx server locally to cut down upload time. If it still fails you can rule out timeouts and even filesystem/disk issues.

answered Mar 21, 2014 at 6:03

Chris Gunawardena

6,5081 gold badge32 silver badges50 bronze badges

Collectives™ on Stack Overflow

JQuery File Upload to NGINX/PHP server fails when over 1.5GB

3 Answers 3

3 Comments

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

3 Comments

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related