Bug Large Files Fail to Download

[Webbstre]

Ok, one last bug report and I'm calling it a night and a week(end). I have been testing raising the limits on my server to allow for larger file sizes. Here is what I have my php.ini set to right now:

;;;;;;;;;;;;;;;;
; File Uploads ;
;;;;;;;;;;;;;;;;

; Whether to allow HTTP file uploads.
file_uploads = On

; Temporary directory for HTTP uploaded files (will use system default if not
; specified).
;upload_tmp_dir =

; Maximum allowed size for uploaded files.
upload_max_filesize = 250M

; Maximum size of POST data that PHP will accept.
post_max_size = 251M

;;;;;;;;;;;;;;;;;;;
; Resource Limits ;
;;;;;;;;;;;;;;;;;;;

max_execution_time = 60 ; Maximum execution time of each script, in seconds
max_input_time = 60 ; Maximum amount of time each script may spend parsing request data
memory_limit = 256M ; Maximum amount of memory a script may consume (8MB)

Before today my max post size was 51 MB, max file upload was 50 MB, and memory limit was 128 MB.

So we've been testing uploading some larger files to the database. I'm one a fast connection, and I managed to upload a 64 MB file and a 183 MB file, each within 1-2 minutes. One of my users with a slow connection uploaded a 193 MB file in "roughly 1 hour and 7 minutes." All appear to have been uploaded successfully under the new php.ini settings.

Here's the problem. I can download the 64 MB file with no problem. When I try to download either of the very large files my browser (Chrome) tells me that it will take 50-something days to download and the number starts to get bigger, then a few seconds later (maybe 10) "completes" and each time I end up with a 220 byte file on my computer. Considering that all three files are over my old 50 MB file limit I'm not sure why only the 64 MB file is successfully downloading (at a normal speed no less) while the other two are just failing on me. Hopefully you can come up with some idea of what's going on. I'm willing to give access to my test domain if it helps find the problem.

---------- Post added at 22:28 ---------- Previous post was at 22:26 ----------

Oh, and I'm all alone on a dedicated server with plenty of RAM, if that is important.

 

[Dylan]

Have you tried downloading with FF or IE?
I've seen a few issues with Chrome having problems with downloading large files.

 

[Webbstre]

I have now tried it with all three browsers, and they all give me a 220 byte file. It's almost certainly a setting of some kind on my end, but I have no idea what. I am capable of downloading other, even larger files, from my server that are not stored within the vbdownloads system. Could it be tied to having the files hidden above the public directory ("to prevent leeching")?

---------- Post added at 21:59 ---------- Previous post was at 20:04 ----------

Just to double-confirm, I tried uploading the file via ftp and downloading it via a direct link, and it worked fine. It's definitely got to be something tied into the size and the database, but I'm not sure what. I'm going to get my testers to upload a bunch of files between 50 and 200 MB to help me hunt down what size it stops working at.

 

[Cosmic]

This is based on quickly scanning the thread and is likely to be completely off, but could it have something to do with the capacity of the temp upload folder? If your temp folders are being cleaned after they reach a certain size that could screw the upload, no?

 

[Dylan]

... likely to be completely off...

Yup, completely lol. He's talking about downloading, not uploading

I have now tried it with all three browsers, and they all give me a 220 byte file. It's almost certainly a setting of some kind on my end, but I have no idea what. I am capable of downloading other, even larger files, from my server that are not stored within the vbdownloads system. Could it be tied to having the files hidden above the public directory ("to prevent leeching")?

---------- Post added at 21:59 ---------- Previous post was at 20:04 ----------

Just to double-confirm, I tried uploading the file via ftp and downloading it via a direct link, and it worked fine. It's definitely got to be something tied into the size and the database, but I'm not sure what. I'm going to get my testers to upload a bunch of files between 50 and 200 MB to help me hunt down what size it stops working at.

I know it works with large files, I just need to track down what is causing the problem on your server. Can I get an admin account to see if I can figure out what's going on?

 

[Webbstre]

I will PM you with the access info to my test domain and my admin account. You'll be able to see in the PHP Info page all of my settings as well, if you need me to change anything server-side.

---------- Post added 12th January 2012 at 22:00 ---------- Previous post was 11th January 2012 at 20:46 ----------

I have more information to provide now. Apparently if you open up one of the 220 byte files in a text editor it says something along these lines:

Fatal error: Allowed memory size of 268435456 bytes exhausted (tried to allocate 200001537 bytes) in /home/username/test.mydomain.com/includes/functions_file.php on line 168

Also, after some testing, the largest file one of my users has been able to upload and then successfully download is 131313131 byte, or 125.22 megabytes. He could upload larger files, but not download. Any ideas Cosmic or Dylan ?

 

[Dylan]

Thanks, I can replicate it on my local dev. It looks like the way the code is, you can download a file that is at most half the size of the memory limit. I'll see if I can get it to be higher.

 

[Webbstre]

Ok, for the meantime I'll try raising my memory limit. Hopefully that won't have repercussions elsewhere.

 

[Dylan]

I think I have this worked out. Can you get this attached file and unzip it, move it to the dbtech/downloads/modules/ folder?
Sorry it took me a bit to get this fixed. I had to figure out a way to get around the way David coded it for large files. I was getting the same error on my dev site. I just changed it and tested. With a 250M memory limit I was able to download a 7M file successfully and a 232M file successfully.
In case you forgot, bring your memory limit back down before you test as well

Let me know if it works for you.

 

[Webbstre]

Thanks for the file. I'll have to wait a couple days before I have time to get into my server and test it. I'll definitely get it tested by the end of the weekend. I'll let you know how it goes!

 

[Dylan]

Thanks for the file. I'll have to wait a couple days before I have time to get into my server and test it. I'll definitely get it tested by the end of the weekend. I'll let you know how it goes!

Cool, let me know. I'm taking the family on vacation for a week on Saturday so I'll check when I get back

 

[Webbstre]

I can verify that with the new file I was able to download a 190 MB file with my memory limit at only 256 MB, which I couldn't before, so it looks like it works now! Thanks for the excellent service! Also, judging by the difference in file sizes for that module I'm guessing you had to code a lot to fix it!

 

[Dylan]

I can verify that with the new file I was able to download a 190 MB file with my memory limit at only 256 MB, which I couldn't before, so it looks like it works now! Thanks for the excellent service! Also, judging by the difference in file sizes for that module I'm guessing you had to code a lot to fix it!

Had to make a few tweaks here and there
Glad it's working for you now

 

[Gecuba]

I think I have this worked out. Can you get this attached file and unzip it, move it to the dbtech/downloads/modules/ folder?
Let me know if it works for you.

Dylan, thanks a lot! I had the same promblem with big files download (no problems with uploading).
Max post & upload size = 105 Mb. I tried to download 77Mb archive and failed - file not found in ff. But when I reuploded download module from your post I downloaded successfully that file.

 

[Gecuba]

It seems, that new download module broke up the counting of file downloads. Counters stopped after reuploading module...

 

[Fillip H.]

Since the issue described in the OP has been resolved, I'm closing this thread.

If you have any further issues, please create a new thread