4GB limit to individual files?
#1
Is there a file size limit in XBMC / Linux?

When I copy or download what will become a large .mkv, it stops at 4GB.

Is this normal? Is there a fix?

Thanks
Reply
#2
xbmcHerb Wrote:Is there a file size limit in XBMC / Linux?

When I copy or download what will become a large .mkv, it stops at 4GB.

Is this normal? Is there a fix?

Thanks

File size limitations are almost always down to fileystem limitations. If you want further help a little more information might be handy, XBMC version (Linux, Windows, XBOX etc) I'll assume it's the linux version given that you have posted in the Linux sub forum! XBMC live's file system won't be causing you prolems with files >4Gb, so there must be something else...

A more accurate description of "When I copy or download that will become a large .mkv, it stops at 4GB." are you downloading with a Windows box and transferring files to XBMC, are you using an external hard drive? is it formatted to FAT32? Please be a little more descriptive...
Reply
#3
Sorry for the lack of details.

XBMC Live 9.11 on a Revo 1600. I have downloaded some files that when unrared are larger than 4GB. They fail to unrar.

I then ftp them over to my main rig and unrar them just fine. When I ftp the single 4GB+ file back to the XBMC machine, the transfer fails , having transferred only 4GB of the larger file.

Thanks for the help
Reply
#4
xbmcHerb Wrote:Sorry for the lack of details.

XBMC Live 9.11 on a Revo 1600. I have downloaded some files that when unrared are larger than 4GB. They fail to unrar.

I then ftp them over to my main rig and unrar them just fine. When I ftp the single 4GB+ file back to the XBMC machine, the transfer fails , having transferred only 4GB of the larger file.

Thanks for the help

What ftp proggie are you using to transfer the files? and have you tried sftp over ssh? and give us the output of

df -T
Reply
#5
Downloading to the Revo via sabnzbd+ Then using Transmit to ftp to my Mac.

Downloaded a 6GB file. Downloads fine because it is in many smaller files. sabnzbd+ goes to unrar. It fails once the package hits 4GB.Copy the 6GB of rars over ftp via Transmit.

I have not tried sftp over ssh. I can. Have to figure how to get you the output.
Reply
#6
Open up a terminal application, or press Ctrl+Alt+F1.

Run the command, in this case df -T

Next, post what you get back here.

For example, if I run it, I get:

Filesystem Type 1K-blocks Used Available Use% Mounted on
/dev/sda4 ext3 19222656 6838232 11407888 38% /
none devtmpfs 986048 300 985748 1% /dev
none tmpfs 990488 268 990220 1% /dev/shm
none tmpfs 990488 96 990392 1% /var/run
none tmpfs 990488 0 990488 0% /var/lock
none tmpfs 990488 0 990488 0% /lib/init/rw
/dev/sda3 ext3 272162712 48831328 209506288 19% /home
/dev/sr0 iso9660 695096 695096 0 100% /media/Kubuntu 10.04 i386

in this case, it may help you get help if you put code tags around what you want, so it looks like this:

Code:
Filesystem    Type   1K-blocks      Used Available Use% Mounted on
/dev/sda4     ext3    19222656   6838232  11407888  38% /
none      devtmpfs      986048       300    985748   1% /dev
none         tmpfs      990488       268    990220   1% /dev/shm
none         tmpfs      990488        96    990392   1% /var/run
none         tmpfs      990488         0    990488   0% /var/lock
none         tmpfs      990488         0    990488   0% /lib/init/rw
/dev/sda3     ext3   272162712  48831328 209506288  19% /home
/dev/sr0   iso9660      695096    695096         0 100% /media/Kubuntu 10.04 i386

To get this, paste or type your output, then select it and click the "#" button above the text area.
Reply
#7
isantop Wrote:Open up a terminal application, or press Ctrl+Alt+F1.

Run the command, in this case df -T

Next, post what you get back here.

For example, if I run it, I get:

Filesystem Type 1K-blocks Used Available Use% Mounted on
/dev/sda4 ext3 19222656 6838232 11407888 38% /
none devtmpfs 986048 300 985748 1% /dev
none tmpfs 990488 268 990220 1% /dev/shm
none tmpfs 990488 96 990392 1% /var/run
none tmpfs 990488 0 990488 0% /var/lock
none tmpfs 990488 0 990488 0% /lib/init/rw
/dev/sda3 ext3 272162712 48831328 209506288 19% /home
/dev/sr0 iso9660 695096 695096 0 100% /media/Kubuntu 10.04 i386

in this case, it may help you get help if you put code tags around what you want, so it looks like this:

Code:
Filesystem    Type   1K-blocks      Used Available Use% Mounted on
/dev/sda4     ext3    19222656   6838232  11407888  38% /
none      devtmpfs      986048       300    985748   1% /dev
none         tmpfs      990488       268    990220   1% /dev/shm
none         tmpfs      990488        96    990392   1% /var/run
none         tmpfs      990488         0    990488   0% /var/lock
none         tmpfs      990488         0    990488   0% /lib/init/rw
/dev/sda3     ext3   272162712  48831328 209506288  19% /home
/dev/sr0   iso9660      695096    695096         0 100% /media/Kubuntu 10.04 i386

To get this, paste or type your output, then select it and click the "#" button above the text area.

Nice one isantop Smile so ext3 is the default fs for XBMC? there should be no problem with >4gb files on ext3, I believe that the max file size is ~2Tb
Reply
#8
Also, if sabnzb is stopping during its unrar process, you could have a look at the sabnzb logfle, I believe its in /home/yourhomedirectory/.sabnzbd/logs

It might offer up some clue as to what's going on...
Reply
#9
turbodonkey,

Looked at the sabnzbd+ log:

2010-04-01 15:39:04,238::WARNING::[newsunpack] ERROR: write error

Narrowing the issue some.

I store my stuff on an external 400GB USB hardrive. I've determined that its copying to that drive that is the issue. I copied a 6.5GB file from a networked machine to the internal drive of the Revo. It worked and it flew like 100x faster than copying to the USB drive.

I'm sorry I keep omitting certain details.
Reply
#10
OK, this is all good news... I would bet that your external drive is formatted to FAT32, and there is indeed a 4Gb limitation for FAT32, I would sugest that you reformat the drive with a FS that is both compatible with Linux and MAC OS... As I recall MAC OS uses HPFS+ as its FS of choice, and I *think* Ubuntu already has what it needs to mount HPFS+, although don't quote me on that!!

I would be tempted to format the drive under MAC OS and see if the XBMC machine can see it...

It would still be good to confirm this by connecting up your drive to the XBMC machine, and running df -T to confirm the file system type.

Any MAC OS users out there with any more insight into my speculations??
Reply
#11
turbodonkey Wrote:OK, this is all good news... I would bet that your external drive is formatted to FAT32, and there is indeed a 4Gb limitation for FAT32, I would sugest that you reformat the drive with a FS that is both compatible with Linux and MAC OS... As I recall MAC OS uses HPFS+ as its FS of choice, and I *think* Ubuntu already has what it needs to mount HPFS+, although don't quote me on that!!

I would be tempted to format the drive under MAC OS and see if the XBMC machine can see it...

It would still be good to confirm this by connecting up your drive to the XBMC machine, and running df -T to confirm the file system type.

Any MAC OS users out there with any more insight into my speculations??


And if it is going to be connected to a Linux box, why not go with ext3 or xfs? I am not sure why Mac OS compatibility became relevant in this thread.
Reply
#12
GJones Wrote:And if it is going to be connected to a Linux box, why not go with ext3 or xfs? I am not sure why Mac OS compatibility became relevant in this thread.

Because xbmcHerb has stated that he has a Mac, and that the drive in question is an external USB drive, I'm sure there is a possibility that he may need to connect it to the Mac at some point...
Reply
#13
You guys fixed my issue. Thank you very much.

The drive was, indeed, formatted as FAT32. Took a while for me to figure out to reformat and then get permissions changed.

It's a USB 2.0 drive. I mistakenly formatted it to ext2 and was getting a transfer rate of 3900KB/s. I stopped and reformatted to ext3 and now I'm getting 10500KB/s, which is a lot better. However, when copying to the internal SATA, I'm getting 60000 KB/s.

I know SATA is faster, but I had no idea it was 6x the speed. Is this normal, or is there something else I could do to speed things up?
Reply
#14
I would expect USB to be slower than a native SATA connection to be honest...

Glad you got it sorted! Smile
Reply
#15
Hey turbodonkey,

I expected it to be slower too, but not 6 times slower Eek
Reply

Logout Mark Read Team Forum Stats Members Help
4GB limit to individual files?0