To me it doesn't sound like a filesize limit of the OS (because then you wouldn't have a file that large in the first place) but rather like a filesize limit of the program you are trying to use to open it. A 12GB file does not fit in 32bit address space, if that program is trying to open it as a memory mapped file it is doomed to fail on any 32bit system.