large-files

I have an ASP.Net MVC application that allows users to upload images. When I try to upload a really large file (400MB) I get an error. I assumed that my image processing code (home brew) was very inefficient, so I decided I would try using a third party library to handle the image processing parts. Because I'm using TDD, I wanted to first write a test that fails. But when I test the controller action with the same large file it is able to do all the image processing without any trouble. The error I get is "Out of memory". I'm sure my code is probably using a lot more memory than it needs to

I need a list of italian words for a game I'm developing but I can't actually make it copy my database from assets. I tried quitea lot of solutions I found on the website, such as: Using your own SQLite database in Android applications how to copy large database which occupies much memory from assets folder to my application? Load files bigger than 1M from assets folder But I had no luck, it keeps on giving me this error on the line os.write(buffer, 0, len); but I can't understand why. Here's the function's code and the constants I'm using. A strange thins is that my database stops copying

In my case I have different files lets assume that I have >4GB file with data. I want to read that file line by line and process each line. One of my restrictions is that soft has to be run on 32bit MS Windows or on 64bit with small amount of RAM (min 4GB). You can also assume that processing of these lines isn't bottleneck. In current solution I read that file by ifstream and copy to some string. Here is snippet how it looks like. std::ifstream file(filename_xml.c_str()); uintmax_t m_numLines = 0; std::string str; while (std::getline(file, str)) { m_numLines++; } And ok, that's working but to

Before anyone complains of "duplicate", I've been checking SO quite thoroughly, but there seem to be no clean answer yet, although the question looks quite simple. I'm looking for a portable C code , which is able to provide the size of a file, even if such a file is bigger than 4GB. The usual method (fseek, ftell) works fine, as long as the file remains < 2GB. It's fairly well supported everywhere, so I'm trying to find something equivalent. Unfortunately, the updated methods (fseeko, ftello) are not supported by all compilers. For example, MinGW miss it (and obviously MSVC). Furthermore,

I'm trying and need some help doing the following: I want to stream parse a large XML file ( 4 GB ) with PHP. I can't use simple XML or DOM because they load the entire file into memory, so I need something that can stream the file. How can I do this in PHP? What I am trying to do is to navigate through a series of <doc> elements. And write some of their children to a new xml file. The XML file I am trying to parse looks like this: <feed> <doc> <title>Title of first doc is here</title> <url>URL is here</url> <abstract>Abstract is here...</abstract> <links> <sublink>Link is here</sublink>

I'm stuck here with file uploading problem. I've searched for answers but found only "increasing post_max_size and upload_max_filesize" suggestion and that doesn't work for me. I can't get large files uploaded(approx. around 150mb+), the following are my php.ini settings and my environments php.ini - max_input_time 300 - max_execution_time 600 - memory_limit 1024M - upload_max_filesize 1512M - post_max_size 2048M environments - Webserver: XAMPP - PHPFramwork: CodeIgniter I’ve also tried many other php.ini configurations. The file uploading class that I’ve built received posted file data from

I am attempting to port a small data analysis program from a 64 bit UNIX to a 32 bit Windows XP system (don't ask :)). But now I am having problems with the 2GB file size limit (long not being 64 bit on this platform). I have searched this website and others for possible sollutions but cannot find any that are directly translatable to my problem. The problem is in the use of fseek and ftell. Does anyone know of a modification to the following two functions to make them work on 32 bit Windows XP for files larger than 2GB (actually order 100GB). It is vital that the return type of nsamples is a