heap-memory

I need help understanding problems with my memory allocation and deallocation on Windows. I'm using VS11 compiler (VS2012 IDE) with latest update at the moment (Update 3 RC). Problem is: I'm allocating dynamically some memory for a 2-dimensional array and immediately deallocating it. Still, before memory allocation, my process memory usage is 0,3 MB before allocation, on allocation 259,6 MB (expected since 32768 arrays of 64 bit ints (8bytes) are allocated), 4106,8 MB during allocation, but after deallocation memory does not drop to expected 0,3 MB, but is stuck at 12,7 MB . Since I'm

I have been using PySpark with Ipython lately on my server with 24 CPUs and 32GB RAM. Its running only on one machine. In my process, I want to collect huge amount of data as is give in below code: train_dataRDD = (train.map(lambda x:getTagsAndText(x)) .filter(lambda x:x[-1]!=[]) .flatMap(lambda (x,text,tags): [(tag,(x,text)) for tag in tags]) .groupByKey() .mapValues(list)) When I do training_data = train_dataRDD.collectAsMap() It gives me outOfMemory Error. Java heap Space . Also, I can not perform any operations on Spark after this error as it looses connection with Java. It gives

I have one problem with java heap memory. I developed one client server application in java which is run as a windows service it requires more than 512MB of memory. I have 2GB of RAM but when I run my application it throws an exception Out of memory error:java heap space but I have already set heap size (maximum 512MB) in the java control panel and I still get the same error. I can't set heap size through the command line because my application runs as a windows service so how can I increase the default heap size? Please note that increasing the Java heap size following an java.lang

I was trying to adjust initial heap size of a tomcat 7 (CentOS, java -version: 1.6.0_25-b06) instance by adding the following line to catalina.sh: export CATALINA_OPTS="-Xms=512M -Xmx=1024M" Starting up tomcat fails and logs the following message to catalina.out: Invalid initial heap size: -Xms=512m Could not create the Java virtual machine. What is wrong with these options? You must not use = . Simply use this: export CATALINA_OPTS="-Xms512M -Xmx1024M" Use following command to increase java heap size for tomcat7 (linux distributions) correctly: echo 'export CATALINA_OPTS="-Xms512M -Xmx1024M"'

I wonder if there is a good way to find the source code that causes a heap corruption error, given the memory address of the data that was written 'outside' the allocated heap block in Visual Studio; Dedicated (0008) free list element 26F7F670 is wrong size (dead) (Trying to write down some notes on how to find memory errors) Thanks in advance! Begin with installing windbg: http://www.microsoft.com/whdc/Devtools/Debugging/default.mspx Then turn on the pageheap like this: gflags.exe –p /enable yourexecutable.exe /full This will insert a non writable page after each heap allocation. After this

Is there an log option that can let tomcat log the bad query instead just throwing this ? SEVERE: java.lang.OutOfMemoryError: Requested array size exceeds VM limit (Tried log level to FULL, but only capture the above) This is not enough information to further debug Alternatively, if this can be fixed by allocated more memory by tweaking the following? -Xms1024M -Xmx4096M -XX:MaxPermSize=256M Update -Xms6G -Xmx6G -XX:MaxPermSize=1G -XX:PermSize=512M (the above seems works better, keep monitoring) I suspect you might be using sorts on a large index. That's one thing I definitely know can require