How to get past 1gb memory limit of 64 bit LuaJIT on Linux?

Question

The overview is I am prototyping code to understand my problem space, and I am running into \'PANIC: unprotected error in call to Lua API (not enough memory)\' errors. I am

Answer 1

You can use the torch tds module. From the README:

Data structures which do not rely on Lua memory allocator, nor being limited by Lua garbage collector.

Only C types can be stored: supported types are currently number, strings, the data structures themselves (see nesting: e.g. it is possible to have a Hash containing a Hash or a Vec), and torch tensors and storages. All data structures can store heterogeneous objects, and support torch serialization.