gridgain

Can I reduce the space of my cache memory?

拈花ヽ惹草 提交于 2019-12-13 05:04:34
问题 I am a newbie on GridGain and I have a problem with the heap size on my cache. I have a CSV file with 2.000.000 ~ 3.000.000 lines, the size of the file is 600~800 megabytes, but when I load this data into my cache on GridGain I need 5~7 gigabytes. Can I reduce the size of the data in the cache? Or do I need 5~7 gigabytes to save a file with 600 megabytes? 回答1: Here are the things that can affect memory consumption: Number of backups configured. If you have, for example, 1 backup configured,

GridGain + .NET Client Connection Warnings / Dropouts

﹥>﹥吖頭↗ 提交于 2019-12-13 04:23:19
问题 I am connecting to GridGain Cluster and I keep seeing the following error in the logs, I am also noticing the client connections dropping/reconnecting quite frequently (although been new to the platform I am not sure if this is normal behavior). [12:41:35,548][WARN ][grid-nio-worker-0-#53%null%][GridTcpRestProtocol] No marshaller defined for NIO session, using PROTOBUF as default [ses=GridSelectorNioSessionImpl [selectorIdx=0, queueSize=0, writeBuf=null, readBuf=null, super=GridNioSessionImpl

Ignite Spring Integration seems broken with 2.4 (upgrading from 2.3)

。_饼干妹妹 提交于 2019-12-13 04:09:39
问题 We are upgrading from 2.3 to 2.4 & realized that a change made in IgniteSpringBean which is referenced in this added line in its javadoc resulted in us moving lots of references in PostConstruct to handleContextRefresh. " A note should be taken that Ignite instance is started after all other Spring beans have been initialized and right before Spring context is refreshed. That implies that it's not valid to reference IgniteSpringBean from any kind of Spring bean init methods like PostConstruct

GridGain - programmatically opening nodes using SSH through Grid.startNodes API

≯℡__Kan透↙ 提交于 2019-12-12 21:07:41
问题 I am using Grid.startNodes(java.util.Collection, java.util.Map, boolean, int, int) as defined here: http://gridgain.com/api/javadoc/org/gridgain/grid/Grid.html#startNodes(java.util.Collection, java.util.Map, boolean, int, int) Code I am using: GridConfiguration cfg = GridCfgGenerator.GetConfigurations(true); Grid grid = GridGain.start(cfg); Collection<Map<String,Object>> coll = new ArrayList<>(); Map<String, Object> host = new HashMap<String, Object>(); //host.put("host", "23.101.201.136");

IgniteSpringBean & Ignite SpringTransactionManager do not work together anymore in 2.4

吃可爱长大的小学妹 提交于 2019-12-11 17:45:48
问题 I see that with a change introduced in 2.4 in IgniteSpringBean to delay ignite instance start until all other spring beans are initialized may have broken Ignite SpringTransactionManager resulting in inability to configure it for Spring transaction abstraction of Ignite transactions. I really, badly need to find a way to work around this. Any ideas/suggestions anyone? Below is the line from IgniteSpringBean java doc "Ignite instance is started after all other Spring beans have been

Explicit setting of write synchronization mode FULL_SYNC needed for replicated caches?

ぃ、小莉子 提交于 2019-12-11 15:15:42
问题 I understand from the docs that replicated caches are implemented using partitioned caches where every key has a primary copy and is also backed up on all other nodes in the cluster & that when data is queried lookups would be made from both primary & backup on the node for serving the query. But i see that the default cache write synchronization mode is PRIMARY_SYNC, where client will not wait for backups to be updated. Does that mean i have to explicitly set it to FULL_SYNC for replicated

Gridgain failover of master (sender) node

若如初见. 提交于 2019-12-11 07:05:49
问题 I am working on batch processing problem. Solution needs to handle failing hardware. There is master node (which initiates tasks executions) and worker nodes which execute the jobs. I know how failover of worker nodes works but I could not find any information about failover of master nodes. Whenever master node which started a task fails the whole task is canceled. Is there any way to finish task processing then? Could you suggest the best way of implementing failover of master node? Kind

Listing current Ignite jobs and cancelling them

落花浮王杯 提交于 2019-12-11 05:41:07
问题 I got a partial answer here but not exactly what I wanted. The link describes how to get a list of task futures but what I'd really like to be able to do is list out and cancel individual jobs (that might be hung, long running etc etc). I've seen another post implying that this is not possible but I'd like to confirm (see second link) Thanks http://apache-ignite-users.70518.x6.nabble.com/How-can-I-obtain-a-list-of-executing-jobs-on-an-ignite-node-td8841.html http://apache-ignite-users.70518

Add cache at runtime to GridGain / reconfigure GridGain at runtime

冷暖自知 提交于 2019-12-08 09:50:35
问题 Is there a means of reconfiguring the GridCacheConfiguration at runtime for GridGain? The end goal is to be able to add a grid cache at runtime after having started up the Grid. final GridConfiguration gridConfiguration = new GridConfiguration(); gridConfiguration.setMarshaller(new GridOptimizedMarshaller()); Grid grid = GridGain.start(gridConfiguration); ... <later on> GridCacheConfiguration newCacheConfig = ...; //defines newConfig grid.configuration().setCacheConfiguration(newCacheConfig);

How to use gridgain with two nodes where each node on its own different host

▼魔方 西西 提交于 2019-12-06 16:15:29
问题 Can anyone help me in guiding to use grid gain, The documentation on website is not enough and confusing. We have to run thousands of simulations in the LAN. can anyone help me in running compute grid on multiple hosts in a LAN. I am able to run compute example on multiple nodes on same host, but not on multiple nodes on multiple hosts. Kindly help. 回答1: Compute examples are configured to work with local host settings. All you have to do is update IP addresses in examples/config/example