spring-batch

问题 I've got a table of over 1 million customers. Every customer's information gets updated often but will only be updated once a day. I've got a Spring batch job which reads a customer from customer table (JdbcCursorItemReader) processes the customer information (ItemProcessor) writes to the customer table (ItemWriter) I want to run 10 jobs at once which will read from one Customer table without reading a customer twice. Is this possible with Spring batch or is this something that I will have to

问题 We are using the CommandLineJobRunner to execute Spring Batch jobs. We are using -next on the command line: java -Dlog4j.configuration=file:./prop/log4j.properties -Dlogfile=logfile_load_data -jar EtlLoadData.jar loaddata_etl_config.xml loaddata_etl_job -next We started coming down with an error: Job Terminated in error: A job instance already exists and is complete for parameters={run.id=10}. If you want to run this job again, change the parameters. org.springframework.batch.core.repository

问题 As per below image from Spring Batch Doc, A master step is getting partitioned into Six Slave steps which are identical copies of master. My question is, can I extend partitioning to one more level or N more levels? i.e. All of six slaves becomes a master for further N slaves? Use Case: First we partition data on major criteria then we further partition data on some other criteria with in that major criteria. e.g. first I launch slaves for data of N clients based on client name then for each

问题 I am just wondering is it doable in Spring Batch? Step1 Step2 (flow) -> flow1, flow2, flow3 Step3 Where each flow1 -> partition into 5 GridSize flow2 -> partition into 5 GridSize flow3 -> partition into 5 GridSize return jobBuilderFactory.get("dataLoad") .incrementer(new RunIdIncrementer()) .listener(listener) .start(step1()) .next(step2()) .next(step3()) .build() .build(); @Bean public Flow step2() { Flow subflow1 = new FlowBuilder<Flow>("readTable1Flow").from(readTable1()).end(); Flow

问题 I'm trying to import city data from a csv file, some data may be duplicated which invoke conflict error ERROR: duplicate key value violates unique constraint "city__unique_idx" Detail: Key (country, city_name, latitude, longitude)=(231, Monticello, 30.5450000000000017, -83.8703000000000003) already exists. 2018-03-13 14:34:03.607 ERROR 13275 --- [ main] o.s.batch.core.step.AbstractStep : Encountered an error executing step cityStep1 in job importCityJob . I want to know how to ignore this

问题 The reader looks like this, <bean id="cvsFileItemReader" class="org.springframework.batch.item.file.FlatFileItemReader" scope="step"> <property name="resource" value="classpath:cvs/input/report.csv" /> <property name="lineMapper"> <bean class="org.springframework.batch.item.file.mapping.DefaultLineMapper"> <property name="lineTokenizer"> <bean class="org.springframework.batch.item.file.transform.DelimitedLineTokenizer"> <property name="names" value="id,impressions" /> </bean> </property>

问题 Below is code Batch snippet: XML : </beans:property> --> <beans:bean id="RDFieldSetMapper" class="in.gov.tds.batch.mapper.RDFieldSetMapper" autowire="byName" scope="step"> <!-- <beans:property name="feedId" value="429717"></beans:property> --> <beans:property name="feedId" value="#{jobParameters[feedId]}"></beans:property> </beans:bean> setter method in Java Class: recordDetail.setFeedId(new Long(feedId)); Please provide the resolution as I am getting Invalid setter method. More Mapper detail

问题 I'm new to springBatch chunking. I want to understand how reader works here is the scenario : implementing a purging of user accounts Chunk processor : have a reader which reads all the user accounts that matches with purge criteria ,in an order. processor : for each user account based on the some calculation ,it may create a new user account and also changes current record(say mark it as purged) question : how doe the reader work? say i have 5000 user accounts. If my chunk size is 1000 will

问题 I'm trying to get Spring Batch 2.2 working with JavaConfig. Nowadays they have a @EnableBatchProcessing annotation that sets up a lot of things. Default that annotation uses a datasource for its job data, but we don't want to save this data and don't want to create the table for it. The documentation says something about customizing but I have not been able to get it working: The user has to provide a DataSource as a bean in the context, or else implement BatchConfigurer in the configuration

问题 I am trying to use spring batch & quartz in a project. The objective is to schedule a spring-batch job using Quartz. I have the following beans - bean id="updateDataFeedJob" class="package.UpdateDataFeedJob" /> <bean id="UpdaterOnScheduleJobDetail" class="org.springframework.scheduling.quartz.MethodInvokingJobDetailFactoryBean"> <property name="targetObject" ref="updateDataFeedJob"/> <!-- the method to call inside of com.siemens.scr.schedule.UpdateDataFeedJob --> <property name="targetMethod"