spring-batch

I defined my tasklet without ItemWriter like this : <b:tasklet> <b:chunk reader="baseReader" processor="baseProcessor" commit-interval="100" /> </b:tasklet> and i got this error : Configuration problem: The <b:chunk/> element has neither a 'writer' attribute nor a <writer/> element. Do you have any idea ? Thanks Well, in a chunk, A reader and a Writer are MANDATORY! however, The ItemProcessor is optional. This is from the official doc : 5.1.1. Configuring a Step Despite the relatively short list of required dependencies for a Step, it is an extremely complex class that can potentially contain

I have one basis job with one basic step. This jobs is executing every x second (I am using quartz for this). Then in my config class I also have variable "runStep". Where should I add this attribute and run my step only if runStep is true ? <batch:job id="export1" parent="baseJob"> <batch:step id="registruj" parent="baseStep"> <tasklet> <chunk reader="registrujReader" processor="registrujProcessor" writer="registrujWriter" commit-interval="1" /> </tasklet> </batch:step> </batch:job> <bean id="baseJob" class="org.springframework.batch.core.job.SimpleJob" abstract="true"> <property name=

This is a tough one, but I am sure it is not unheard of. I have two datasets, Countries and Demographics. The countries dataset contains the name of a country and an ID to it's Demographic data. The demographic dataset is a hierarchal dataset starting from the country down to the suburb. Both of these datasets are pulled from a 3rd party on a weekly basis. I need to split the demographics out into files, one for each country. So far the steps that i have are 1) Pull Countries 2) Pull Demographics 3) (this is needed) Loop over the country dataset calling a "Write Country Demographics to File"

I've to write a Spring batch which will read a file from HDFS and will update the data in MySQL DB. The source file in HDFS contains some report data, in CSV format. Can someone point me to an example of reading a file from HDFS? Thanks. The FlatFileItemReader in Spring Batch works with any Spring Framework Resource implementation: @Bean public FlatFileItemReader<String> itemReader() { Resource resource; // get (or autowire) resource return new FlatFileItemReaderBuilder<String>() .resource(resource) // set other reader properties .build(); } So if you manage to have a Resource handle pointing

As of now, I'm able to connect to Cassandra via the following code: import com.datastax.driver.core.Cluster; import com.datastax.driver.core.Session; public static Session connection() { Cluster cluster = Cluster.builder() .addContactPoints("IP1", "IP2") .withCredentials("user", "password") .withSSL() .build(); Session session = null; try { session = cluster.connect("database_name"); session.execute("CQL Statement"); } finally { IOUtils.closeQuietly(session); IOUtils.closeQuietly(cluster); } return session; } The problem is that I need to write to Cassandra in a Spring Batch project. Most of

I have a simple job as below: <batch:step id="step"> <batch:tasklet> <batch:chunk reader="itemReader" processor="itemProcessor" writer="itemWriter" commit-interval="5000" /> </batch:tasklet> </batch:step> itemReader is as below: <bean id="itemReader" class="org.springframework.batch.item.file.FlatFileItemReader" scope="step"> <property name="linesToSkip" value="1"></property> <property name="skippedLinesCallback" ref="skippedLinesCallback" ></property> <property name="lineMapper"> <bean class="org.springframework.batch.item.file.mapping.DefaultLineMapper"> <property name="lineTokenizer"> <bean

I have a simple spring batch job - read a file line by line, do something with the input string, and write some output. Output file contains every line of input plus some processing status for that line (success/failure.) The reads a file from: <dir>/<inputFolder>/<inputFileName> and writes processed output to <dir>/<outputFolder>/<inputFileName> All these values are passed as jobParameters File Reader is like so: <bean id="itemReader" class="org.springframework.batch.item.file.FlatFileItemReader" scope="step"> <property name="resource" value="file:#{jobParameters['cwd']}/#{jobParameters[