spring-batch | 易学教程

How to handle the exceptions thrown from item reader?

阅读更多关于 How to handle the exceptions thrown from item reader?

问题 I want to catch the exceptions thrown from item reader (e.g. reader not open , incorrect token exceptions etc) and handle it. Currently spring batch is throwing them as fatal exceptons and come out of the step. Please let me know if there is any way to do it? 回答1: I faced the same issue whereby I wanted to catch the org.springframework.batch.item.file.FlatFileParseException thrown by the FlatFileItemReader and perform some custom handling & logging. Did some research and almost reached the

Multi-threading with Spring batch File Item Reader

阅读更多关于 Multi-threading with Spring batch File Item Reader

问题 In a Spring Batch I am trying to read a CSV file and want to assign each row to a separate thread and process it. I have tried to achieve it by using TaskExecutor, but what is happening all the thread is picking the same row at a time. I also tried to implement the concept using Partioner, there also same thing happening. Please see below my Configuration Xml. Step Description <step id="Step2"> <tasklet task-executor="taskExecutor"> <chunk reader="reader" processor="processor" writer="writer"

Spring Batch: Create an ItemReader that reads an xml file from a web service

阅读更多关于 Spring Batch: Create an ItemReader that reads an xml file from a web service

问题 I am trying to create a Spring Batch job that will process an xml file that will be served up through a REST call. I am trying to use an XML file that's hosted on the internet to test this. The file is located at: http://www.w3schools.com/xml/plant_catalog.xml I downloaded this file locally and am able to convert it to an object and write it, but I don't know how I can do the same without downloading the file locally. This works locally, but how can I specify a URL as the resource for the xml

Spring Batch - Not all records are being processed from MQ retrieval

阅读更多关于 Spring Batch - Not all records are being processed from MQ retrieval

问题 I am fairly new to Spring and Spring Batch, so feel free to ask any clarifying questions if you have any. I am seeing an issue with Spring Batch that I cannot recreate in our test or local environments. We have a daily job that connects to Websphere MQ via JMS and retrieves a set of records. This job uses the out-of-the-box JMS ItemReader. We implement our own ItemProcessor, but it doesn't do anything special other than logging. There are no filters or processing that should affect incoming

Spring Batch ItemReader list processed only once

阅读更多关于 Spring Batch ItemReader list processed only once

问题 I'm trying to create a Spring Batch job using a ListItemReader<String> , ItemProcessor<String, String> and ItemWriter<String> . The XML looks like the following, <job id="sourceJob" xmlns="http://www.springframework.org/schema/batch"> <step id="step1" next="step2"> <tasklet> <chunk reader="svnSourceItemReader" processor="metadataItemProcessor" writer="metadataItemWriter" commit-interval="1" /> </tasklet> </step> <step id="step2"> <tasklet ref="lastRevisionLoggerTasklet"></tasklet> </step> <

Spring Batch - How to read one big file in multiple threads?

阅读更多关于 Spring Batch - How to read one big file in multiple threads?

问题 Problem: Read file of size > 10 MB and load it in staging table using Spring Batch. How can we maintain state while reading a file, in order to restart the job if it fails? As per the documentation the FileItemReader is not thread safe and if we try to make it thread safe, we end up loosing restartability. So basic questions are: Is there a way to read the file in blocks and each thread knows which block it needs to read? If we make the read synchronous, what changes are required to make the

Cannot convert value of type 'org.springframework.batch.item.xml.StaxEventItemWriter' to required type 'org.springframework.batch.item.ItemReader'

阅读更多关于 Cannot convert value of type 'org.springframework.batch.item.xml.StaxEventItemWriter' to required type 'org.springframework.batch.item.ItemReader'

I am developing Spring Batch MongoDB to XML example. I've successfully created the project, but when I am running it I see the below error is coming, I don't know what is going wrong here. Error for reference Exception in thread "main" org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'step1': Initialization of bean failed; nested exception is org.springframework.beans.ConversionNotSupportedException: Failed to convert property value of type 'org.springframework.batch.item.xml.StaxEventItemWriter' to required type 'org.springframework.batch.item.ItemReader'

Is there a spring batch “job” scope?

阅读更多关于 Is there a spring batch “job” scope?

问题 I just want to know if there is a "JOB" scope in spring batch, like the "STEP" scope ? If there is not, should we develop our custom scope, or is there a better alternative ? Thanks in advance. 回答1: A jira has been opened some times ago on the spring batch issues tracker regarding this issue: https://jira.springsource.org/browse/BATCH-1701 A pull request has been submitted as well, hopefully it will be merge soon, because I have this use case too: https://github.com/SpringSource/spring-batch

spring batch writing to a fixed format file

阅读更多关于 spring batch writing to a fixed format file

I have an Item Writer as below: <beans:property name="lineAggregator"> <beans:bean class="org.springframework.batch.item.file.transform.FormatterLineAggregator"> <beans:property name="fieldExtractor"> <beans:bean class="org.springframework.batch.item.file.transform.BeanWrapperFieldExtractor"> <beans:property name="names" value="column1, column2, column3, column4 " /> </beans:bean> </beans:property> <beans:property name="format" value="%-8s%-12s%-11s%-16s" /> </beans:bean> </beans:property> As clear, I am writing 4 columns to a fixed format file with column lengths as 8, 12, 11 and 16

How to load all files of a folder to a list of Resources in Spring?

阅读更多关于 How to load all files of a folder to a list of Resources in Spring?

问题 I have a folder and want to load all txt files to a list using Spring and wildcards: By annotation I could do the following: @Value("classpath*:../../dir/*.txt") private Resource[] files; But how can I achieve the same using spring programmatically? 回答1: Use ResourceLoader and ResourcePatternUtils: class Foobar { private ResourceLoader resourceLoader; @Autowired public Foobar(ResourceLoader resourceLoader) { this.resourceLoader = resourceLoader; } Resource[] loadResources(String pattern)