spring-batch

问题 I haven't seen a script to do the DDL modification necessary to go from Spring Batch 2 -> 3 in MySQL. Curious if one exists? 回答1: After running a quick comparison of the schemas, these appear to be the changes for upgrading from Spring Batch 2.2.7.RELEASE -> 3.0.1.RELEASE on MySQL. ALTER TABLE `BATCH_JOB_EXECUTION` MODIFY COLUMN `EXIT_CODE` varchar(2500) DEFAULT NULL; ALTER TABLE `BATCH_JOB_EXECUTION` ADD COLUMN `JOB_CONFIGURATION_LOCATION` varchar(2500) DEFAULT NULL; ALTER TABLE `BATCH_JOB

问题 I have implemented spring batch partitioning for a single steps where a master step delegates its work to several slave threads which than gets executed in parallel. As shown in following image.(Reference Spring docs) Now what if I have multiple steps which are to be executed in parallel? How to configure them in batch configuration? My current configuration is <batch:job id="myJob" restartable="true" job-repository="jobRepository" > <batch:listeners> <batch:listener ref="myJoblistener"><

问题 Use case: Read 10 million rows [10 columns] from database and write to a file (csv format). Which ItemReader implementation among JdbcCursorItemReader & JdbcPagingItemReader would be suggested? What would be the reason? Which would be better performing (fast) in the above use case? Would the selection be different in case of a single-process vs multi-process approach? In case of a multi-threaded approach using TaskExecutor, which one would be better & simple? 回答1: To process that kind of data

问题 We have simple batch processes which are working fine. Recently we have new reqmnt to implement new batch process to generate reports. We have diff source of data to read to prepare this reports. Specifically we might have one view for each report. Now we want to scale this process in such a way that, it can be scaled and be completed as early as possible. I am familiar with multithread step but not sure about other strategy(Remote chunking and partition step) and which one to use when. In

问题 Does anyone have good example of Spring Batch (Using Annotation) to cache a reference table which will be accessible to processor ? I just need a simple cache, run a query which returns some byte[] and keep it in memory till the time job is executing. Appreciate any help on this topic. Thanks ! 回答1: A JobExecutionListener can be used to populate the cache with reference data before the job is executed and clear the cache after the job is finished. Here is an example: import org

问题 I am new to Spring Batch and I have run into a problem. The batch application I am working on reads and processes lines from a delimited text file. I have configured the application to use a FlatFileReader to read the delimited text file, but the issue is that some of the data being read has a double quote in it. A FlatFileParseException is thrown when the FlatFileReader encounters a single double quote, but none is thrown when two double quotes are present. Has anyone come across this issue,

问题 I'm implementing Multi-Line Records Reader solution based on https://docs.spring.io/spring-batch/reference/html/patterns.html#multiLineRecords I have the following flat file: HEA;0013100345;2007-02-15 NCU;Smith;Peter;;T;20014539;F BAD;;Oak Street 31/A;;Small Town;00235;IL;US HEA;0013100345;2007-02-15 NCU;Smith;Peter;;T;20014539;F HEA;0013100345;2007-02-15 HEA(and optionally NCU, BAD) must be converted to a single object. However in my case I don't have "end" line, so "HEA" is a start of new

问题 I need to get an ideal number of threads in a batch program, which runs in batch framework supporting parallel mode, like parallel step in Spring Batch. As far as I know, it is not good that there are too many threads to execute steps of a program, it may has negative effect to the performance of the program. Some factors could arise performance degradation(context switching, race condition when using shared resources(locking, sync..) ... (are there any other factors?)). Of course the best

问题 I am developing Spring Batch CompositeItemReader & Writer Example. I developed XML file and able to compile code successfully, but when running mu sample code gives me following error. Not sure what is going wrong? org.springframework.beans.NotReadablePropertyException: Invalid property 'customerNumber' of bean class [java.lang.String]: Bean property 'customerNumber' is not readable or has an invalid getter method: Does the return type of the getter match the parameter type of the setter? at

问题 I am developing Spring Batch CompositeItemReader & Writer Example. I developed XML file and able to compile code successfully, but when running mu sample code gives me following error. Not sure what is going wrong? org.springframework.beans.NotReadablePropertyException: Invalid property 'customerNumber' of bean class [java.lang.String]: Bean property 'customerNumber' is not readable or has an invalid getter method: Does the return type of the getter match the parameter type of the setter? at