spring-batch

问题 I am writing a program using Spring Batch to process 7,637,064 rows from a MySQL database table. I've had success with smaller tables, but the large number of rows in this table is causing OutOfMemoryError exceptions when the JdbcCursorItemReader attempts to open the cursor. I could probably resolve this by throwing a larger Xmx at it, but it seems to me that Spring Batch should have a way to handle this and that I may simply be missing a key piece of configuration. Spring Batch configuration

问题 I am writing a program using Spring Batch to process 7,637,064 rows from a MySQL database table. I've had success with smaller tables, but the large number of rows in this table is causing OutOfMemoryError exceptions when the JdbcCursorItemReader attempts to open the cursor. I could probably resolve this by throwing a larger Xmx at it, but it seems to me that Spring Batch should have a way to handle this and that I may simply be missing a key piece of configuration. Spring Batch configuration

问题 I'd like to know the difference between corePoolSize and throttle-limit as Spring Batch attributes defining multi threading configuration. I've got the difference between corePoolSize and maxPoolSize thanks to this post "What is the difference between corePoolSize and maxPoolSize in the Spring ThreadPoolTaskExecutor" But my issue concerns corePoolSize vs throttle-limit ... I found that it's preferable to define CorePoolSize = Throttle-limit, but I'm wondering... if I define for example :

问题 I want to test Spring Batch, but I need to use it without maven or gradle because there are some restrictions in the network. I read a tutorial on spring and the spring documentation to configure a Job, but I get an "Error creating bean with name 'jobRepository'" This question has been asked already without an answer. I'm using Jeveloper and Weblogic 12.1.3.0.0. My project has the following dependencies which I get from another project configured with Eclipse Maven: com.ibm.jbatch-tck-spi-1.0

问题 Context We have a batch job that replicates localized country names (i.e. translations of country names to different languages) to our DB from the external one. The idea was to process all localized country names for a single country in 1 chunk (i.e. first chunk - all translations for Andorra, next chunk - all translations for U.A.E., etc.). We use JdbcCursorItemReader for reading external data + some oracle analytic functions to provide total number of translations available for the country:

问题 I am working on spring batch, for writer currently using FlatFileItemWriter. I would like to write my input file content to more than one flat file based on some field value. Is Spring batch support any kind of functionality by default.[something similar to CompositeItemWriter] For example, my input file content is something like this. john,35,retail,10000 joe,34,homeloan,20000 Amy,23,retail,2000 Now i would like to write two different files based on third column, it means row 1 and row 3

问题 In the spring batch code, I am reading chunk of 100 records. for each record in the chunk I am checking whether the record exists in the DB or not. If the record exists in the DB I am not inserting it. For the first time, if I have a duplicate record in the chunk of 100, the spring batch processor is not able to identify that this record is duplicate as there is no data in DB and the processor will select all 100 first and then perform the insert. Is there a way I can perform a check within

问题 I want to use Spring Batch and Spring Integration to import data from database and write them into a file and ftp them to a remote server. But I guess my problem is I don't want to create Domain Object for my table. My queries are random and I want something that just reads the data and writes it to files and transfer. Can I use Spring Batch and Integration without creating respective domain objects? 回答1: Absolutely. You can use either of the JDBC ItemReader s or the JPA ItemReader with a

问题 I tried spring.batch.job.enabled=false in application.properties and -Dspring.batch.job.enabled=false when running the jar file. However @EnableBatchProcessing automatically start running the batch jobs on application start. How i can debug such scenario? TestConfiguration.class @Configuration @EnableBatchProcessing public class TestConfiguration {...} MainApplication @ComponentScan("com.demo") @EnableAutoConfiguration public class MainApplication { public static void main(String[] args)

问题 I have one spring batch job which can be kicked of by rest URL. I want to make sure only one job instance is allowed to run. and if another instance already running then don't start another. even if the parameters are different. I searched and found nothing out of box solution. thinking of extending SimpleJobLauncher. to check if any instance of the job running or not. 回答1: You could try to intercept the job execution, implementing the JobExecutionListener interface: public class