spring-batch

问题 I'm using spring batch with custom reader and writer. I have a control table with customerId's . I need to run the same Step multiple times, once for each customer in my control table. The customerId should be able to pass as a parameter since I need it in the reader as well as in the writer. How can this best be achieved? @Bean public Step shipmentFactsStep() { return stepBuilderFactory.get("shipmentFactsStep") .<Shipmentfacts, Shipmentfacts>chunk(10000) .reader(shipmentfactsItemReader())

问题 I'm wanting to know how to log things such as the Job Name and Execution ID using MCD in Spring Batch. Here's some code: bootstrap.properties this file has a list of items I currently log, and I've added execId as the 3rd element here. logging.pattern.level=%5p [%X{X-B3-TraceId:-},%X{sessionId:-},%X{execId:-},%X{program:-},%X{mainframeId:-}] spring.application.name=mcc spring.profiles.active=globals,local,local-override MCC Application this file has my main method. When I manually set the

问题 I have a Spring Batch job that needs to do the below Check a directory on local file system that may contain more than one file Process each of the files, save data from those files to database Rename files by adding a suffix to include PROCESSED or ERROR I have used the below A MultiResourceItemReader that reads files and delegates to a FlatFileItemReader The FlatFileItemReader reads data using LineMapper , FieldSetMapper An ItemProcessor manipulates data read An ItemWriter writes to the

问题 I am using FlatFileItemReader and have extended the AbstractResource to return a stream from Amazon S3 object. S3Object amazonS3Object = s3client.getObject(new GetObjectRequest(bucket,file)); InputStream stream = null; stream = amazonS3Object.getObjectContent(); return stream; In my batch job I have also implemented MultiFileResourcePartitioner in which i gave the bucket to partition all the files. I am able to read only part of few files and after which i get a socket reset error.see below

问题 I have implemented my batch jobs using spring batch partitioning and using rabbitmq as a middle ware. I studied documentation and referred to these unit tests https://github.com/sshcherbakov/spring-batch-talk/blob/master/src/main/resources/META-INF/master.xml https://github.com/sshcherbakov/spring-batch-talk/blob/master/src/main/resources/META-INF/slave.xml I can run my job steps concurrently but I am bit worried about how it will work if I launch multiple instances of same job at the same

问题 I have a use case where a user drop multiple csv files into remote directory and then place a ready.txt to indicate that files are ready to consume. Our applcation when it see a ready.txt file in the remote directory it should start copying all the files into local directory including ready.txt using sftp file inbound channel adapter. Is there a way to make sure readt.txt file is the last file to be copied to local directory? Because when files are copied from remote directory to local

问题 I am using quartz to schedule a spring batch job. The job reads a file from a folder( which has multiple files ) does some processing and copies it to another folder. is it possible to create multiple instances of the job, that will run concurrenty,reading multiple files ? My question is : In spring batch, is it possible to spawn multiple instances of the same job? I am using quartz schedular ? 回答1: In Spring Batch it is possible to start several jobs, provided you have supplied different

问题 I'm using JDeveloper and Weblogic 12c(12.1.3) and I want to create a job with XML using Spring Batch. When I deploy the project It shows me and error. I need to use this IDE because of some restrictions in my job, also, without using maven. I've seen several example and I think my XML it's fine. I think the problem is related to weblogic (I had a similar issue) because I made the same test with the same project structure and libraries using Netbeans IDE and GlassFish Open Source Edition 4.1.1

问题 My service is starting spring batch job. I want to be able to pass some object to the job, each time this object parameter will be different. This object I need to use in my tasklet. I am starting the job by JobLauncher. As far as I googled, I see that JobParameters wont' help me in this case. Also I found that lots of answers are to use JobExecutionContext or whatsoever. But I want to inject parameter object right before job start. Is it posssible? Service which starts the job @Service

问题 I have a functioning program that reads from a DB and inputs it into a flat file. I'm using Spring batch for these I want be able to choose the parameters for my query. How can I do that. My xml look something like this: <bean id="databaseitemreader" class="JdbcursorItemReader"> <property name = "datasource" <ref = ...> <property name = sql value= "Select fname , lname , address from tbl_student"/> Item file writer stuff ..... (This one does not need any change) I want to be be able to pass