talend

How to loop through child elements of XML type data column in talend

时光怂恿深爱的人放手 提交于 2019-12-12 06:16:10
问题 I want to migrate data from an old table which has one column which has data in XML form. I am trying to break the XML using talend but always getting the first element again and again. This is the data i have in my OLD DB: ID DETAIL 1 <ORDER_DETAIL> <PACK> <ID>703</ID> <NAME>iPhone 6-16 GB-Space Grey-KD 57 Pack</NAME> <STANDALONE_PRICE>0</STANDALONE_PRICE> <MONTHLY_PRICE>57</MONTHLY_PRICE> <UPFRONT_PRICE>0</UPFRONT_PRICE> <ITEMS> <ITEM> <ID>177</ID> <NAME>Bundle_2500_30GB_UNLIMITED</NAME>

Execute only one Talend Component

坚强是说给别人听的谎言 提交于 2019-12-12 05:49:30
问题 In Talend Open Studio, how do I execute only one of my components? If I click Run, all active components will run. So far the only way I know to execute a single component is to deactivate all others in the Job. How can I execute one component or subjob without having to deactivate all the other components in the job? 回答1: Well, I'm afraid you can't. Two possible solutions : Deactivating unwanted components / subjobs (like you already stated) Decompose your job into multiple jobs. This may

Talend job running with slow transfer rate

若如初见. 提交于 2019-12-12 05:17:20
问题 I am new to talend and have very limited experience in it , My task required to perform daily incremental update from sql rds to redshift on daliy basis, however my job runs with very slow transfer rate details are listed below my sql rds query is SELECT * FROM test.ankit2 WHERE id > (SELECT COALESCE(max(id), 0) as id FROM test.stagetable) ankit2 is the table in myrds and stagetable is table in redshift and used tmap component to link the component from rds input to redshift output component

Merge Operation Fails -gpload utility greenplum

守給你的承諾、 提交于 2019-12-12 03:44:57
问题 We would like try to describe my problem below: We have small gpdb cluster. In that,we are trying for Data integration using Talend tool. We are trying to load the incremental from a table to another table, quite simple... I thought... Job Data Flow is tgreenplumconnection | tmssqlinput--->thdfsoutput-->tmap-->tgreenplumgpload--tgreenplumcommit Getting error Exception in thread "Thread-1" java.lang.RuntimeException: Cannot run program "gpload": CreateProcess error=2, The system cannot find

How to downlaod a file (image, pdf,…) using talend

自作多情 提交于 2019-12-12 03:33:49
问题 I want to migrate Files (Attachments) from a FTP server to another server (Salesforce), to do that i am going to use talend. i have no clue which components to use and in which order in order to download the files (multiple formats but downloadable via a http link), and to insert them into salesforce database, i will be grateful if someone explains to me how to proceed (what are the components to use and how to relate them) ? 回答1: Based on the info provided, first you will obtain the files

Running Talend child jobs through a parent job

◇◆丶佛笑我妖孽 提交于 2019-12-12 02:11:45
问题 I want to develop a Talend job parent job which will read a file. This file will have all the child job names. So the parent job when run must go through each entry in the file (ie each child job name) and execute the child job. Can anyone please guide me on this. 回答1: You can use the tRunJob dynamic job feature, I executed 3 sub jobs called a, b and c, and the order is specified in the file, see below : First block is to load your file into context, you can use a properties file or delimited

Eliminate duplicates and Insert Unique records having max no. of column values present through Talend

耗尽温柔 提交于 2019-12-12 01:23:42
问题 I have an excel file which gets updated on a daily basis i.e the data is always different every time. I am pulling the data from the Excel sheet into the table using Talend . I have a primary key Company_ID defined in the table. The error I am facing is that the Excel sheet has few duplicate Company_ID values. It will also pick up more duplicate values in the future as the Excel file will be updated daily. I want to choose the first record where the Company ID field is 1 and the record doesn

talend etl oracle error 0 row insert

怎甘沉沦 提交于 2019-12-11 23:35:18
问题 I am a newbie to TalendETL and am using Talend Open Studio for Big Data version 6.2. I have developed a simple Talend ETL job that picks up data from a tFileInputExcel and tOracleInput(dimension date ) and inserts data into my local Oracle Database. Below is how my package looks : this job run but i get 0 rows insert into my local Oracle Database 回答1: Your picture shows that no rows come out your tMap Component. Verify that your links inside the Tmap are corrects. 回答2: Seems there is no data

Cannot compare xs:string to xs:integer

空扰寡人 提交于 2019-12-11 18:46:54
问题 Currently running a code on Talend and it throws up this error net.sf.saxon.trans.XPathException: Cannot compare xs:string to xs:integer at net.sf.saxon.expr.GeneralComparison.typeCheck(GeneralComparison.java:255) when the saxon 9 is added to the configuration but when its removed it works fine. Any ideas why its interfering with the xpath 回答1: Which version of Saxon, precisely, did you add to the Configuration? Prior to Saxon 9.6, the Saxon jar file included a manifest indicating that it was

I need to run 2 twaitforfile in the same subjob talend

笑着哭i 提交于 2019-12-11 17:30:11
问题 I need to run 2 file watchers in the same subjob using talend. Right now If I link them together I get only one file watching running when I run talend. Below is what I have. Is there a way to execute them together. The reason for this is because im trying to get the Fk from one table into the tmap from another table, so any other suggestion on how to do this is also appreciated: enter image description here 回答1: In one subjob, you can only have one 'beginning' component (the one with the