talend

Export Talend items from talend studio put on SVN and build it from Jenkins

我的未来我决定 提交于 2019-12-21 02:47:15
问题 Hi I am using talend open studio 5.5. I want to export talend job and put into the SVN. It contains the following files. 1) process a) .items b) .properties I want to build talend job from this and create jar, bat and sh files as created when build job in talend open studion. 回答1: This part of a series explains how to use the Talend command line tool to build jobs from outside of the studio. It's scriptable so can be access from an external tool and in this case Jean-Baptiste uses Maven as a

How to Guess schema in Mysqlinput on the fly in Talend

大兔子大兔子 提交于 2019-12-20 07:13:30
问题 I've build a job that copy data from a mysql db table to b mysql table. The table columns are the same except sometimes a new column can be added in table a db. i want to retrieve all the columns from a to b but only those that exists in table b. i was able to put in the query specific select colume statment that exists in table b like: select coulmn1,column2,columns3... from table a the issue is if i add a new column in b that matches a the talend job schema in Mysqlinput should be changed

tJavaFlex behaviour when changing loop position

杀马特。学长 韩版系。学妹 提交于 2019-12-20 06:10:57
问题 Having some problems in a job, and I suspect it is due to a lack of understanding of tJavaFlex. I am generating 10 rows in this test job, and am generating loop inside a tJavaFlex: So there are 10 rows coming in, and a loop in the Start and End section. I was expecting that for each row coming in, it would generate 10 identical rows coming out. And that I would see iterations 0,1,2,3....9 for each row. What I got was this. This looks to me like the entire job is running 10 times, and so I

talend , mongoDB connection

你。 提交于 2019-12-19 11:43:32
问题 I am facing a problem with mongo DB connection. I have succefully imported tMongo components it to my Talend Open Studio 5.1.1 and by copying the mongo 1.3.jar file to lib/java folder, my Mongo DB jobs are running successfully, but the problem is even if I provide some fake server path(IP) and fake port for mongoDB, my job is running without an error and it is giving me 1 row with no data. and same goes with right IP and port. How do I resolve it. 回答1: I think the connection is not working.

Talend: java.lang.UnsatisfiedLinkError: no sapjco3 in java.library.path

Deadly 提交于 2019-12-18 08:53:18
问题 I have the jar and dll in the Talend lib directory. The path and classpath are set. I also have downloaded and installed the VC++ 2005 redistribution sp 1 patch and the missing dlls that are supplied by SAP. I have tried to run this ETL job on a windows 2003 machine and on a XP machine with the same result. Can anyone help me out here. Starting job Chargebacks at 13:57 03/10/2014. [statistics] connecting to socket on port 3350 [statistics] connected java.lang.UnsatisfiedLinkError: no sapjco3

JSON Deserialization on Talend

◇◆丶佛笑我妖孽 提交于 2019-12-14 03:21:36
问题 Trying to figuring out how to deserialize this kind of json in talend components : { "ryan@toofr.com": { "confidence":119,"email":"ryan@toofr.com","default":20 }, "rbuckley@toofr.com": { "confidence":20,"email":"rbuckley@toofr.com","default":15 }, "ryan.buckley@toofr.com": { "confidence":18,"email":"ryan.buckley@toofr.com","default":16 }, "ryanbuckley@toofr.com": { "confidence":17,"email":"ryanbuckley@toofr.com","default":17 }, "ryan_buckley@toofr.com": { "confidence":16,"email":"ryan_buckley

Unparseable Date error - Talend

陌路散爱 提交于 2019-12-13 20:42:53
问题 I am trying to copy data from Excel to a SQL table. I have dates generated in Excel file using RAND function. I am taking them as strings in an input and trying to convert them in date data type using tConvertType. I have setted its datatype as 'string' in initial input and as 'date' in tConvertType's output and in tMSSqlOutput. My job has work flow Excel input -> tConvertType -> tMap -> tMSSqlOutput. While running the job I am getting an error which says : java.text.ParseException:

Talend (7.0.1) - Cannot modify mapred.job.name at runtime

余生长醉 提交于 2019-12-13 19:30:59
问题 I am having some trouble running a simple tHiveCreateTable job in Talend OS for Big Data (Print of the job where I am getting this error). The Hive connection is fine and the job worked until Ranger was activated in the cluster. After ranger, I started getting the following log: [statistics] connecting to socket on port 3345 [statistics] connected Error while processing statement: Cannot modify mapred.job.name at runtime. It is not in list of params that are allowed to be modified at runtime

Importing data to SQL from Excel using Talend

醉酒当歌 提交于 2019-12-13 19:16:25
问题 I am trying to import data to SQL from Excel. I have created a successful connection with the database but while trying to retrieve the schema I am not getting my table, instead I am having the schema of the database (Type CATALOG). How do I get the schema of the table to which I will export the Excel data? I have refereed to this video to do the import. http://www.youtube.com/watch?v=JDBYU9f1p-I 回答1: What you can use is tFileExcelSheetOutput, map what you need with tMap and send the to t[DB

How to run multiple hive queries in tHiveRow in Talend latest versions

两盒软妹~` 提交于 2019-12-13 18:12:06
问题 I'm using talend 6.2.1 version. Trying to run multiple hive queries in tHiveRow , but it simply not allowing me to do so if I separate my queries with a ";". I have tried with tForEach , but there is a limitation to it as we cannot include a value greater than 130 characters. So, I turned to tFixedFlowInput but iterative run for multiple queries seems not possible here. I followed this Running multiple hive queries using tHiveRow component in Talend Can anybody help me achieve my objective.