talend

Encoding Issue in Talend Open Studio

你说的曾经没有我的故事 提交于 2020-01-06 19:48:12
问题 I am working on a Talend Project, Where we are Transforming data from 1000's of XML files to CSV and we are creating CSV file encoding as UTF-8 from Talend itself. But the issue is that some of the Files are created as UTF-8 and some of them created as ASCII , I am not sure why this is happening The files should always be created as UTF. 回答1: As mentioned in the comments, UTF8 is a superset of ASCII. This means that the code point for any ASCII characters will be the same in UTF8 as ASCII.

talend - filename of output from a column value

时光毁灭记忆、已成空白 提交于 2020-01-06 16:24:51
问题 I have an existing job: tDatabaseInput -> tMap -> tOutputDelimited For the last component, I'll be needing the filename of the file to be based from one of the columns named TYPE (which is always the same for every row). The value for the column named TYPE is 'A1' which is the same for all the records in the database. Thanks in advanced 回答1: There is many ways to do it, but here is the simplest and more readable job : tMySqlConnection_1 : Get a connection to the data base server tMysqlInput_1

Talend tRestClient Consume REST API with 1 header

两盒软妹~` 提交于 2020-01-06 09:31:52
问题 I'm trying to call a simple 'Hello World' REST API via the GET verb. The API is only expecting one HTTP Header, Accept application/json which i've set in the Advanced Settings>HTTP Headers of my tRestClient component. However, looking at the code tab, Talend seems to automatically create another entry for the contents of the Accept Type dropdown. When i run I’m getting HTTP 406 Not Acceptable back because the API is not expecting 2 headers. I've tested this API with other software and it

Talend tRestClient Consume REST API with 1 header

ⅰ亾dé卋堺 提交于 2020-01-06 09:31:30
问题 I'm trying to call a simple 'Hello World' REST API via the GET verb. The API is only expecting one HTTP Header, Accept application/json which i've set in the Advanced Settings>HTTP Headers of my tRestClient component. However, looking at the code tab, Talend seems to automatically create another entry for the contents of the Accept Type dropdown. When i run I’m getting HTTP 406 Not Acceptable back because the API is not expecting 2 headers. I've tested this API with other software and it

Talend tRestClient Consume REST API with 1 header

丶灬走出姿态 提交于 2020-01-06 09:31:27
问题 I'm trying to call a simple 'Hello World' REST API via the GET verb. The API is only expecting one HTTP Header, Accept application/json which i've set in the Advanced Settings>HTTP Headers of my tRestClient component. However, looking at the code tab, Talend seems to automatically create another entry for the contents of the Accept Type dropdown. When i run I’m getting HTTP 406 Not Acceptable back because the API is not expecting 2 headers. I've tested this API with other software and it

Parse date with possible single-digit month/day/hour using java.text.SimpleDateFormat

↘锁芯ラ 提交于 2020-01-03 19:02:38
问题 On a project with Talend Open Studio (an Open Source code-generating ETL tool), I am getting errors parsing incoming date strings like "3/14/1967 0:00:00" ( note the single-digit month ). Digging into the code, I can see it is using java.text.SimpleDateFormat. So the date pattern string I expect I need to use is "d-M-yyyy H:mm:ss" ... but it keeps giving me errors like "Unparseable date: 3/14/1967 0:00:00". I assume that SimpleDateFormat can deal with the single-or-double digit problem. Do I

Running multiple hive queries using tHiveRow component in Talend

时光总嘲笑我的痴心妄想 提交于 2020-01-02 13:44:11
问题 Hi i want to tun multiple hive queries through a single component. Through tHiveRow i'm able to run single query but unable to run multiple queries at a time. I know that we can run multiple sql queries after going through the following link http://www.vikramtakkar.com/2013/05/example-to-execute-multiple-sql-queries.html But any one has any idea as how to run multiple queries? 回答1: Your link reference shows a MySQL connection... this says nothing about the Hive JDBC driver capabilities, since

Expose Talend ETL Job as a Web Service

匆匆过客 提交于 2019-12-30 09:35:15
问题 I am currently evaluating Talend ETL (Talend Open Studio for Data Integration). I would like to know how / if i can expose an ETL Job as a Web Service. I know i can export jobs as web services and invoke them through a specific URL however, my goal is to be able to expose a specific WSDL with IN / OUT parameters. A sample use case would be: 1) Invoke WS in Talend ETL and pass XML with data 2) Talend ETL extracts the data from the XML and inserts them as variable(s) in the query to be executed

how to load data faster with talend and sql server

走远了吗. 提交于 2019-12-30 01:20:08
问题 I use Talend to load data into a sql-server database. It appears that the weakest point of my job is not the dataprocessing, but the effective load in my database, which is not faster than 17 rows/sec. The funny point is that I can launch 5 jobs in the same time, and they'll all load at 17rows/sec . What could explain this slowness and how could I improve the speed? Thanks New informations: The transfer speed between my desktop and the server is about 1MByte My job commits every 10 000 I use

Custom component with dynamic configuration like jira, jdbc or azurestorage in talend

徘徊边缘 提交于 2019-12-25 09:42:28
问题 I want to create a Talend component with dynamic configuration. I tried various sources to achieve that but no luck, apprach I tried previously but I could not able to link the component with plug-in, it always gives the error failed to load component then I am trying to create plugins like azure storage I cloned the repo from talend components with dynamic configuraion I developed the new component like azure storage and tried to register in C:\Users\sandy\Documents\talend\TOS_BD-20161216