talend

How can I convert local time to UTC and vice versa in a Talend job

自作多情 提交于 2019-12-09 07:19:50
问题 I have a database (not SQL) with time fields all filled with local time. And I have a database (SQL) with time fields in UTC. Now I want to exchange information between those databases, but I can only realize this if I can convert from local time to UTC and vice versa. How can I achieve this in Talend? I know the data in the local time database, is the local time in the Netherlands. (GMT +1 (winter) of GMT +2 (summer)) Examples: 23-10-2015 16:00 Local time => 23-10-2015 14:00 UTC (and vice

Using single XSLT -multiple Transformation for removal of xsi:nil =“true” and splitting of XML file

自作多情 提交于 2019-12-08 15:04:33
问题 We are trying to write XML file using data integration tool (talend) ) then,We triggered tXSLT (that is transformation component) over outputted XML. Basically, we want to apply two transformation at a time. that is splitting of XML file and removal of xsi:nil ="true" element from our XML document. Original XML file Look like It has SalesOrders information <?xml version="1.0" encoding="Windows-1252"?> <SalesOrders xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi

Alternatives to Talend Big data tool [closed]

不打扰是莪最后的温柔 提交于 2019-12-08 14:20:25
问题 Closed. This question is off-topic. It is not currently accepting answers. Want to improve this question? Update the question so it's on-topic for Stack Overflow. Closed 4 years ago . i want to know other products like Talend.I would like to know competing products Is there any? please suggest Thanks 回答1: CloverDX and Pentaho are two good options to consider. 来源: https://stackoverflow.com/questions/16980571/alternatives-to-talend-big-data-tool

talend - parameterized tOracleInput query and naming of output

孤街醉人 提交于 2019-12-08 09:39:45
问题 I have a view as a tOracleInput and another component for output (lets day tOutputDelimited for simplicity purpose). Now I want to add a where clause to some of the fields in my tOracleInput to filter data. The idea is to pass these value as an argument during the jar execution for filtering of output. Moreover, the filename of the output must came from the first argument passed from jar execution. Anyone can enlighten me on how to achieve 1 & 2. Thanks in advance 回答1: In your job, create 2

Talend: How to import this csv file in SQL?

北城余情 提交于 2019-12-08 09:39:00
问题 I receive CSV files from BP, regarding our fuel and tol transactions. The file begins always with these 7 lines of information, which is not included in the details. How can I import this data into 1 table in SQL using Talend? I know how I can import data from a csv file into SQL, but how can I add the information in de header (Factuur number, Factuur Date, ...) to every row in de details. "Factuur","12345678" "Datum","27/02/2012" "Totaal:","1" "Totaal netto:","99,18" "Totaal bruto:","107,13"

Mapping FK into a table in talend

十年热恋 提交于 2019-12-08 09:12:18
问题 I have 2 entities in my schema. I mapped one already and now for the second one I need to also have the PK of the first entity as a FK in the second entity when mapping using talend. They are both in the same job, but how can I use the Pk of the first entity in the mapping of the second entity? enter image description here This is what I have so far (row1 is entity1 which has an autogenerated key inside the tmap) row2 is creating csv from xml file row3 maps the csv file generated from row2,

Talend tWaitForFile insufficiency

岁酱吖の 提交于 2019-12-08 08:07:48
问题 We have a producer process that write files into a specific folder, which run continuously, we have to read files one by one using talend, there is 2 issues: The 1st: tWaitForFile read only files which exist before its starting, so files which have created after the component starting are not visible for it. The 2nd: There is no way to know if the file is released by the producer process, it may be read while it is not completely written, the parameter _wait_release_ of tWaitForFile does not

how to export talend job as single fat jar

ⅰ亾dé卋堺 提交于 2019-12-08 06:45:22
问题 Is it possible to export the talend job as one jar only (inclusive of all its dependencies)? Because currently, the exported zip file has the dependencies outside. Thanks in advance 回答1: I never found a way to achieve the one single jar inclusive of dependencies output via the Talend Open Studio (Community Edition). The workaround is to create a Java Application, add the libraries and the job jars into it, then package that java application as one fat jar. 回答2: You can build the job.

Java Program with args to implement in Talend

三世轮回 提交于 2019-12-06 15:27:08
问题 I have been asked to write a Java program that would take TSV files as an inpunt and generate a different TSV file (with quite some changes inside it that are very variable on the input and args) as output. It is a pretty big program (took me 3 days to code but I'm not good) and it is finally working on inputs from 15k lines, generating 1500K lines output. Writing the code, I had no idea that I would have to implement it in Talend afterwards, so it is a normal Java program that takes 4 args :

Loop through all schemas in Talend

落花浮王杯 提交于 2019-12-06 13:07:33
问题 I am struggling with looping all schemas in Oracle. What I need to achieve is as shown below Create connection Use the existing to fetch the schema tOracleInput2 tJavaRow to assign variable tFlowToIterate for Iterations Alter session based on schema fetched at step 2 using tOracleRow_1 Now i need to execute query and generate certain output and that will require one or more steps But the issue is, that it will iterate till step 5 and when all the iterations are done, it moves to step 6. I