etl

Oracle connections broken in SSIS after uninstalling 32bit version of oracle client

元气小坏坏 提交于 2020-01-04 10:05:09
问题 I get the following error message when I try to test my connections: Test connection failed because of an error in initializing provider. The 'OraOLEDB.Oracle.1' provider is not registered on the local machine I originally had 32 bit and 64 bit version of Oracle 12 client installed on my work machine. I uninstalled the 32bit version, because it was causing some conflicts with another application, but now after uninstalling I can no longer use my oracle connections in SSIS. I'm using Visual

How Intersect and Except result in SSIS

て烟熏妆下的殇ゞ 提交于 2020-01-04 06:52:56
问题 Have Two result Set A and B, In SSIS Merge Join how get EXCEPT and INTERSECT of A result set. Bellow sql syntax return desired out put: ---Insersect select a.* from A a Inner join B b on a.Key=b.Key --Except select a.* from A a left join B b on a.Key=b.Key where b.Key is null How to get those query result from SSIS merge join 回答1: According to his Microsoft Artcile, "The Merge Join transformation provides an output that is generated by joining two sorted datasets using a FULL, LEFT, or INNER

Convert month name to month number in SSIS

时间秒杀一切 提交于 2020-01-04 06:25:09
问题 I have an input column "MonthName" which has values in the following string format 22-MAY-2017 02:29:33.00 . I would like to convert this into Datetime data type in the destination table. For that the following conversion needs to be done 22-MAY-2017 02:29:33.00 to 22-05-2017 02:29:33.00 How do i achieve this in Derived Column task. I am using below expression to fetch the month name part of the value but i don't think it servers much of my purpose SUBSTRING(MonthName,FINDSTRING(MonthName,"-"

convert ssis expression datetime to int

微笑、不失礼 提交于 2020-01-04 01:51:30
问题 I want to calculate last friday's date in ssis. Below code is doing it. DATEADD("dd", -1 - (DATEPART("dw", getdate()) % 7), getdate()) But it gives results for datetime datatype and I want results for int data type in ssis. How to convert? DATEADD("dd", -1 - (DATEPART("dw", getdate()) % 7), getdate()) 回答1: According to this Microsoft article: When a string is cast to a DT_DATE, or vice versa, the locale of the transformation is used. However, the date is in the ISO format of YYYY-MM-DD,

convert ssis expression datetime to int

走远了吗. 提交于 2020-01-04 01:51:13
问题 I want to calculate last friday's date in ssis. Below code is doing it. DATEADD("dd", -1 - (DATEPART("dw", getdate()) % 7), getdate()) But it gives results for datetime datatype and I want results for int data type in ssis. How to convert? DATEADD("dd", -1 - (DATEPART("dw", getdate()) % 7), getdate()) 回答1: According to this Microsoft article: When a string is cast to a DT_DATE, or vice versa, the locale of the transformation is used. However, the date is in the ISO format of YYYY-MM-DD,

informatica powercenter vs custom perl ETL job?

瘦欲@ 提交于 2020-01-02 07:02:09
问题 Most of my company uses powercenter informatica for Extract-Transform-Load type data move jobs between databases. However project I am on has a big custom Perl job with some Java thrown in for good measure to move data and trigger some other updates. There is talk of rewriting the thing to use powercenter instead, what are people's experiences on such a project, does it make sense? Seems like you trade lot of flexibility in going to such a "off the shelf" solution, but do the ETL tools buy

How to use OrientDB ETL to create edges only

天大地大妈咪最大 提交于 2020-01-02 04:01:06
问题 I have two CSV files: First containing ~ 500M records in the following format id,name 10000023432,Tom User 13943423235,Blah Person Second containing ~ 1.5B friend relationships in the following format fromId,toId 10000023432,13943423235 I used OrientDB ETL tool to create vertices from the first CSV file. Now, I just need to create edges to establish friendship connection between them. I have tried multiple configuration of the ETL json file so far, the latest being this one: { "config": {

Java ETL process

不羁的心 提交于 2020-01-02 00:32:35
问题 I have this new challenge to load ~100M rows from an Oracle database and insert them in a remote MySQL database server. I've divided the problem in two: a server side REST server responsible for loading data into the MySQL server; a client side Java app that is responsible from loading the Oracle data source. At the Java side I've used plain JDBC for loading paginated content and transfer it over the wire to the server. This approach works well but it makes the code cumbersome and not very

Can a array list of C# be used to populate SSIS object variable?

好久不见. 提交于 2020-01-01 15:32:31
问题 I have populated a list in C# script and assigned its value to SSIS object variable. Then I used that object variable to execute some SQL query by looping through For each do enumerator. I tried doing this by Foreach ado enumerator but getting error X variable doesn't contain a valid data object. Can anybody provide any inputs. 回答1: Youre using a list. Not a recordset and therefore you need to enumerate over a variable. If you want to use ADO Recordset, you need to fill a datatable instead.

import tab-delimited txt into Access table using VBA

拥有回忆 提交于 2020-01-01 03:24:24
问题 I am trying to import a tab-delimited txt file into an Access table using VBA. In my code, I want to insert it into a table that has not yet been created. Here is what I tried doing. Note - I was able to make this work with a CSV, and without including this: DataType:=xlDelimited, Tab:=True Sub InsertData() 'import CSV into temp table DoCmd.TransferText TransferType:=acLinkDelim, TableName:="tbl_TEMP", _ FileName:=FileNameVariable, HasFieldNames:=True, DataType:=xlDelimited, Tab:=True End Sub