etl

问题 We have a need to do the initial data copy on a table that has 4+ billion records to target SQL Server (2014) from source MySQL (5.5). The table in question is pretty wide with 55 columns, however none of them are LOB. I'm looking for options for copying this data in the most efficient way possible. We've tried loading via Attunity Replicate (which has worked wonderfully for tables not this large) but if the initial data copy with Attunity Replicate fails then it starts over from scratch ...

问题 Thanks in advance for your help. I'm in need of help on writing SSIS script component to delimit single row to multiple rows. There were many helpful blog and post I looked at below: http://beyondrelational.com/ask/public/questions/1324/ssis-script-component-split-single-row-to-multiple-rows-parent-child-variation.aspx http://bi-polar23.blogspot.com/2008/06/splitting-delimited-column-in-ssis.html However, I need a little extra help on coding to complete the project. Basically here's what I

问题 Closed . This question needs to be more focused. It is not currently accepting answers. Want to improve this question? Update the question so it focuses on one problem only by editing this post. Closed 5 years ago . I have recently been exposed to some ETL tools such as Talend and Apatar and I was wondering what exactly the purpose/main goal of these tools is in laymans terms. Who primarily uses them and if you use them, how they are (from my understanding) better than just writing some type

问题 I wish to connect SQL server 2012 to SharePoint server. This do complete SQL queries..what is the easy way to do so please? I want to download data from a SharePoint table into SQL server table basically. I can only find tutorials connecting SharePoint to SQL server. I want the other way around Happy to do this via SSIS too.. Please help 回答1: There are three options to read from Sharepoint table: (1) Using ODATA Components You can use ODATA Source component to access to the Sharepoint Lists

问题 Here is the following situation: I have a table of StudentsA which needs to be synchronized with another table, on a different server, StudentsB . It's a one-way sync from A to B. Since the table StudentsA can hold a large number of rows, we have a table called StudentsSync (on the input server) containing the ID of StudentsA which have been modified since the last copy from StudentsA to StudentsB . I made the following SSIS Data Flow task: The only problem is that I need to DELETE the row

问题 Here is the following situation: I have a table of StudentsA which needs to be synchronized with another table, on a different server, StudentsB . It's a one-way sync from A to B. Since the table StudentsA can hold a large number of rows, we have a table called StudentsSync (on the input server) containing the ID of StudentsA which have been modified since the last copy from StudentsA to StudentsB . I made the following SSIS Data Flow task: The only problem is that I need to DELETE the row

问题 I got a package that runs through a folder and it's sub folders to get client data. The agreement has changed and now the client will post his data in different folder name every time. I was wondering if I can do a foreach loop on the main folder and exclude specific folders like archive . I don't have knowledge in writing scripts so I was wondering if SSIS can do that without the script. 回答1: Using Execute Script Task Get List of - filtered - files using an Execute Script Task before

问题 The Problem i'm trying to import data into a table using SQL Server Management Studio's Import Data task. It only brings in 26 rows, out of the original 49,325. ( Edit : That's where 99.9% comes from: (1-26/49325)*100 = 99.9% Using DTS in Enterprise Manager correctly brings all 49,325 rows. Why is SSMS not importing all rows, reporting that it transferred 49,325 successfully, and experienced no errors? Why is Enterprise Manager able to correctly import all 49,325 rows? Microsoft SQL Server

问题 In SSIS, I try to load data from a flat file. The flat file have fixed width columns, but some column are not present in a row (a column can have a CRLF, which must be a new line) like this a b c the first rowok<CRLF> iu jjrjdd<CRLF> this is a newline<CRLF> How I can have exactly the same number of line and exact data in my output? I setup a flat file connection, of ragged right type. In this sample, row 1 is correctly retrieve, but for row 2, it didn't recognize CRLF, and put in b column all

问题 I am using SQL Server 2016. I have a stored procedure GET_RECORDS that takes input parameters for filter and outputs a CURSOR parameter I want to get this cursor in my SSIS package I had created data flow task, OleDb source and variables for parameter values. Then mapped parameters Params mapping screen but when I wanted to save the component - I got an error error screen I tried to add clause WITH RESULT SETS with some dummy columns, but my procedure doesn't return any result set What am I