etl

问题 I have a few SSIS packages that were password-protected (their protection level is apparently EncryptAllWithPassword) by a developer who left the company and can't be reached anymore, and trying to open them gives the following error since the password can't be supplied: Error loading 'Package.dtsx' : Failed to remove package protection with error 0xC0014037 "The package is encrypted with a password. The password was not specified, or is not correct.". This occurs in the CPackage::LoadFromXML

问题 I am trying to programmatically create an SSIS package containing a simple data flow from table A to table B in the same database. I am using the example given here. The package gets created and saved to a dtsx file, but when I open it in visual studio I see that the source and destination tables have not been selected. I also want to insert a transformation task in between before it reaches the destination. EDIT Well I have managed to get the source and destination tables selected and the

问题 I wondered if anyone has encountered a similar challenge: I have a database with some data that was ETL'ed (imported and transformed) in there from an Excel file. In my ASP.NET MVC web application I'm using Code First approach and dropping/creating every time database changes: #if DEBUG Database.SetInitializer(new DropCreateDatabaseIfModelChanges<MyDataContext>()); #endif However, since the data in the Database is lost, I have to ETL it again, which is annoying. Since, the DB will be dropped

问题 I am running Visual Studio 2010 Ultimate -- which integrates with TFS source control. However, when I run SQL Server 2008 Business Inteligence Studio, no source control is offered. When I look under Tools... Options... Source Control... there are no plug-ins available. Is this because BI Studio uses the 2008 Visual Studio Shell and I only have VS 2010? TIA. 回答1: I think you need to do the following: Install Visual Studio Team Explorer 2008 Install Visual Studio 2008 SP1 Install Visual Studio

问题 Background: I have a PostgreSQL (v8.3) database that is heavily optimized for OLTP. I need to extract data from it on a semi real-time basis (some-one is bound to ask what semi real-time means and the answer is as frequently as I reasonably can but I will be pragmatic, as a benchmark lets say we are hoping for every 15min) and feed it into a data-warehouse. How much data? At peak times we are talking approx 80-100k rows per min hitting the OLTP side, off-peak this will drop significantly to

问题 I have problems with SSIS process(acctually the same problem occurs for two different processes). So, we are doing some ETL work using SSIS. We have Business Intelligence project that executes without errors from Visual Studio. However when its deployed on the server and scheduled as a job it fails with errors like: INTRASTAT_Towar:Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component "Union All 3" (876) failed with error code 0xC0047020 while processing input

问题 I am trying to zip a Folder in SSIS, there are 12 files in the source folder and I need to zipthat folder. I can get the files to zip fine my problem is the folders. I have to use winzip to create the zipped packages. Can anyone point me to a good tutorial. I haven't been able to implement any of the samples that I have found. Thanks 回答1: Adding a Script Task, yuo can use the ZipFile (class) here reference, you must refer to the System.IO.Compression.FileSystem assembly in the project (.NET

问题 How can I cause an SSIS 2017 package to fail if a column in the source table does not have a corresponding column in the destination table, or at least a deliberate decision to not include it? I made a table in both called test with one column, testcol. SSIS transfers the data. Now I added a testcol2 to the source, but not to the destination. The job still runs fine the way it's handled today, but I want that to fail and report an unmapped column error. 回答1: Update 1 After doing more research

问题 I'm working on providing a method to allow for bulk updating our tables ( greater than 1M new or updated rows per update) and was interested in dropping the current indexes and recreating them after the updates. I was wondering if anyone has a script to provide loose coupling of these operations so that if the indexes change over time, the update process does not change. It seems like this is one of those things that the community has already probably solved. 回答1: I have script that I use to

问题 I have read a few articles about moving data out of SAP BW and into SQL Server. I cant find any articles on moving the data from SQL Server to SAP BW, is it even possible and if so what would be the best way to handle this? 回答1: After searching on this topic, i found many link addressing this issue, in this answer i will try to summarize them all and to provide all links that can help you achieving your goal. There are many way to import data from SQL Server into SAP BW: (1) SAP BW DB Connect