etl

ASP.NET Automated & Manual ETL Process

大城市里の小女人 提交于 2020-01-06 09:08:22
问题 Here's an interesting problem. I have an ETL script written in c# that I have been running manually on a somewhat regular basis. It is used to update my web app's database. I want to automate the ETL process AND create an interface for the web app admins to manually start the ETL process. I could have sql server kick off the ETL process on a schedule and implement a button or something on a web page that will do the same thing, but I don't want to put my code in 2 different places because I

ASP.NET Automated & Manual ETL Process

拟墨画扇 提交于 2020-01-06 09:03:44
问题 Here's an interesting problem. I have an ETL script written in c# that I have been running manually on a somewhat regular basis. It is used to update my web app's database. I want to automate the ETL process AND create an interface for the web app admins to manually start the ETL process. I could have sql server kick off the ETL process on a schedule and implement a button or something on a web page that will do the same thing, but I don't want to put my code in 2 different places because I

What are the options for extracting data out of Hyperion 7.3 with SSIS?

Deadly 提交于 2020-01-06 07:58:08
问题 We need to get data out of some Hyperion cubes (databases) using SSIS. Are there any connection managers available for this? Has anyone done this? 回答1: There are some third party connectors out there. Don't think any exist from oracle or microsoft. 回答2: I know this is a very old question but I just happened upon it and thought I would offer some perspective. There isn't build in support for getting data from Hyperion with SSIS. There are a few ways to go, however. You can fairly easily export

translate CMD FTP request to PowerShell FTP request

女生的网名这么多〃 提交于 2020-01-06 07:17:33
问题 I have a fully-working FTP request saved to a .CMD file. Here is my CMD script: @echo off setlocal set uname=exUsername set passw=exPassword set hostname=exHostname set filespec=exSpec echo %uname%> test.ftp echo %passw%>> test.ftp echo pwd>> test.ftp echo cd exDir>> test.ftp echo binary>> test.ftp echo get %filespec%>> test.ftp echo bye>> test.ftp ftp -s:test.ftp %hostname% if errorlevel 1 pause endlocal I want to translate the above code to a PowerShell script. Here is my PowerShell script:

SSIS File Filter in For Each File Enumerator

心已入冬 提交于 2020-01-06 06:11:08
问题 I have a For each file Enumerator. Under the folder I have E:\Input Under the Files I have "*" + @[User:Date] + "*.*" The date variable is set to 20180101 . The Variable Mappings are set to User::FileToBeMoved Within the Enumerator I have a File System Move File with the Source being the Variable User::FileToBeMoved and the destination being a variable containing E:\Input\Archive I have files in there like In20180101.txt , Intermediate20180101.txt and Out20180101.txt The files are not being

unable to update the first cell in the excel worksheet using C# code in SSIS

女生的网名这么多〃 提交于 2020-01-06 04:57:26
问题 the following code was used in a execute script task of ssis package based on c# 2017 language used the following code which was taken from this answer Application excelApplication = new Excel.Application { Visible = true, ScreenUpdating = true }; string filename;//= Dts.Variables["User::filename"].Value.ToString(); filename = @"D:\Sundeep\2019\01082019\VersionWithDummyData\finbalReviewTest.xlsx"; _Workbook workbook = excelApplication.Workbooks.Open(filename); _Worksheet sheet = workbook

SSIS Package stays in execution and doesn't finish execution nor gives an error

丶灬走出姿态 提交于 2020-01-06 04:54:27
问题 I have created a package which has multiple data flow tasks. It also includes BEGIN TRANSACTION as an Execute SQL Task When package is called by another package, it doesn't finish execution. However, if it is run by hand, it executes successfully. Here is the screenshot of the package 来源: https://stackoverflow.com/questions/52268610/ssis-package-stays-in-execution-and-doesnt-finish-execution-nor-gives-an-error

SSIS 2005 - How to Import a Fixed Width Flat File?

☆樱花仙子☆ 提交于 2020-01-05 04:33:10
问题 I have a flat file that looks something like this: junk I don't care about \n \n columns names\n val1 val2 val3\n val1 val2 val3\n columns names \n val1 val2 val3\n I only care the lines with values. These value lines are all fixed width format and have the same line length. The other junk lines and column names can have any line width. When I try the flat file fixed width option or the ragged right option the preview looks all wrong. Any ideas what the easiest way to get this into SSIS is?

SSIS: “Error: The result of the expression ”@[User::FileName]…cannot be written to the property"

回眸只為那壹抹淺笑 提交于 2020-01-04 15:28:44
问题 I have been trying for the last 10 hours to solve the following problem: I have a ForEach Loop container that is enumerating Excel file names in my Control Flow. Within the ForEach Loop container I have an Excel Source that imports data into Sql-Server. This connects to a Derived Column transformation using User::FileName as the expression that connects to a OLE DB Command that that maps to the User::FileName to a Report_Date (the Excel file names contain the report date) column in Sql-Server

Foreach Loop Container gives an error after 5 iterations. SSIS

半城伤御伤魂 提交于 2020-01-04 10:19:42
问题 I created SSIS package that iterates through Excel spreadsheets and load data into SQL. Using ForEach Loop Container. For some reason after 5 iterations I got an error. I tried: Set MaximumErrorCount to 0 on Foreach Loop Container ValidateExternaMetadata set to Off on OLE DB Destination Why it iterates 5 times and after that gives me an error?? 回答1: Them main issue is Opening a rowset for "New_Val$A3:C10000" failed. Check that the object exists in the database it is not related to the