etl

Time parsing Issue using DateTime.ParseExact()

↘锁芯ラ 提交于 2019-12-02 04:04:28
I have a Time Value stored as string with the format HH:mm I used the following code to parse it as date with Today Date DateTime.ParseExact("09:00","HH:mm",New System.Globalization.CultureInfi("En-GB")) The Result Is 2017-03-15 09:00:00 When Running this Code From another machine i get the following Result: 1899-12-31 09:00:00 I replaced my code to the following DateTime.ParseExact(DateTime.Now.ToString("yyyy-MM-dd") & " 09:00","yyyy-MM-dd HH:mm",New System.Globalization.CultureInfi("En-GB")) And it works Fine, But i still want to Know why every system parsed the date to a different Value???

SSIS Excel/CSV from Sharepoint to SQL Server

依然范特西╮ 提交于 2019-12-02 03:43:11
问题 I need to take Excel/CSV files from Sharepoint and put them into a table on SQL Server. I'd like to like these packages to deploy automatically, so anytime somebody puts in a new excel file in a specific folder/subfolder, it will shoot it into my database. Is there a way to do this without downloading the files locally, and just transferring from share point itself? I already know how to take excel files locally and importing it through SSIS. The idea is to get people who know nothing about

How to pivot data using Informatica when you have variable amount of pivot rows?

折月煮酒 提交于 2019-12-02 03:15:35
Based on my earlier questions , how can I pivot data using Informatica PowerCenter Designer when I have variable amount of Addresses in my data. I would like to Pivot e.g four addresses from my data. This is the structure of the source data file: +---------+--------------+-----------------+ | ADDR_ID | NAME | ADDRESS | +---------+--------------+-----------------+ | 1 | John Smith | JohnsAddress1 | | 1 | John Smith | JohnsAddress2 | | 1 | John Smith | JohnsAddress3 | | 2 | Adrian Smith | AdriansAddress1 | | 2 | Adrian Smith | AdriansAddress2 | | 3 | Ivar Smith | IvarAddress1 | +---------+------

Error: 0x1 at XX: Exception has been thrown by the target of an invocation

我与影子孤独终老i 提交于 2019-12-02 03:00:15
问题 This question was migrated from Super User because it can be answered on Stack Overflow. Migrated 6 months ago . I am trying to copy files from an FTP server to a local drive using C# Task script in SSIS. The script ran well in SQL Studio 2008 R2, but there was a version update to 2016 using SQL SSDT (SQL Server Data Tools) 2015, and when I first executed the script it ran OK, but later threw the following error: Error: 0x1 at 3-Copy and rename EC Files: Exception has been thrown by the

SSIS ERROR: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020

萝らか妹 提交于 2019-12-02 02:57:50
I have problems with SSIS process(acctually the same problem occurs for two different processes). So, we are doing some ETL work using SSIS. We have Business Intelligence project that executes without errors from Visual Studio. However when its deployed on the server and scheduled as a job it fails with errors like: INTRASTAT_Towar:Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component "Union All 3" (876) failed with error code 0xC0047020 while processing input "Union All Input 2" (916). The identified component returned an error from the ProcessInput method. The

Predicting data with Python script in an SSIS package

此生再无相见时 提交于 2019-12-02 02:41:57
I'm aware of Microsoft's inclusion of Python in their Machine Learning Services for SQL server, however this is only available for SQL Server 2017 and up, which is a requirement my servers do not currently meet. With that being the case, I wanted to deploy my generate-predictions-with-trained-model pipeline entirely within SSIS, I.E: Grab data from my DB Pass it to a Python Script Data Flow Task which imports the trained model, generates the predictions and passes them on to the next Data Flow Task Write the predictions to the DB Is there a way to do that entirely within SSIS, or will it be

How to call .dtsx file which has input parameters from a stored procedure?

馋奶兔 提交于 2019-12-02 02:39:15
How to call .dtsx package file which has input parameters from a stored procedure? Stored Procedure # 1 -> Will pass the list of files to be exported to excel as a Comma Separated value in a variable. Input variable will be passed to the SSIS Package to export the data to excel. How to handle the SSIS Package which has Input parameters from a Stored Procedure call? Using DtExec and xp_cmdshell One way to do that is to run DtExec utility from file system using xp_cmdshell utility inside sql server. First you have to enable the xp_cmdshell utility: -- To allow advanced options to be changed.

Workaround for exporting data to Excel with more than 255 columns

耗尽温柔 提交于 2019-12-02 02:34:17
SSMS and SSRS to Excel enable for more than 255 columns when copy-pasting. SSIS does not allow for more than 255 columns to be exported to Excel 2007. Is there a way to override this? Problem There are a lot of Limitations when exporting to an Excel Files using Sql server data tools Workarounds You can do some workaround to achieve this: Create a dataflowtask that export your data into a FlatFile ( csv ) Store your Destination FileName in a Variable Create another Dataflowtask that convert your csv file to an Excel File using a script task with a similar Function Note: you have to add

Importing Excel Data Seems to Randomly Give Null Values

半城伤御伤魂 提交于 2019-12-02 02:26:02
问题 Using SSIS for Visual Studio 2017 for some excel file imports. I've created a package with several loop containers that call to specific packages to handle some files. I have an issue with one particular package being executed in that it seemingly randomly decides the data for columns is NULL per excel file. I was/am under the impression that this is part of the registry setting for TypeGuessRows (changed initially to 0 then to 1000 as a test) located at HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft

SSIS:Issue with data from a csv file:

a 夏天 提交于 2019-12-02 02:13:56
问题 Issue with data from a CSV file: I downloaded some file in CSV with some values like this one: 1.21E+11 , when the values are too long. If I convert to XLS/XLSX and change the field to numeric, that fixes the issue, but I want to do something automatized. 回答1: Try adding a derived column of type DT_R8 and use the following expression: (DT_R8)[InputColumn] As shown in the image below, i tested the following expression: (DT_R8)"1.21E+11" And the result was: 121000000000 来源: https:/