ssis

SSIS sending source Oledb data to S3 Buckets in parquet File

拟墨画扇 提交于 2020-04-18 06:32:27
问题 My source is SQL Server and I am using SSIS to export data to S3 Buckets, but now my requirement is to send files as parquet File formate. Can you guys give some clues on how to achieve this? Thanks, Ven 回答1: For folks stumbling on this answer, Apache Parquet is a project that specifies a columnar file format employed by Hadoop and other Apache projects. Unless you find a custom component or write some .NET code to do it, you're not going to be able to export data from SQL Server to a Parquet

Using Proxy to give SQL Server Agent windows credential to access to azure db not working

旧巷老猫 提交于 2020-04-18 00:49:35
问题 I have a client using Azure database to store their data. I have developed SSIS packages to do the ETL and deployed the project to a local machine. The packages ran perfectly if I right click on a package and hit execute. The project connection manager I used for loading the data to Azure database is an ADO.NET connection manager. The Authentication Mode is "Active Directory Integrated Authentication". When I run these packages using SQL Server Agent it throws connection error shown below:

Using Proxy to give SQL Server Agent windows credential to access to azure db not working

六月ゝ 毕业季﹏ 提交于 2020-04-18 00:49:30
问题 I have a client using Azure database to store their data. I have developed SSIS packages to do the ETL and deployed the project to a local machine. The packages ran perfectly if I right click on a package and hit execute. The project connection manager I used for loading the data to Azure database is an ADO.NET connection manager. The Authentication Mode is "Active Directory Integrated Authentication". When I run these packages using SQL Server Agent it throws connection error shown below:

Microsoft Office 12.0 Access Database Engine Oledb provider in SSIS

自古美人都是妖i 提交于 2020-04-15 17:12:28
问题 I am not able to see Microsoft Office 12.0 Access Database Engine Oledb provider in SSIS and I'm using MS Office 2013. How to re-solve this? 回答1: You are missing the Microsoft Access Database Engine 2010. Download it here: https://www.microsoft.com/en-US/download/details.aspx?id=13255 Install it on your dev-client and on your servers. After the installation has completed, you should see the Microsoft Office 12.0 Access Database Engine OLEDB provider in your Visual Studio's connection wizard.

Microsoft Office 12.0 Access Database Engine Oledb provider in SSIS

ぃ、小莉子 提交于 2020-04-15 17:12:16
问题 I am not able to see Microsoft Office 12.0 Access Database Engine Oledb provider in SSIS and I'm using MS Office 2013. How to re-solve this? 回答1: You are missing the Microsoft Access Database Engine 2010. Download it here: https://www.microsoft.com/en-US/download/details.aspx?id=13255 Install it on your dev-client and on your servers. After the installation has completed, you should see the Microsoft Office 12.0 Access Database Engine OLEDB provider in your Visual Studio's connection wizard.

How to return T-SQL query with column names as first row

一世执手 提交于 2020-04-13 07:32:20
问题 I'm writing a SSIS package to output data from a SQL Server 2012 database to a .CSV file for a client. The requirement is that the first row be the column names. Below is the query I've written for the Source in the Data Flow Task. The problem is, it always returns the column names as the LAST row, not the first. Why? How do I achieve this? DECLARE @Today AS DateTime= GETDATE() DECLARE @NextPayrollDate AS DateTime EXEC mobile.getNextPayrollDate @Today, @NextPayrollDate OUTPUT ;WITH

Executing SSIS Package with SQL Authentication

被刻印的时光 ゝ 提交于 2020-04-07 04:18:52
问题 I have a SSIS package that talks to a remote server over HTTP. I execute the SSIS package using a stored procedure in my database (SQL Server 2012), which is called from a web server. The web server connects to the database using Windows Authentication. I now have a need to run the stored procedure (and therefore, the SSIS package) from a client which does not support Windows Authentication. The SSIS package is complicated enough that migrating to a different solution is not feasible. The

Deserialize Json Web API Response - Nested objects

为君一笑 提交于 2020-03-20 06:29:33
问题 I am getting a Web API JSON Response via SSIS Script component, that is coming back in the following format: { "Success": true, "Response": { "Applications": [ { "App_ID": 1638486, "App_Ref": "Test Example", "Status": "Complete", "Error_Code": null, "Error_Message": null, "Create_Dt": "2014-05-14 03:09:01.030 +00:00", "Modify_Dt": "2014-05-14 03:10:59.757 +00:00", "Client_Name": "Silver Chef", "Client_Code": "SLVC01", "Centrelink_Status": "Receiving_Logons" }, { "App_ID": 1637906, "App_Ref":

Deserialize Json Web API Response - Nested objects

删除回忆录丶 提交于 2020-03-20 06:28:23
问题 I am getting a Web API JSON Response via SSIS Script component, that is coming back in the following format: { "Success": true, "Response": { "Applications": [ { "App_ID": 1638486, "App_Ref": "Test Example", "Status": "Complete", "Error_Code": null, "Error_Message": null, "Create_Dt": "2014-05-14 03:09:01.030 +00:00", "Modify_Dt": "2014-05-14 03:10:59.757 +00:00", "Client_Name": "Silver Chef", "Client_Code": "SLVC01", "Centrelink_Status": "Receiving_Logons" }, { "App_ID": 1637906, "App_Ref":

Azure Data Factories vs SSIS

妖精的绣舞 提交于 2020-03-18 05:26:33
问题 I am thinking of moving our SSIS ETLs to Azure Data Factory. My arguments in favour of such leap are: Our sources and targets are already in the cloud. ADF is cloud native so it seems at good fit. ADF is a service are therefore we could consume and pay for it on demand. SSIS implies licensing costs, and doesn't lend lend it itself naturally for on-demand consumption (we thought of using DevOps to spin ETL servers on an ad-hoc basis) Generating ETL code programmatically with SSIS requires very