etl

Autofit Column Width using SSIS ETL on Visual Studio

三世轮回 提交于 2019-12-24 06:38:00
问题 I´m creating an ETL on visual studio, but when I export my data to a table on Excel, the columns seem a bit short. Is there a way to autofit the column width from visual studio? Thank you Update 1 Here is the code as I copied it and also the error I get 回答1: You can achieve this using a script task that execute after the DataFlow Task success. You have to add Microsoft.Office.Interop.Excel assembly to the script task references and use the following code: (used Vb.Net) Note: you have to add

how to assign a constant value to a column in oledb destination in ssis

你。 提交于 2019-12-24 05:13:39
问题 i have a OLE DB destination which has a destination columns such as TrackDateTime , OperationTypeID, and TrxID .Here TrxID i will get a value from input column. But my requirements here is to get the values for TrackDateTime , OperationTypeID : Here TrackDateTime must be current date and time and OperationTypeID must be 2 always. How can I achieve this? 回答1: You can use a derived column transformation to generate fixed values: TrackDateTime GETDATE() or if you need the package execution date

OrientDB ETL Throws exception on loading CSV file

泪湿孤枕 提交于 2019-12-24 04:51:56
问题 I am trying to load a simple CSV file to OrientDB and it always throws this exception. CSV File Content id, name, role 1, Sarath, Architect 2, Anoop, Project Manager 3, Nazeem, Lead Developer 4, Rini, Senior Developer 5, Shine, iOS Developer 6, Vishnu, iOS Developer json config file { "source": { "file": { "path": "./dev.csv" } }, "extractor": { "row": {} }, "transformers": [ { "csv": {} }, { "vertex": { "class": "Person" } } ], "loader": { "orientdb": { "dbURL": "remote:localhost/dev",

Error while extracting data from Sybase using OLE DB in SSIS

怎甘沉沦 提交于 2019-12-24 04:44:08
问题 I am having problems extracting data from Sybase using Advantage 11 OLE DB Provider in SSIS (2017). I can connect to the database, see the list of tables, and, when selecting a table as a data source I can see the columns. However, when I click Preview (or run the data flow task), I get this error: The provider cannot derive parameter information from the command. Use SetParameterInfo. (Advantage OLE DB Provider) I am using no parameters, my Data Access mode is set to Table or View (see

SQL script to SSIS expression

≡放荡痞女 提交于 2019-12-24 04:32:26
问题 I have the below T-SQL line of query that I'm trying to translate into Visual studio SSIS expression into derived column task. So tableA has just [Work item /Submission no#] column, but I need to split them into two column like SubmissionCommon and SubmissionNumber in TableB when below case is executed. CASE WHEN ISNUMERIC(SUBSTRING([Work item /Submission no#], 4, 2)) = 1 THEN LEFT([Work item /Submission no#], 15) ELSE LEFT([Work item /Submission no#], 16) END AS SubmissionCommon, [Work item

Can SSIS support loading of files with varying column lengths in each row?

落爺英雄遲暮 提交于 2019-12-24 02:15:57
问题 Currently I receive a daily file of around 750k rows and each row has a 3 character identifier at the start. For each identifier, the number of columns can change but are specific to the identifier (e.g. SRH will always have 6 columns, AAA will always have 10 and so on). I would like to be able to automate this file into an SQL table through SSIS. This solution is currently built in MSACCESS using VBA just looping through recordsets using a CASE statement, it then writes a record to the

After reinstall SYBASE oledb provider it does not appear in SSIS connection manager

走远了吗. 提交于 2019-12-24 01:17:17
问题 I have reinstalled Sybase Adaptive Server Enterprise PC Client 12.5.4. After that it's completely disappeared from SSIS connection manager. How can I fix it? 回答1: Use ADO.Net not OLEDB When you need to connect to Sybase you have to add an ADO.Net connection not OLEDB: Official documentations In the following official documentation they mentioned that: Adaptive Server ADO.NET Data Provider can be integrated into SQL Server Integration Services (SSIS), allowing for native access to ADO.NET Data

RedShift - CSV load with line Break

半城伤御伤魂 提交于 2019-12-24 01:13:39
问题 Im trying to load a CSV file while loading I got the error Delimited value missing end quote CSV file Error line REDSHIFT ERROR: line_number | 13 colname | Comment col_length | 250 raw_line |"123"|"123"|"xyz"|"2009-06-25 21:00:14.660000000"|"0"|""|""|""|""|""|"HI, raw_field_value | HI, err_code | 1214 err_reason | Delimited value missing end quote 回答1: You'll need to escape the newline characters in the source data and then specify the ESCAPE option in your COPY statement. Please have a look

ssis generate json file remove return

天大地大妈咪最大 提交于 2019-12-24 01:09:20
问题 I am using a script task to generate a json file from a sql query. The c# code in the script task: public void Main() { // TODO: Add your code here ConnectionManager cm; string sqlString = ""; System.IO.StreamWriter file = new System.IO.StreamWriter(@"f:\JSONOutput.txt"); sqlString = "SELECT * FROM[dbo].[JJVCACUProductElectron] where id in (1,2,3) for json auto"; System.Data.SqlClient.SqlConnection sqlConn; System.Data.SqlClient.SqlCommand sqlComm; cm = Dts.Connections["crm_vm_2017_cs_dotnet"

SQL Server 2008: Disable index on one particular table partition

↘锁芯ラ 提交于 2019-12-24 01:05:33
问题 I am working with a big table (~100.000.000 rows) in SQL Server 2008. Frequently, I need to add and remove batches of ~30.000.000 rows to and from this table. Currently, before loading a large batch into the table, I disable indexes, I insert the data, then I rebuild the index. I have measured this to be the fastest approach. Since recently, I am considering implementing table partitioning on this table to increase speed. I will partition the table according to my batches. My question, will