etl

问题 Here's my folder setup. Here's the File setup The idea is to traverse through the folders & put FileA contents to Table FileA.dbo on the database ( also FileB,FileC etc). The FileName structure is same throughout all the folders. I have this ssis package where I parse through the folders with a foreachloop-> dataflow. I have checked that the algorithm I've formulated to get the filename is working REVERSE(Substring(Reverse( @[User::FileName] ),5,LEN( @[User::FileName] ))) == "FileA" It parses

问题 I have an SSIS package that creates 2 text files using a data flow component. It connects to an SQL database and if the query returns data, the 2 files are created. After that, a script task loops through the folder where the 2 files are written into, determines the oldest file and moves it to another folder. Everything moves smoothly when I execute the package on the server. No errors and all functions are executed. Perfect. However, when I schedule the SSIS package in a job, the said script

问题 This is a follow-on from a previous question: OData Source Component in SSIS Hanging Setup I'm using SSIS in Visual Studio 2015 (17.4) and would like to pull in the public NADAC data from this page using the OData connection: https://data.medicaid.gov/Drug-Pricing-and-Payment/NADAC-National-Average-Drug-Acquisition-Cost-/a4y5-998d. I've successfully created an OData Source Connection Manager to the base URL: https://data.medicaid.gov/api/odata/v4/ using windows authentication. I've created a

问题 I'm using a foreach loop and file system task to move files into specific folders (or trying to at least). i.e. A file name can be 100000 and it needs to go to folder 1000 File 102000 needs to go to folder 1020 File 103000 need to go to folder 1030 etc etc I'm struggling with how to move the files to the correct folder. I thought I could use a variable with the upper level directory followed by a substring of the filename variable held in the foreach loop e.g. "D:\\Archive\\" + SUBSTRING(@

问题 I have a SSIS package where I have to select some values from an excel sheet and insert them into a SQL Server database table, i am doing it through Execute sql task. These are the steps: Select all records from mapping table, cell location is dynamic so keeping it in sql table (around 3000 cells are there - we have to pick value from selective fields in Excel and not all) Example: Iterate through Foreach on each record Create a query with cell name and Sheet name Example: Select * from

问题 Excel file is not being recognized by SSIS. Error : Could not retrieve table information from connection manager "Excel Connection Manager Failed to connect to the source using the connection manager 'Excel Connection Manager' I have tried installing 32-bit of redistributable which resolved this error but when I run this outside using SQL stored procedure it is failing, which is in turn resolved if i install 64 of redistributable but this is failing in SSIS, Hence, I need 32-bit to run in SP,

问题 I am having difficulty doing a simple use case with Orientdb and teleporter Stack: OS: Windows 10 / Java: v8 / Orientdb: 2.2 beta2 / Teleporter: 1.0.0 / Database: MS SQL Express 2014 Setup: Installed, MS SQL Express 2014 with instance name SQL2014 Created new db Graphdb with two tables, Country w/ PK Country ID and Province w/ PK Province ID and FK Country ID Installed, and start Orient db 2.2 beta 2 Created new oteleporter_graphdb.bat oteleporter.bat -jdriver sqlserver -jurl jdbc:sqlserver:/

问题 I am sorry to post what seems a very simple issue but I cannot find an answer and I am wasting days (not just hours at this point). I am fairly new to SSIS and it is just kicking my backside. Background: Pretty straightforward SSIS Package to import an Excel sheet into a Staging table in SQL Server. Since I do not want to mislead anyone by using the wrong nomenclature, I will refer to the Excel source as Excel and the SQL Server table as the Target Table. This package HAS worked before.

问题 Greetings, I've taken over from a prior team and writing ETL jobs which process csv files. I use a combination of shell scripts and perl on ubuntu. The csv files are huge; they arrive as zipped archives. Unzipped, many are more than 30Gb - yes, that's a G Legacy process is a batch job running on cron that unzips each file entirely, reads and copies the first line of it into a config file, then re-zips the entire file. Some days this takes many many hours of processing time, for no benefit.

问题 I have 3 tables, one is for vertex A, one is for vertex B, and the third is for edges from B to A. How can I import this graph to OrientDB? For now, the tutorial just says how to import two csv files, one is for vertex A, and the other one is for vertex B and connected vertices from A. Load vertex A, then load vertex B and creating edges from A to B in the mean time. This works for simple graphs. But for complicated graphs, for example, I have three types of vertices, A, B and C, three types