etl

问题 I am running SQL Server 2014 on my machine. I have installed SSDT for Visual Studio 2017, which I also have. Now I am not able to find the SSIS Toolbox in my Visual Studio. Do I need to re-install the SSDT all over again? Please let me know. Thanks in advance. 回答1: If SSDT is installed correctly You can show SSIS toolbox in 3 ways: (1) Visual Studio Menu strip Based on this Microsoft article: If you can't see the toolbox, go to VIEW -> Other Windows -> SSIS Toolbox. (2) From Context Menu

问题 I don't want to use package configurations to pass variables from Parent to child package. I'd prefer to pass the variables to child, from a C# script task in the parent package. Can this be done ? Here is the pseudocode for what I hope to do - //code in script task of parent package Main(){ Object parentObj = SSIS.ParentPackage.myObject; String parentStr = SSIS.ParentPackage.myString; callChildPackage(parentObj, parentStr); } 回答1: This answer is copied from MS forum. Now, google is your

问题 One of the standards from W3C for RDB2RDF is Direct Mapping. I heard that there is a problem when converting many-to-many relationship from a relational database and they say it loses semantic, I need more explanation about it. 回答1: ...there is a problem when converting many-to-many relationship from a relational database I'd say that direct mapping introduces additional "parasitic" semantics, treating normalization artefacts as first-class object. Let's consider the D011-M2MRelations

问题 I have 6-7 identical databases (almost). I want to copy the data from some of the tables of EACH of these servers into the corresponding table of ONE server. That is, multiple sources and one destination server. All the servers have different IPs. How do I do this task ? Would for loop be appropriate for this. If yes, then what would be a good way to do it ? I might perform a bit of Transform. Not sure as of now. To be safe, I want to use SSIS. 回答1: Here is an overview of how you can set up a

问题 After creating a dynamic Excel connection manager with Visual Studio 2015 SSIS and iterating through multiple Excel files in a directory I have run into the problem of not being able to change the number of columns in the connection manager. The Excel files do not have the same number of columns (or heading names/locations). I'm passing the data from the connection manager straight into a script component in order to handle this. I tried creating an Excel connection manager with more columns

问题 It looks like /api/2/project easily returns all projects in a JIRA instance in JSON format. I'd like to do the same for issues, but this does not appear to exist. Is /api/2/search the standard way to do a mass-dump like this? And what is the best way to regularly update this to a database? Would I do something like search (update date > [last entry in database]) and then go through the pagination? Surely I can't be the first person attempting this, though I see no similar guide anywhere

问题 Closed . This question needs to be more focused. It is not currently accepting answers. Want to improve this question? Update the question so it focuses on one problem only by editing this post. Closed 5 years ago . AFAIK, ETL integrates data from a fixed number of sources/tables. Is it possible that ETL can integrate data from an unknown number of tables which might be added in the future, given that these tables might be of different types (customer, shipping, employee, accounting etc.) ?

问题 I am doing comparison between three open source ETL tools Talend, Kettle and CloverETL. I could find with no problem Talend and CloverETL's connector list. But, I cannot find the one for Kettle. Does someone knows them or where can I find them ? Thanks a lot, 回答1: I assume by "connector" you mean input/output nodes and not intermediate transformations. Just looking through the Kettle GUI, I see: Inputs Access CSV De-serialize from file [GH: not sure what kind of file/serialization this means]

问题 Let's say I have two data sources in SSIS. Table A has 10 rows and two of the columns are empty. Table B has 20 rows with two columns each. I want to somehow join them in an ETL process in a specific way: for each row of table A, 20 rows are generated with the values for the two columns from table B. This way 200 rows should be generated with every possible combination of the rows from tables A and B I tried using Merge Join and Union pieces, but they won't work... Any ideas how to fix this?

问题 I've recently installed the latest version of SQL Server (2008 R2 x64) and I'm now trying get my first steps to create an ETL. Is it possible to create an ETL with SQL Server 2008 R2 Express, and if not is there some tool that provides that for free? What I plan to do is collect data from multiple sources like a web services, rss feeds, a parsed url request, a file or maybe other database engine. Transform this collected data for an understandable schema (for my purposes) and store this in my