etl

问题 I'm quite confused as to how I'm supposed to be adding dimension members to my data warehouse. Let's say that TOWN_NAME is a dimension table that links town_Id to a town_name. So, now, I have 1000 customer names, and they are from 9 towns. Suddenly, in my next ETL process, a customer ends up being added whose town is not amongst that 9 towns i have in my dimension. So I need to add a member to my dimension table. Which step/process in BIDS or DATA TOOLS (BIDS 2012) would have I to use? How

问题 As it currently stands, this question is not a good fit for our Q&A format. We expect answers to be supported by facts, references, or expertise, but this question will likely solicit debate, arguments, polling, or extended discussion. If you feel that this question can be improved and possibly reopened, visit the help center for guidance. Closed 6 years ago . I am working on a metrics project for my team. I have to load several different reports into a central repository and then create

问题 I'm trying to import a large size of JSON FILE from Amazon S3 into AWS RDS-PostgreSQL using Python. But, these errors occured, Traceback (most recent call last): File "my_code.py", line 67, in file_content = obj['Body'].read().decode('utf-8').splitlines(True) File "/home/user/asd-to-qwe/fgh-to-hjk/env/local/lib/python3.6/site-packages/botocore/response.py", line 76, in read chunk = self._raw_stream.read(amt) File "/home/user/asd-to-qwe/fgh-to-hjk/env/local/lib/python3.6/site-packages/botocore

问题 I am trying to create a temporary table and insert data into the temp table within an Execute SQL Task inside a foreach loop container. Here are the sql tasks IF OBJECT_ID('TEMPDB.DBO.#TEMP') IS NOT NULL DROP TABLE #TEMP GO CREATE TABLE #TEMP ( ... ); INSERT INTO #TEMP SELECT (...) FROM table t1 INNER JOIN table2 t2 ON t1.id = t2.table1_id WHERE t1.value = ? I want to have a parameter in the WHERE clause but whenever I try to add it I get this error. "Multiple-step OLE DB operation generated

问题 I am writing a SSIS package and trying to extract the data from one database to another. I have created a Execute SQL task and using the following statement INSERT INTO dbo.getParties EXEC dbo.getParties to perform the operation. This works when the source and destination our in the same database. How do I handle this when the source and destination are in different databases. You can associate only one connection manager to a task. Do I connect to the source and in the SP call the

问题 I'm trying to declare a Worksheet to handle cells of .xlsx file, but my C# script fails when I declare Worksheet object : Microsoft.Office.Interop.Excel.Application xlApp = new Microsoft.Office.Interop.Excel.Application(); Workbook excelBook = xlApp.Workbooks.Open(fileFullPath); MySheet = (Excel.Worksheet)excelBook.Worksheets[Data_Sheet]; I've tried all of this statements : MySheet workSheet = (Worksheet)excelBook.Application.Sheets[1]; MySheet = (Excel.Worksheet)excelBook.Worksheets[1]; Even

问题 I have a Flat File Source that is reading data from a flat file. We have recently added a new column to this flat file. The flat file data is inserted into a database table. To accommodate the new field in the destination component, I used the ALTER TABLE statement to add the new column to the table. That is the only change I have done. Should the mapping between flat file and destination component automatically change? I do not see the additional column present in the flat file anywhere

问题 I created and executed a dtsx with SSMS corresponding wizard: This was to import a flat file in an existing table. At the end I saved the "package" as a .dtsx file Now I need to modify the column mappings and re-execute this package. Is there any way I can do it, using SQL Server Management Studio? I tried opening the file, but it opens this dialog: Where I cannot edit the mappings any more. Update: I understand that "editing" a dtsx is not a simple thing, yet is there a reason why the wizard

问题 I'm having an issue with SSIS and VS2015 CM. I have a package that needs to connetc with Oracle to get some data. I installed the ODAC for Win64 and the Oracle client but I can't see the Oracle provider for OLE DB listed in the providers list. Although I can see the Microsoft OLE DB provider for Oracle it doesn't work when I try to use that provider either. What should I do to get the Oracle OLE DB provider listed? 回答1: You have to download and install the Oracle Data Access Components (ODAC)

问题 I'm new to SSIS Package. I want to transfer data from source to destination database which has different table structures. My Data Flow is from OLE DB Source to OLE DB Destination I have named OLE DB Source as Patient Source and in OLE DB Source Editor, the connection is made with Source Database and in Data Access Mode I have selected SQL command and SQL command text as follows select ppFName, ppLName, ppPersonalNbr, ppEmailOne from pat_Patients and as well as I have previewed the data, it