Home > SQL Server Tips > Data Warehousing and Business Intelligence > Handle slowly changing dimensions with SSIS 2005 wizard
SQL Server Tips:
EMAIL THIS
 TIPS & NEWSLETTERS TOPICS 

DATA WAREHOUSING AND BUSINESS INTELLIGENCE

Handle slowly changing dimensions with SSIS 2005 wizard


Baya Pavliashvili
10.04.2007
Rating: -4.00- (out of 5)


Expert advice on database administration
Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us    Add to Google


In previous versions of SQL Server, you had to manage the process of implementing slowly changing dimensions through custom logic, often embedded in Data Transformation Services (DTS) packages. Within a DTS package, you had to manually compare each relevant column's value between the dimension table and the corresponding data source. If any differences were detected, you'd have to decide whether you wanted to create another row or overwrite the existing row to manage slowly changing dimensions (SCD). SQL Server 2005 Integration Services has a transformation that makes implementing SCD a matter of running a wizard.

Slowly changing dimensions are a part of almost every data warehouse. Rarely does one see dimensions whose member values remain constant. For example, customer dimension attributes such as last name, occupation, home address and others are likely to change from time to time. Some changes are relatively minor. For example, if the department name changes from "marketing" to "marketing and sales," you probably won't need to track the history of changes. However, the adjustments history of customers' income level or income-to-debt ratio can be very significant for financial organizations that sell consumer loans. In such cases, data ware


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us    Add to Google


RELATED CONTENT
SQL Server Business Intelligence (BI) and Data Warehousing
Ensuring high availability of SSAS databases
Building a data warehousing and BI solution
An overview of SQL Server Report Builder 2.0
An introduction to SQL Server data warehousing concepts
Sharing SSAS cube data in SharePoint with PerformancePoint Server 2007
Microsoft SQL Server Integration Services primer
A short history of SQL Server Integration Services
SQL Server Reporting Services Fast Guide
New data profiling tools in SQL Server 2008
Utilize SSAS for data predictions and classification using Excel

SQL Server Interoperability
Utilize SSAS for data predictions and classification using Excel
How to create a SQL Server linked server to DB2
Export SQL Server data to an Excel file using SSIS and Visual Studio
Performance tuning for SQL Server 2005 and Exchange running on SBS
Custom VB.Net scripting in SQL Server Integration Services
Can SQL Server 2000 work on Windows 2003 platform?
Query to search text in old DTS packages in SQL Server?
Run DTS packages within SQL Server Integration Services
SQL Server Integration Services how-to
Compatibility of SQL Server 2005 and 2000 coexisting

Microsoft SQL Server 2005 (Yukon)
SQL Server Reporting Services Fast Guide
SQL Server Service Broker Tutorial and Reference Guide
Tips for tuning SQL Server 2005 to improve reporting performance
SQL Server consolidation: Why it's an optimization technique
Parent-child dimensions in SQL Server 2005 with Analysis Services MDX
Enforcing data integrity in a SQL Server database
SSIS error message due to installation problem on SQL Server 2005
Should you upgrade to SQL Server 2005 or SQL Server 2008?
Basics for working with DATETIME and SMALLDATETIME in SQL Server 2005
How to configure Database Mail in SQL Server 2005 to send mail
Microsoft SQL Server 2005 (Yukon) Research

RELATED GLOSSARY TERMS
Terms from Whatis.com − the technology online dictionary
data aggregation  (SearchSQLServer.com)
data preprocessing  (SearchSQLServer.com)
data warehouse  (SearchSQLServer.com)
FileMaker  (SearchSQLServer.com)
GIS  (SearchSQLServer.com)
MOLAP  (SearchSQLServer.com)
pivot table  (SearchSQLServer.com)
Quiz: SQL Server 2000  (SearchSQLServer.com)
SQL  (SearchSQLServer.com)
T-SQL  (SearchSQLServer.com)

RELATED RESOURCES
2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems
Search Bitpipe.com for the latest white papers and business webcasts
Whatis.com, the online computer dictionary


house architects must come up with a way of tracking the changes.

There are multiple methods for maintaining changes in dimensions member values, but here are the most commonly used methods:

  • Overwrite the existing dimension member values. This method does not provide a way of tracking the history of changes. This method is commonly referred to as "type 1 SCD."
  • Create a new row with the current dimension members. Tag the existing row as expired. This method is commonly referred to as "type 2 SCD."
  • Here's how the Slowly Changing Dimensions Wizard works in SSIS and what it can do for a data warehouse architect:

    [TABLE]

    Changes in AccountDescription column, on the other hand, do not create a new row – they simply overwrite the existing value:

    [TABLE]

    As I mentioned at the beginning of this tip, there are other methods for maintaining slowly changing dimensions in your data warehouse that are not available through the wizard. However, the ability to implement type 1 and type 2 slowly changing dimensions by virtue of a few clicks within SSIS certainly could speed up ETL development.


    [TABLE]


    Rate this Tip
    To rate tips, you must be a member of SearchSQLServer.com.
    Register now to start rating these tips. Log in if you are already a member.




    DISCLAIMER: Our Tips Exchange is a forum for you to share technical advice and expertise with your peers and to learn from other enterprise IT professionals. TechTarget provides the infrastructure to facilitate this sharing of information. However, we cannot guarantee the accuracy or validity of the material submitted. You agree that your use of the Ask The Expert services and your reliance on any questions, answers, information or other materials received through this Web site is at your own risk.



    SQL Server Development - .NET, C#, T-SQL, Visual Basic
    HomeNewsTopicsITKnowledge ExchangeTipsAsk the ExpertsMultimediaWhite PapersIT Downloads
    About Us  |  Contact Us  |  For Advertisers  |  For Business Partners  |  Site Index  |  RSS
    SEARCH 
    TechTarget provides technology professionals with the information they need to perform their jobs - from developing strategy, to making cost-effective purchase decisions and managing their organizations' technology projects - with its network of technology-specific websites, events and online magazines.

    TechTarget Corporate Web Site  |  Media Kits  |  Site Map




    All Rights Reserved, Copyright 2005 - 2009, TechTarget | Read our Privacy Policy
      TechTarget - The IT Media ROI Experts