Data loading

When moving data from a database to a warehouse, the data transformation phase is followed by the data loading process. This is a seemingly straightforward process, but there are some things to look at before making the move according to Ralph Kimball's book The Data Warehouse Lifecycle Toolkit (Wiley Computer Publishing):

The capabilities you need during the data loading process are, in large part, a function of the target platform. Some of these capabilities are:

1. Support for multiple targets. The atomic data mart may be on one DBMS, and the business process data marts may be on another. Each target will probably have its own syntax and idiosyncrasies, and your load process should know about these differences and use or avoid them as appropr

Digg This!     StumbleUpon     Del.icio.us

RELATED CONTENT Data Warehousing and Business Intelligence Sharing SSAS cube data in SharePoint with PerformancePoint Server 2007 New data profiling tools in SQL Server 2008 Utilize SSAS for data predictions and classification using Excel SQL Server 2008 Integration Services delivers new features Parent-child dimensions in SQL Server 2005 with Analysis Services MDX Change data capture in SQL Server 2008 improves BI reporting accuracy Manage traces in SQL Server 2005 Analysis Services with XMLA commands Tutorial: SQL Server 2005 Analysis Services Open SSIS packages without validation using these SQL properties How to process SQL Server 2005 Analysis Services for data availability

RELATED RESOURCES 2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems Search Bitpipe.com for the latest white papers and business webcasts Whatis.com, the online computer dictionary

iate.

2. Load optimization. Most DBMSs have a bulk loading capability that includes a range of features and can be scripted or invoked by your data staging tool through API. Every database product has a set of techniques and tricks that optimize its load performance. These include steps like avoiding logging during loads and taking advantage of bulk loader capabilities like creating indexes and aggregates during the load.

3. Entire load process support. The loading services also need to support requirements before and after the actual load, like dropping support requirements before and after the actual load, like dropping and re-creating indexes and physical partitioning of tables and indexes.

For More Information