Home > Ask the Oracle Database / Applications Experts > Data Warehousing, ETL, and business intelligence Questions & Answers > Recording the audit information of data loads
Ask The Oracle Expert: Questions & Answers
EMAIL THIS

Recording the audit information of data loads

Ian Abramson EXPERT RESPONSE FROM: Ian Abramson

Pose a Question
Other Oracle Categories
Meet all Oracle Experts
Become an Expert for this site


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   


>
QUESTION POSED ON: 17 March 2003
I am on a data warehousing project and want to record the audit information of data loads. We are using Oracle, Datastage and BusinessObjects. How do I record this audit information as I don't know of any feature with ETL tool (Datastage) that will give me count of records extracted from the source and count of records loaded into the target data warehouse. Is there a work-around that can be built using Datastage or maybe outside of the ETL tool?

>

Your options for recording the audit information of loads can be done in numerous ways. Your decision will depend upon the granularity that you wish capture and where you wish to place the information. Your options depend if you wish to capture row level errors or simply load data. As well you must consider if you wish to put your data in a flat file or within the database.

Based on your configuration you have told me about in your question, it is my understanding that you want simply to store the results of the loads. Since you are using DataStage as your ETL tool, you can simply use an aggregator stage to create a count of the records that have passed through to the end of your DataStage job. You can then populate data into a table that will hold the date of the load, the job name or table loaded and then the row count. I think that should provide you with the audit results that you are looking for.

For More Information


Digg This!    StumbleUpon Toolbar StumbleUpon    Bookmark with Delicious Del.icio.us   



RELATED CONTENT
Data Warehousing, ETL, and business intelligence
Analyzing an index after rebuild
Speed of low-cost query
Data warehouse based on operational data model
Method other than DB link for large data transfer
Data migration with ETL
Basic steps for implementing a DBMS
Importing 8i dump file to 9i
Using export/import process to clone to data warehouse
Areas of impact while migrating database from 8i to 9i/10g
External tables explained

Oracle data warehousing
Oracle data warehousing tutorial
Oracle's supply chain BI the answer for SaaS provider
Oracle business intelligence guide
BI strategies of Oracle and the megavendors
Exadata: A first look at Oracle's entry into the appliance market
Oracle New Year's resolutions, part 2: GRC tips and customer resolutions revealed
Oracle's Top 8 stories of 2008
IOUG chief discusses OpenWorld, DBA pay and security
Oracle enters the appliance market with Exadata
Tip: Exposing logical attributes with virtual columns

RELATED GLOSSARY TERMS
Terms from Whatis.com − the technology online dictionary
multidimensional database  (SearchOracle.com)
operational data store  (SearchOracle.com)
repository  (SearchOracle.com)

RELATED RESOURCES
2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems
Search Bitpipe.com for the latest white papers and business webcasts
Whatis.com, the online computer dictionary



Search and Browse the Expert Answer Center
Search and browse more than 25,000 question and answer pairs from more than 250 TechTarget industry experts.
Browse our Expert Advice



Oracle White Papers: Fusion Middleware
HomeNewsTopicsTipsAsk the ExpertsMultimediaWhite PapersProductsBlogs
About Us  |  Contact Us  |  For Advertisers  |  For Business Partners  |  Site Index  |  RSS
SEARCH 
TechTarget provides technology professionals with the information they need to perform their jobs - from developing strategy, to making cost-effective purchase decisions and managing their organizations' technology projects - with its network of technology-specific websites, events and online magazines.

TechTarget Corporate Web Site  |  Media Kits  |  Site Map




All Rights Reserved, Copyright 2003 - 2009, TechTarget | Read our Privacy Policy
  TechTarget - The IT Media ROI Experts