Engine-based vs. code-generating ETL tools

Digg This!     StumbleUpon     Del.icio.us

RELATED CONTENT Data Warehousing, ETL, and business intelligence Analyzing an index after rebuild Speed of low-cost query Data warehouse based on operational data model Method other than DB link for large data transfer Data migration with ETL Basic steps for implementing a DBMS Importing 8i dump file to 9i Using export/import process to clone to data warehouse Areas of impact while migrating database from 8i to 9i/10g External tables explained Oracle data and application integration Users caution to look before you leap with Oracle Fusion Applications Oracle CRM On Demand data integration raises big issues Q&A: Oracle's Lenley Hensarling on integrating Value Chain apps with EnterpriseOne Oracle brings Fusion Middleware into the modern age Risk analysis software now part of Oracle Agile PLM software portfolio SearchOracle.com podcasts Special Report: Collaborate '09 Oracle and Java: Some think advisory board would comfort users Oracle New Year's resolutions, part 1: Advice for navigating 2009 Oracle to acquire application service management firm

RELATED RESOURCES 2020software.com, trial software downloads for accounting software, ERP software, CRM software and business software systems Search Bitpipe.com for the latest white papers and business webcasts Whatis.com, the online computer dictionary

In today's ETL environment there are two different approach that vendors have given to the ETL community. There are engine-based and code-generator solutions. Each has its advantages and drawbacks as you have stated.

I actaully find it interesting that you state that Oracle Warehouse Builder is a code-generator type of ETL product. I personally see OWB as a engine-based product, since it uses the Oracle database as its engine. A true code-generator type of ETL product differs in that it produces type programs that need to be compiled and are not in a proprietary language. Generally code-generaters will produce ETL programs in languages like COBOL or C. It generally creates very generic program that requires significant work to make efficient. In the case of engine-based products here we have a generally proprietary solution. These products each have their unique data engines that are tuned for performance. They also have a language that allows you to extend the functionality of the product.

So what is the bottom line in this case? You have to choose a product that works for your individual environment and organization. Engine-based products can provide solid performance. Code-generators also provide solid performance, but you will have to have to do more customization with the programs. If your organization does not have enough expertise in these 3rd-Gl languages you may want to choose an engine-based product, which usually have a shorter learning curve.

For More Information

• What do you think about this answer? E-mail us at editor@searchDatabase.com with your feedback.
• The Best Data Warehousing and Business Intelligence Web Links: tips, tutorials, scripts, and more.
• Have an DW tip to offer your fellow administrators and developers? The best tips submitted will receive a cool prize. Submit your tip today!
• Ask your technical data warehousing questions -- or help out your peers by answering them -- in our live discussion forums.
• Ask the Experts yourself: Our SQL, database design, Oracle, SQL Server, DB2, metadata, object-oriented and data warehousing gurus are waiting to answer your toughest questions.