I am a IT professional with 20 years of experience. Over the past five years I have developed more and more basic knowledge and understanding of data warehousing (DW). I've been led to understand that the most important function in DW is ETL processing. What do I need to do to get a real job in this field and develop practical experience and actually use what up until now has been basic book knowledge?

    Requires Free Membership to View

Certainly the ETL functions are important and necessary components of an overall healthy DW architecture, but by no means THE MOST important. There is really no real MOST important part. Consider your internal organs for a moment. Is the heart the most important? The Lungs? Brain, circulatory system, digestive system?

The DW architecture needs a solid data architecture, data acquisition strategy, ETL architecture, DBMS, BI architecture, technology infrastructure, network architecture, etc.

However, if you would like to pursue a career as an ETL architect I recommend you gain practical experience with the following:

DW data architecture design principals (Data modeling skills including 3NF, data vault and data mart design)

Strong, strong, strong SQL skills. ETL is about leveraging the DBMS supported SQL and extending those capabilities with the ETL prioritary data manipulation functions. You need to understand SQL to fully appreciate what your ETL code is really doing. (If you've been around for 20 years, odds are you have some mainframe background. Us old COBOL programmers needed to understand the Assembler code that was produced to be good developers and debuggers. Same holds for the ETL tools)

DBMS skills. You don't need to be an Ace DBA, but you need to know your way around the DBMS's your working with (source and target), now how to create, alter, drop tables, apply & drop constraints, know when indexes will improve the performance of your ETL jobs, know when partitioning is warranted, know about database table spaces, and various indexing schemes.

Business analyst skills. I prefer my ETL architects don't code in a vacuum. Always strive to understand the business problem being solved and the information needs of your business sponsors. This will help you produce better processing streams and help you challenge the data models provided to you from your data architect.

There are many public and private training providers out there that can give you a solid foundation of data management and CIF architecture disciplines. Then approach your boss and let him/her know your desires.

Good luck.


This was first published in January 2005

There are Comments. Add yours.

 
TIP: Want to include a code block in your comment? Use <pre> or <code> tags around the desired text. Ex: <code>insert code</code>

REGISTER or login:

Forgot Password?
By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy
Sort by: OldestNewest

Forgot Password?

No problem! Submit your e-mail address below. We'll send you an email containing your password.

Your password has been sent to: