ETL for the Data Warehouse: a Template-Driven approach

Extract, transformation, and load process development (ETL) typically accounts for more than half of the work on a Data Warehouse project. Although complex and challenging a rigorous ETL process ensures data quality and currency thus ensuring Data Warehouse credibility and usefulness. The good news is that using a standardized approach along with proven techniques and templates can exponentially lessen the amount of effort required and can ensure data quality, scalability and performance. This class gives a broad overview of ETL processing for the Data Warehouse and delves into the in-depth issues and considerations involved. The class looks at the increasing need for Real-Time data feeds to the Warehouse and discusses the various methods to meet these needs. It specifically presents and teaches a Template-Driven approach which quickens development speed and provides completeness. These templates are demonstrated with working Informatica/Oracle code, but can and have been adapted for other ETL tools and database platforms. They are also applicable for hand-coded efforts. CD's containing the code will be distributed to all class attendees. Benefits of attending: • Gain a thorough understanding of the critical ETL development issues • Understand current main-stream ETL architectural approaches • Learn in-depth techniques for addressing common development issues including how to develop near Real-Time data feeds • Be introduced to using standardized maintenance templates and learn how to apply them to your particular environment • Take back working code to jump start your ETL development efforts MICHAEL SCHMITZ He specializes in high performance Data Warehousing solutions. He has in-depth experience utilizing efficient, scalable techniques whether dealing with large-scale Data Warehouses or small-scale, platform constrained Data Mart implementations. After establishing a career in database management systems and working for Software AG and IBM he began specializing in Data Warehousing in 1987 with Teradata. He subsequently worked for Red Brick and Informix and served as Director of Data Warehousing for Oracles’ Mid-Market Solutions Group. After establishing a successful independent consultancy he worked Knightsbridge Solutions and HP’s Information Management practice. He is most recently acted as the Lead DW/BI Architect for Nike building a new Enterprise Data Warehouse based on Informatica and Teradata. He is currently the principal and owner of Database Performance LLC. His experience with different systems, architectures, and methodologies has enabled him to evolve a unique approach to Data Warehousing utilizing best of breed components and methods. He has written several articles on his approach and has co-authored one book. He actively works on Data Warehouse implementations and teaches design and implementation classes internationally.