Data Transformation: ETL

• Tools or Technologies that process source data and insert/update data in the warehouse based on the business rules defined.

• Example

• • We need to turn our source data into our warehouse data
  • Source System:
  • • ORDER_LINE_ITEM: Quantity, Discount Amount, Actual Price
  • Data Warehouse:
  • • SALES_FACT: REVENUE, DISCOUNT PERCENT, etc.

• Technologies

• • SQL (if it’s in the same database you can use SQL to do this)
  • Perl (original data warehouse toolkit, still in common use)
  • Commercial Tools (Oracle Warehouse Builder, Informatica)
  • Open Source Tools (Kettle, KETL)

• BOTTOM LINE: Get the job done!