|
|
|
|
|
|
by karlmdavis
5260 days ago
|
|
|
Simple ETL jobs are mostly just E & L: extract the data from one system, load it into another. Where things get complex is in the Transform aspect of some jobs. Mapping disparate schemas is complex, often messy work. Especially when one (or both) sides of the ETL job have poor/no primary keys, foreign keys, or even are just "mostly standard" CSV files [shudder]. Also: some ETL jobs can get quite large. I know one guy who had to create an ETL system that continuously moved data from one 1200-table system into some other system. Crazy. |
|
|