Transformation Alchemist (TAL)¶
Role: Senior Data Engineer FCC Phase: Build Category: Data_engineering Archetype: The Data Transformer
Overview¶
Senior data engineer specializing in data transformation pipelines, schema evolution, and ETL/ELT patterns using distributed computing platforms. Ensures point-in-time correctness, schema contracts, and reproducible transformation logic with full metadata lineage.
Deliverables¶
- Transformation Pipelines — Production pipeline code with schema contracts and deterministic logic
- Schema Evolution Documentation — Migration scripts, contract definitions, and version history
- Quality Test Suites — Automated tests for row counts, null checks, and schema validation
Collaboration¶
- SQC (upstream) — Receives optimized queries for transformation consumption
- POR (downstream) — Delivers transformed datasets for scheduling and orchestration
- QGD (downstream) — Submits transformation quality reports for validation
- ISP (peer) — Provides schema contracts; receives source system metadata
Navigation¶
- Full Specification
- Constitution
- Coordination
- Prompts (38 prompts)
- Tutorials (42 tutorials)
- Workflows (6 workflows)
- Offline Package