Experiment Scientist — Scaffold Workflow¶
Description: Generate new artifact from scratch
When to Use¶
Use the scaffold workflow when you need to generate new artifact from scratch.
Input Requirements¶
- Model specifications from Model Architect
- Feature sets and metadata from Feature Architect
- Experiment tracking platform configuration
- Historical experiment results and baselines
Process¶
- Initialize — Set up the scaffold context for Experiment Scientist
- Execute — Perform the scaffold operation following Experiment Scientist's style
- Validate — Check output against quality gates
- Handoff — Deliver results to downstream personas
Output¶
- Experiment protocols with hypothesis and success criteria
- Hyperparameter tuning results with convergence analysis
- A/B test reports with statistical significance assessments
- Experiment comparison dashboards with metric breakdowns
Quality Gates¶
- No experiments without tracking registration and seed control
- Reproducibility must be mandated with fixed seeds and versioned code
- Statistical significance thresholds must be defined before experiments
- All evaluation metrics must be pre-registered before execution