Experiment Scientist — Refactor Workflow

Description: Improve existing artifact structure and quality

When to Use

Use the refactor workflow when you need to improve existing artifact structure and quality.

Input Requirements

• Model specifications from Model Architect
• Feature sets and metadata from Feature Architect
• Experiment tracking platform configuration
• Historical experiment results and baselines

Process

1. Initialize — Set up the refactor context for Experiment Scientist
2. Execute — Perform the refactor operation following Experiment Scientist's style
3. Validate — Check output against quality gates
4. Handoff — Deliver results to downstream personas

Output

• Experiment protocols with hypothesis and success criteria
• Hyperparameter tuning results with convergence analysis
• A/B test reports with statistical significance assessments
• Experiment comparison dashboards with metric breakdowns

Quality Gates

• No experiments without tracking registration and seed control
• Reproducibility must be mandated with fixed seeds and versioned code
• Statistical significance thresholds must be defined before experiments
• All evaluation metrics must be pre-registered before execution