Skip to content

Chapter 13: Assessments

This chapter provides assessment materials for evaluating understanding of the FCC framework. It includes knowledge checks, short-answer exercises, a capstone project description, a grading rubric, and a self-evaluation checklist.

Assessment data is also available programmatically in src/fcc/data/docs/assessment_rubrics.yaml.

Knowledge Checks

Answer each question by selecting the best option.

1. What does FCC stand for?

  • A) Find, Construct, Certify
  • B) Find, Create, Critique
  • C) Fetch, Compose, Check
  • D) Form, Craft, Critique

2. How many components does the R.I.S.C.E.A.R. specification include?

  • A) 7
  • B) 8
  • C) 10
  • D) 12

3. Which constitution tier blocks workflow execution on violation?

  • A) Preferred (tier 3)
  • B) Mandatory (tier 2)
  • C) Hard-stop (tier 1)
  • D) Advisory (tier 0)

4. What is the purpose of the HandoffProtocol in a collaboration session?

  • A) Define data serialization format
  • B) Control turn-taking rules between humans and agents
  • C) Specify network communication protocols
  • D) Configure file transfer settings

5. How many core personas does FCC define?

  • A) 5
  • B) 10
  • C) 84
  • D) 107

6. Which event bus feature enables post-hoc analysis of simulation runs?

  • A) Event filtering
  • B) Event replay
  • C) Event throttling
  • D) Event batching

7. What are the three dimensions of the tag registry taxonomy?

  • A) Name, type, scope
  • B) Capability, category, supercategory
  • C) Input, output, constraint
  • D) Role, phase, archetype

8. In the PAOM/AOME/CONSTEL dependency triangle, what does AOME provide to CONSTEL?

  • A) LLM routing
  • B) Persona definitions
  • C) Privacy taxonomy
  • D) Workflow graphs

9. Which scoring range does the QualityScore use?

  • A) 0-10
  • B) 0-100
  • C) 1-5
  • D) A-F

10. What does the SharedContext record for each set() operation?

  • A) Only the new value
  • B) The key and new value
  • C) Old value, new value, actor, and timestamp
  • D) A hash of the change

Short-Answer Exercises

Exercise 1: Persona Design

Design a R.I.S.C.E.A.R. specification for a "Cost Optimization Analyst" persona in the Critique phase. Include all 10 components. Explain why you chose the specific archetype and how the persona collaborates with at least two other personas.

Exercise 2: Governance Layering

A team managing both public API documentation and internal security reports needs different governance rules for each domain. Describe how you would use FCC's governance plugin system to implement domain-specific constitutions without duplicating shared rules. Reference the 3-tier model in your answer.

Exercise 3: Event-Driven Architecture

Explain how the FCC event bus enables loose coupling between the simulation engine and the collaboration engine. Describe the event types involved and how a subscriber could bridge the two systems.

Exercise 4: Quality Gate Design

Design three quality gates for a machine learning model deployment pipeline. Specify the gate ID, name, threshold, and checks for each gate. Explain why you chose those particular thresholds.

Exercise 5: Cross-Project Integration

Describe the three layers of the CTO bridge architecture and explain why the abstract protocol layer exists. How would you add support for a new ontology format without modifying existing FCC code?

Capstone Project: Domain-Specific FCC Extension

Description

Build a complete domain-specific FCC extension for a domain of your choice (e.g., healthcare, fintech, education, sustainability). The extension should demonstrate mastery of all major FCC subsystems.

Requirements

  1. Personas (3 minimum): Define at least three custom personas with full R.I.S.C.E.A.R. specifications, dimension profiles, and constitutions.

  2. Workflow: Create a custom workflow graph with at least 8 nodes that includes Find, Create, and Critique phases.

  3. Governance: Implement domain-specific governance with:

  4. At least 2 hard-stop rules per persona
  5. At least 3 quality gates

  6. A governance plugin that adds domain-specific compliance checks

  7. Simulation: Run a mock simulation through the custom workflow with all three personas. Generate a trace and verify it contains the expected steps.

  8. Collaboration: Set up a collaboration session with:

  9. At least 2 approval gates
  10. A handoff protocol
  11. At least 4 turns (mix of human and agent)

  12. SharedContext usage

  13. Integration: If applicable, create a provider plugin that exposes a domain vocabulary (at least 10 terms).

  14. Documentation: Write a one-page summary explaining the domain, the personas, and how the FCC workflow addresses a real challenge in that domain.

Deliverables

  • YAML files for personas, workflows, and governance rules
  • Python code for plugins and simulation scripts
  • JSON session recording from the collaboration session
  • One-page domain summary document
  • Test file with at least 10 tests validating the extension

Grading Rubric

Component Points Criteria
Persona quality 15 Complete R.I.S.C.E.A.R., meaningful content
Workflow design 10 Correct graph structure, phase coverage
Governance setup 15 All 3 tiers used, gates configured, plugin works
Simulation execution 10 Trace generated, events captured
Collaboration session 15 Gates evaluated, turns recorded, context used
Integration/plugins 10 Plugin registered, personas merged
Documentation 10 Clear domain summary, accurate descriptions
Tests 10 10+ tests, meaningful assertions
Code quality 5 Clean, readable, follows FCC conventions
Total 100

Grade Scale

Grade Score Range Description
A 90-100 Exceptional: all components complete and well-integrated
B 80-89 Proficient: all components present, minor gaps
C 70-79 Competent: most components present, some incomplete
D 60-69 Developing: significant gaps in multiple areas
F Below 60 Incomplete: major components missing

Self-Evaluation Checklist

Use this checklist to assess your understanding before and after completing the guidebook.

  • I can explain the FCC (Find-Create-Critique) cycle and its purpose
  • I can define a persona using the 10-component R.I.S.C.E.A.R. specification
  • I understand dimension profiles and how they characterize personas
  • I can load and traverse a workflow graph programmatically
  • I can describe the 6 workflow action types and their purposes
  • I can set up an event bus and subscribe to specific event types
  • I can run a mock simulation and interpret the resulting trace
  • I understand the 3-tier constitution model and when each tier applies
  • I can configure quality gates and evaluate deliverables against them
  • I can create and run a collaboration session with approval gates
  • I can use SharedContext for auditable cross-turn data sharing
  • I can create a plugin and register it with the plugin system
  • I understand the CTO bridge architecture and its three layers
  • I can explain the PAOM/AOME/CONSTEL dependency triangle
  • I can design governance for a multi-team environment using plugins

Key Takeaways

  • Knowledge checks test factual recall across all chapters.
  • Short-answer exercises require applying concepts to realistic scenarios.
  • The capstone project integrates all major FCC subsystems into a cohesive extension.
  • Use the self-evaluation checklist to identify areas for further study.
  • Assessment data is available in src/fcc/data/docs/assessment_rubrics.yaml for programmatic use.