Owner: CoE Lead + Agent Owner. Input: Quarterly cadence. Sub-steps:
- Review every production agent's quarterly numbers:
- KPI vs. target.
- ROI: net monthly value (hours saved × loaded cost) + (revenue uplift) − (LLM + infra + observability + maintenance cost).
- Incident count + severity.
- HITL escalation trend.
- Cost trend.
- Re-classify risk if anything material changed (new data sources, new users, new jurisdictions, scope creep). Risk profile drifts; the registry needs to reflect reality.
- Refresh the vendor-embedded AI catalog (every quarter, per Step A7).
- Review the framework itself — anything that broke during the quarter that needs a framework update?
- Report to the executive sponsor.
Output / gate criteria: Quarterly portfolio report. Updated registry. Framework changelog updated if needed.
Decision branches:
- Two consecutive quarters below break-even or KPI → Step 16.
- Risk profile changed → re-run portions of Steps 3–7 as needed.
Skip-this-step risk: The portfolio rots. Old agents stay forever, new risks aren't surfaced, ROI claims aren't checked.