BMAD Telemetry & Evaluation

Build-Measure-Analyze-Decide: System Accuracy & Council Accountability

Global Hit Rate

68.5%

Target: >60.0%

System Brier Score

0.12

Lower is better (0.0 - 1.0)

Matured Forecasts

142

+12 this week

Council Reputation Leaderboard

Agent Role	Hit Rate	Avg Brier Score	Evaluated
#1Risk Manager	82.0%	0.050	30
#2Macro Analyst	71.4%	0.090	142
#3Technical Analyst	65.2%	0.140	142
#4Quant Reviewer	63.8%	0.110	142
#5News Analyst	58.1%	0.190	142

Brier scores accurately reflect calibration capabilities. An agent producing a high hit-rate but poor Brier score is over-trading with miscalibrated confidence. The orchestrator adjusts weightings automatically based on these metrics.