Technology Solutions5 min read
Set the false-positive budget with the people who get paged
An alerting system is only as good as the trust of the team receiving it. Trust is spent by false positives and it does not refill on its own.
Anita Deshmukh, Chief Technology Officer ·
Precision is a negotiation, not a metric
The right operating point on the precision-recall curve is not a mathematical question. It depends on what a false alert costs the field team and what a missed one costs the business, and only one of those is in the model.
Review it on a schedule
Conditions change, and so does tolerance. A quarterly review with the team that responds keeps the threshold honest and keeps them invested in the system working.