Adjust claims desk · Quillmark Mutual
World clock Mon 17:00:00 CET paused · 60×

Accuracy

The operator measured against the answer key: 7 replayed days, Tue to Mon. Measured against 2,189 injected incidents (incidents_truth) between the operator's first and last tick, Tue 09:00 to Mon 17:01 CET, 7 replayed days. Incidents from before it was switched on are not counted. A detection matches a planted incident of a kind it reports, on the same claim, ring or payment, within 20 minutes.
Precision0.9902,139 detections
Recall0.968of 2,189 injected
Resolved automatically92.6%auto rate, 7-day mean
Reverted by people48actions a person undid
Model callsnonerules only, nothing to pay per resolved incident
Median time to resolve34 min 30 smedian, all resolved · 11 h 43 min when a person decides

Precision per detector, per day

the 6 busiest detectors; the rest are in the table below

Reverted actions

who undid the operator, and why
When (CET)ClaimKind and callByWhy
Mon 14:12CL-26-133781
unassigned_claim
UNDO PUT /claims/29781/fast-track
Saar B. (Fast Track lead, scripted)storm roof damage over 1,300 needs a surveyor, not fast track [scripted claims-desk responses (synthetic)]
Mon 14:06CL-26-133777
unassigned_claim
UNDO PUT /claims/29777/fast-track
Saar B. (Fast Track lead, scripted)storm roof damage over 1,300 needs a surveyor, not fast track [scripted claims-desk responses (synthetic)]
Mon 13:50CL-26-133763
unassigned_claim
UNDO PUT /claims/29763/fast-track
Saar B. (Fast Track lead, scripted)storm roof damage over 1,300 needs a surveyor, not fast track [scripted claims-desk responses (synthetic)]
Mon 13:05CL-26-133718
unassigned_claim
UNDO PUT /claims/29718/fast-track
Saar B. (Fast Track lead, scripted)storm roof damage over 1,300 needs a surveyor, not fast track [scripted claims-desk responses (synthetic)]
Mon 12:00CL-26-133664
unassigned_claim
UNDO PUT /claims/29664/fast-track
Saar B. (Fast Track lead, scripted)storm roof damage over 1,300 needs a surveyor, not fast track [scripted claims-desk responses (synthetic)]
Mon 11:49CL-26-133654
unassigned_claim
UNDO PUT /claims/29654/fast-track
Saar B. (Fast Track lead, scripted)storm roof damage over 1,300 needs a surveyor, not fast track [scripted claims-desk responses (synthetic)]
Mon 11:47CL-26-133652
unassigned_claim
UNDO PUT /claims/29652/fast-track
Saar B. (Fast Track lead, scripted)storm roof damage over 1,300 needs a surveyor, not fast track [scripted claims-desk responses (synthetic)]
Mon 11:31CL-26-133640
unassigned_claim
UNDO PUT /claims/29640/fast-track
Saar B. (Fast Track lead, scripted)storm roof damage over 1,300 needs a surveyor, not fast track [scripted claims-desk responses (synthetic)]

Drift alarms

precision down 15 pts week on week
Mon green all detectorsWeek-on-week alarms need 14 replayed days; the ledger has 7. waiting for data
Mon green modelNo drift: answers usable, confidence steady, few reverts. recal.drift

Per detector, 7 days

precision: of what it flagged, how much was a planted incident
DetectorDetectionsPrecisionReports
date_mismatch34 1.000 date_mismatch
double_invoice80 1.000 double_invoice
duplicate_claim45 0.956 duplicate_claim
estimate_above_benchmark62 0.919 estimate_above_benchmark
missing_police_report134 1.000 missing_police_report
payment_over_authority42 1.000 payment_over_authority
photo_before_loss35 0.600 photo_before_loss
ring_indicator7 1.000 ring_indicator
stalled_claim161 1.000 stalled_claim
subrogation_missed156 1.000 subrogation_missed
total_loss_unflagged12 1.000 total_loss_unflagged
unassigned_claim1,371 1.000 unassigned_claim

Planted incidents, by kind

recall: of what was planted, how much it found; the counts add up to 2,189
Planted kindPlantedFoundRecallReported by
unassigned_claim1,372 1,3710.999 unassigned_claim
subrogation_missed179 1560.872 subrogation_missed
stalled_claim166 1610.970 stalled_claim
missing_police_report142 1340.944 missing_police_report
double_invoice105 800.762 double_invoice
estimate_above_benchmark57 571.000 estimate_above_benchmark
duplicate_claim52 430.827 duplicate_claim
payment_over_authority42 421.000 payment_over_authority
date_mismatch34 341.000 date_mismatch
photo_before_loss21 211.000 photo_before_loss
total_loss_unflagged12 121.000 total_loss_unflagged
ring_indicator7 71.000 ring_indicator
total2,189 2,1180.968