Service design · research operations
A nine week study of an AI caregiving assistant, with nine success measures agreed before anybody was recruited. Two write ups: how the admin panel that scores it was built, and how the product was audited for the things it invents.
Client anonymised. The study has not started, so every figure shown is illustrative and no number describes a real person.
Replacing a panel that already existed, against a brief of keep as much as possible and try not to lose anything we need. What was dropped on purpose, what was genuinely given up, and why every number the panel shows is computed from an upload rather than written into the page.
Read →It put a diagnosis nobody had given it into a care plan, and cited a source for it. A line by line reading of what the assistant told four invented caregivers, checked against what those caregivers had actually said to it.
Read →