Blog

The dashboards are lighting up: usage is climbing, licenses are spreading, and the monthly AI bill keeps growing. Unfortunately, none of that actually tells you whether the AI is working. New guidance from OpenAI makes the point plainly: usage and spend tell only part of the story. Leaders need to see the work behind the spend, and connect it to real outcomes. Usage is not value It is an easy trap to fall into, because a chart of active users or tokens looks like progress, and it feels reassuring in a board deck. But token volume is a measure of activity, not value. A short answer can be worth a great deal, and a long one can be worth nothing. The useful question is different: how much useful work are we getting per dollar? Pick one measurable pilot So how do you tell whether it is working? Not with a bigger rollout, but with one carefully chosen, measurable pilot. Choose a repeatable task with clear boundaries, and give it an owner. Write down today’s baseline, meaning the time, cost, or quality you get right now, and set a defined window to evaluate it. Treat the pilot as a decision-making exercise rather than a showcase, so that at the end you either expand it, change it, or stop it based on the evidence. The scorecard that tells the truth That decision needs a scorecard, and it does not have to be complicated. Track five things: how long the work takes, the quality of the output, how much rework it needs, whether people actually adopt it, and the total cost. Those five numbers tell you far more than any usage graph, and they also tell you where to invest next. The workflow scorecard TimeHow long the work takesQualityHow good the output isReworkHow much needs fixingAdoptionWhether people use itCostTotal cost to runFive measures that tell you whether an AI pilot is worth scaling – far more than any usage graph. Framing after OpenAI’s business-value guidance, 2026. AI, automation, or just better process? There is a prior question worth asking too. Does this task even need AI? Some work needs genuine judgment, and that is where AI shines. Some work follows predictable rules, and traditional automation is cheaper and safer. And some work is just slowed down by an unclear process, where the real fix is fixing the process. Matching the right tool to