Category: Measuring
-
My Product Management Tool (71): Confusion Matrix

At first, the Confusion Matrix made me feel confused (pun 100% intended). Now it’s one of the first things I reach for when checking whether an LLM judge can be trusted. Using an LLM as a judge means an LLM acts as your automated evaluator. A team can’t read every agent output, so the judge…
-
“Impact-first Product Teams” (Book Review)

There are two things that frustrate me when I see some product managers and teams at work. First, PMs and teams not making a tangible impact. Instead, these teams just focus on releasing features “that the business has asked for”. Second, PMs talking about “the business” as if it was a separate entity that they’re…
-
My Product Management Toolkit (65): creating – customer and business – impact

At a time where people in the industry seem to question the added value of Product Managers (PMs) there’s even more reason for PMs to focus on the impact that they’re making through their products. The need for PMs to ensure to move the needle on their company’s bottom line is not a new one,…
-
My Product Management Toolkit (43): retention levers and impact

I like Hiten Shah’s simple but clear explanation about the importance of measuring retention: “retention is the indicator of whether a product is working for its users or not.” Retention is typically measured by comparing the number of customers at the start of a given time period with the number of customers at the end…
-
My Product Management Toolkit (36): Google’s HEART framework

Measure. Measure. Measure. Tracking the impact of a product is crucial if you wish to learn about your product and your customers. I’ve written before about the importance of spending time on defining the right metrics to measure, avoiding the risk of succumbing to data overload. That’s all well and good, but what do you do when…
