Tag: llm
-
My Product Management Toolkit (69): AI guardrails

What are AI guardrails? Guardrails identify and remove inappropriate or inaccurate output generated by LLMs. They can also pick up on risky prompts to reduce the risk of leaking sensitive information, sharing personally identifiable information and providing non-compliant advice. Guardrails shape the LLM’s behaviour by setting specific rules that apply to any data input into…
-
Sora no more

OpenAI’s decision this week to shut down Sora, its video generation app, says less about video generation and more about where the real AI battle is being fought right now. Launched with great fanfare in 2024, Sora initially shot to the top of the App Store. But downloads fell sharply — dropping nearly 75% from…
-
Eventual / Daft (Product Review)

My summary of Eventual before using it – Eventual is a multimodal data processing platform designed to power AI-based products and features. How does Eventual explain itself in the first minute? “Revolutionising the way you work with data” is the main strapline on Eventual’s website, and the short explainer video wastes no time making the case.…
-
Learning about automated prompts

Most of the prompts we write are done manually; you type something into ChatGPT or Claude and wait for a response. But there’s a whole other world of prompting happening behind the scenes, where developers write code that assembles and fires off prompts automatically, thus reducing the manual effort in prompt creation and tuning. This…
-
How to write effective evals

We talk a lot about vibe coding, being able to build out product ideas quickly. However, when we deploy products built on existing AI models, we need to ensure the AI’s quality is high, consistent and scalable. Evals provide us with a system to measure quality at scale. Best to start with manual evaluations, which…
