← All field notes
AI systems

AI needs an operating model, not just a chatbot

Metasis MediaOctober 12, 20235 min read

The visible AI feature is often the smallest part of the system. The difficult work sits around it: deciding which sources are authoritative, what the model may do, when a person must review the result, and how uncertainty is communicated.

A prototype can feel impressive while avoiding every operational question that determines whether people will trust it in production.

Start with the workflow

Before choosing a model, map the work. Identify the trigger, the information available at that moment, the decision being made, the person accountable for it, and the cost of a wrong answer.

That framing reveals whether the useful capability is retrieval, classification, drafting, extraction, orchestration, or something simpler than AI.

Make authority visible

When sources conflict, the product needs a rule for precedence and freshness. Retrieval alone does not create trust. People need to understand what informed the result and where the system is uncertain.

The operating model around AI is part of the product.

Design the review path

Human review should not be a vague safety promise. Define who reviews, what context they receive, which actions they can take, and what durable record remains afterward.

Good AI systems make judgment easier to apply. They do not hide it behind a confident answer.

Metasis field notes

Written from hands-on product systems work across workflow design, software delivery, automation, migration, and release.