By Bill Murphy  ·  Powered by Colony Spark

THE OPERATIONS
BRIEF

 

ISSUE #19  ·  SEPTEMBER 18, 2026

 
 

Hi ${first_name},

A plant manager types a question into the new ERP chat box and gets an answer in four seconds. The number is clean, the sentence around it is confident, and nobody in the room can tell you which of a dozen unvoted decisions produced it. Natural language changed how fast you can ask. It did not decide what the answer means.

This issue is about what has to be true before you trust a conversational answer out of the ERP: a roundtable operator's rule for proving a number before explaining it, and a one-page metric constitution you can fill in this week for the one KPI everyone in the room already argues about.

Bill

 

THE SHIFT

Natural-Language ERP Needs a Metric Constitution.

Conversational access changes the cost of asking. It does not settle what the question means.

Picture the question every operations leader eventually types into a chat box: what shipped late last month? The system that used to require a saved search and a report writer now returns an answer in seconds. What it does not surface is the list of choices baked into that answer: promised date or requested date, order level or line level, whether a partial shipment counts as late, whether a reopened order resets the clock, whether a cancelled line ever enters the denominator, which plant's production calendar applies, and how stale the underlying data is at the moment you asked.

That is the trade natural-language ERP is making across the industry right now. Oracle's Ask Oracle lets eligible NetSuite Next users ask business questions in plain English and pull an answer straight out of the system. Oracle's own documentation is candid about the risk: vague terms such as open or delayed can produce unexpected results, and when the system is uncertain, it appends an interpretation note explaining what it assumed. That is a useful safety valve. It is also an admission that the tool cannot read your mind about what open actually means at your plant.

Four data points behind the shift

· Oracle's own guidance warns that ambiguous terms like open or delayed can lead to unexpected results, so Ask Oracle appends an interpretation note when it is uncertain (Oracle Ask Oracle documentation).

· NetSuite's August 2026 release lets admins manage Ask Oracle access by role, use permitted saved searches as answer sources, and preview NetSuite Next on a copy of live account data (Oracle NetSuite 2026.2 release notes).

· NIST's July 2026 smart-manufacturing roadmap names industrial data management, integration across heterogeneous systems, and trustworthy, explainable, reliable operation as critical barriers to AI deployment on the floor (NIST).

· Deloitte's 2026 survey of more than 140 manufacturers found 84% seeing measurable value from AI, while only about 20% of use cases are actually scaled, citing robust data and governance as the gap (Deloitte).

Turn those August controls on. Then be honest about what they do. Role-based access decides who is allowed to ask. Saved searches decide what context the answer is allowed to draw from. The sandbox preview decides who can break things safely. None of the three decides whether a partial shipment counts as late at your plant. That is a business decision, it needs a named owner, and no release note is going to make it for you.

NIST's framing backs up the operational point: the barrier to trustworthy AI on the floor is not the model, it is the industrial data management and governance layer sitting underneath it. Deloitte's numbers put a scale on the gap. Most manufacturers are already seeing value from AI. Most of that value is still stuck in pilots, and the reason, in Deloitte's own words, comes down to robust data, governance, and deployment models. Read that as a scale-gap signal from a broad, cross-industry study, not a market forecast for any one region.

None of this is an argument against handing people a chat box instead of a report writer. It is an argument for certifying the handful of metrics that actually drive daily decisions before turning the chat box loose on all of them. On-time delivery, gross margin, backlog, late orders: pick the short list first, and settle it before the questions start arriving at conversational speed.

The fix is not fewer questions. It is fewer ungoverned answers.

 

FROM THE FLOOR

Show the proof before the reasoning.

Robert Wyse, Industronics Service Company, on what it takes to get an AI-generated number trusted on the floor

Robert Wyse owns Industronics Service Company. Speaking at the Colony Spark Operators Roundtable in August, he named the exact standard an AI-generated ERP answer has to clear before anyone on the floor will act on it.

“I think you really have to show the proof before you get into the reasoning. You have to illustrate the why. Otherwise, it's really hard to get everyone on board.”

Robert Wyse

Owner, Industronics Service Company  ·  Colony Spark Operators Roundtable, August 2026

Wyse is describing sequence, not sentiment. Show the proof first: the definition, the source records, the filters, the timestamp. Only then does the reasoning get a hearing. Flip that order, lead with a confident-sounding explanation before anyone has seen where the numbers came from, and the room stops trusting the tool the first time the number does not match what the plant manager already knows.

The takeaway

Before an AI-generated ERP answer changes a plan, a schedule, or a customer commitment, the operator needs to see what counts, where the data came from, and a way to check it against a report they already trust. Confidence is not proof. Reproducibility is.

 

THE STACK

The Metric Constitution, Built in dbt.

Define the metric once. Expose only the certified answer.

A one-page constitution per metric, a governed calculation layer between the chat box and the warehouse, and a four-step routine for reconciling what it returns.

The problem in Section 1 has a fix that does not require blocking the chat box. Define the operational metric once, in a governed semantic layer, then let the AI agent query and explain that certified definition instead of inventing its own. The dbt Semantic Layer paired with dbt MCP is the most specific version of this available today for manufacturers and distributors whose ERP and WMS data already land in a warehouse.

This setup centralizes the definitions of the metrics that actually run the plant: on-time delivery, fill rate, inventory turns, margin, supplier performance. It separates the natural-language interface from the calculation. The agent's job becomes explaining and querying an approved metric, not deciding what late means on the fly.

The one-page metric constitution

Before any of this is code, it is a page. Pick the metric your team argues about most and answer these eight lines. If you cannot answer one of them without a meeting, you have found the reason the chat box is going to embarrass someone.

1. Name and plain-English definition. One sentence an operator would say out loud, not a formula.

2. Owner. A person, not a department. They settle disputes about this number.

3. Calculation and grain. The math, and whether it counts orders, lines, units, or dollars.

4. Time dimension. Which date field, and why that one instead of the other three.

5. Filters and exclusions. Written down. Samples, intercompany, cancellations, rework, test orders.

6. Source of record. Which system and which table the number comes from when two disagree.

7. Refresh timing. How current the data is at the moment someone asks, stated in hours.

8. Reconciles against. The one certified report this metric has to match, every time.

Lines 1 through 7 become the metric definition in dbt. Line 8 is what the operator checks before acting. Here is the routine that moves the page into the stack.

Define, expose, ask, reconcile

1. Define. Build the operational metric in dbt: calculation, time dimension, entities, grain, filters, exclusions. Test it against known results and deploy it to the Semantic Layer.

2. Expose. Configure dbt MCP in the approved agent environment. Turn on the Semantic Layer and only the metadata tools the workflow needs, on the narrowest practical account and token permissions.

3. Ask. Pose the operating question. Require the response to show the metric name and definition, filters, grain, time range, and result, not just a number.

4. Reconcile. Check the result against the certified report or a known query. If the numbers differ, the metric owner resolves the definition, source, or filter mismatch before anyone acts on it.

Example

Ask, why did on-time delivery fall at the East plant last month? The agent queries the governed on-time-delivery metric, states exactly how on time is defined, shows the plant and date filters and the result grain, then breaks the result down only through approved dimensions. The operator compares the total against the existing report before using the explanation for anything.

Availability and guardrails

Availability

The dbt Semantic Layer is available on dbt Platform Starter, Enterprise, and Enterprise+ accounts. The self-hosted dbt MCP server can run locally, but its Semantic Layer toolset needs dbt Platform credentials and a production environment ID. Starter pricing runs $100 per user per month with 5,000 queried metrics included (dbt Semantic Layer docs, dbt pricing).

Guardrails

Keep the agent scoped to the Semantic Layer and the metadata tools the workflow actually needs. Do not enable SQL execution, administrative, job-management, or write-capable tools unless the use case and permissions explicitly call for them (dbt MCP setup).

The interface can be conversational. The number it returns still needs a constitution behind it.

 

THE OPERATIONS BRIEF

By Bill Murphy  ·  Powered by Colony Spark

Already treating your ERP metrics as a governed asset, or watching a chat box generate three different answers to the same question? Hit reply, I read every one. Bill