Artificial Intelligence

AI Due Diligence: Verify the Asset Behind the Demo

7 min read

Ask the seller to reproduce the AI result that matters most to the deal.

Same source record. Same product version. Fresh run. Keep the trace.

If the result cannot be reproduced, the buyer may be looking at a demonstration rather than an asset. If it can, the trace becomes a receipt: it shows which data, model, instructions, tools, people and vendors created the outcome. AI due diligence follows that receipt until the buyer knows what will transfer and what will disappear when the deal closes.

Name the asset before grading it

“Our AI” can refer to very different property. Separate the pieces.

Asset candidateEvidence that it exists
Proprietary dataDataset inventory, provenance, rights, version and quality record
Evaluation systemRepresentative cases, acceptance rules, runner, results and failure history
Model or adaptationTraining method, weights or provider record, version and reproducible test
Retrieval layerCorpus, access filter, indexing process, citations and freshness operation
Agent applicationInstructions, tools, permissions, state, approvals, logs and fallback
Product workflowUser path, business rule, integration, outcome and support process
Operating know-howNamed people, runbooks, incident evidence and change practice

A target may have several of these. It may also have only a product workflow built on a third-party model. That can still warrant the price. The mistake is pricing every layer as proprietary without evidence.

Write a transfer statement for each candidate: what the buyer receives, which right permits continued use, which outside dependency remains and which person knows how to operate it.

Replay one material outcome

Pick a case tied to revenue, retention, labor, risk or another deal assumption. Avoid the seller’s cleanest demo. Use an ordinary production case plus a case that previously failed.

Preserve the run as a sequence:

  1. Source input and permission context.
  2. Data preparation or retrieval.
  3. Model and instruction version.
  4. Tool calls and outside services.
  5. Human review or approval.
  6. Final product action.
  7. User or business outcome.
  8. Cost and latency record.

Now change one material condition. Remove a source, supply conflicting evidence, deny a tool, cross a usage limit or substitute the documented fallback model. The changed run tells the buyer more than a second happy example.

The trace should be exportable without the seller’s private observability account. If the buyer cannot retain the evidence, post-close learning starts at zero.

Prove the data can travel with the deal

Data volume is not a moat when the target cannot show where the data came from or how it may be used.

For every dataset used to train, tune, retrieve, evaluate or monitor the material outcome, record:

  • source and collection method
  • owner and applicable contract or permission
  • allowed purposes and transfer conditions for counsel to assess
  • personal, confidential or restricted fields
  • transformations, labeling and quality decisions
  • retention, deletion and correction path
  • downstream copies and derived artifacts
  • person accountable for the record

Keep technical findings separate from legal conclusions. The review can show that a training set contains customer support conversations and that its source agreement is missing from the data room. Counsel decides what rights transfer and what remedy the transaction needs.

The OECD Due Diligence Guidance for Responsible AI frames due diligence as an ongoing process for identifying and addressing impacts in AI development and use. It is not an M&A valuation standard. Its evidence habit is still useful: trace impacts and responsibilities through business relationships instead of treating the model as an isolated object.

Rebuild the quality claim from cases

An accuracy number without its cases, sampling method, version and acceptance rule is decoration.

Request the evaluation inventory. For each set, capture who assembled it, which product population it represents, when it was frozen, how labels were decided, which cases were excluded and what action a failure can cause.

Inspect results by consequence. A document classifier that confuses two harmless internal categories has a different failure than one that routes a payment, denies a request or sends customer communication. Aggregate scores can hide the second case inside thousands of easy examples.

Ask for four views:

ViewDiligence question
Current releaseDoes the shipped version meet its own acceptance rules?
Prior releasesIs quality stable, improving or drifting under the same cases?
Hard-case slicesWhich users, inputs or actions carry concentrated failure?
Production reviewDo observed failures resemble the evaluation set?

Re-run a sample from the buyer’s environment where practical. Preserve raw outputs and final actions. A target should be able to explain a mismatch without quietly changing the test.

Price the workload, including failed work

AI unit economics are workload economics. The model price is only one input.

Reconstruct a month from metered records. Separate input and output usage, retrieval, repeated model calls, tool calls, retries, failed runs, human review, storage, observability and reserved infrastructure. Tie the total to completed business outcomes, not API requests.

Use at least three cohorts: ordinary usage, a heavy customer or workflow, and a failure-heavy slice. Model growth through the variables that actually scale, such as documents processed, conversations, agent steps, context length, concurrent users or reviewed exceptions.

Then run sensitivity cases:

  • the provider changes price or removes the preferred model
  • context or agent steps grow with customer complexity
  • quality controls increase human review
  • a major customer needs a separate region or deployment
  • rate limits force additional capacity or queuing

Do not invent precision. Give ranges, assumptions and the point at which the gross-margin or capacity claim stops working.

Inspect authority outside the model

An agent can produce harmless text or change a customer record. The diligence scope should follow the action.

For each tool, API and data store, record the identity used, allowed actions, target objects, policy check, approval point, idempotency rule, timeout, retry, log and reversal path. Deny a forbidden action in a controlled environment and inspect the target system afterward.

NIST’s AI Risk Management Framework is a voluntary framework organized around govern, map, measure and manage functions. Use those functions to check whether risk work exists across the product lifecycle. Do not turn a framework reference into a claim that the target is compliant or safe.

Prompt refusals are not access control. The application should constrain credentials and actions even when the model output is wrong or hostile content reaches its context.

Test provider and model exit

The architecture slide may say “multi-model.” Look for a completed substitution test.

Record the current provider, model, version policy, contract, data handling terms, region, quota, safety settings, latency, cost unit and feature dependencies. Then list what a replacement would need to reproduce.

Run representative evaluation cases on the proposed fallback. Exercise tool calling, structured output, retrieval, safety behavior and context limits used by the product. Record code changes and quality differences.

A replacement that handles a chat prompt but breaks the product’s JSON contract is not a fallback. Neither is a model that passes easy cases while doubling human review.

The result can be a portability range rather than a pass. The buyer needs to know whether exit is an afternoon configuration change, a month of revalidation or a product redesign.

Find the human dependencies

Ask the operator who is not the principal model engineer to deploy a small change, run the evaluation suite, diagnose a bad production result and switch to the approved fallback.

Watch where the handoff stops. The missing detail may live in a notebook, a prompt-management account, a personal cloud project or someone’s memory of why an evaluation case was excluded.

Create a knowledge transfer record for each load-bearing role: responsibility, system access, recurring decisions, emergency action, substitute, documentation and transfer test. Retention plans should follow observed concentration, not job titles.

Connect AI evidence to ordinary product value

An impressive model capability can still be a weak acquisition asset when users do not depend on it, the workflow cannot integrate, or the buyer already owns an equivalent service.

Trace adoption beyond feature activation. Which users return? Which product action follows the output? What manual work remains? Which customer contract or renewal depends on the result? How does the AI path interact with the rest of the product?

Compare the target capability with the buyer’s existing systems and data rights. The decision may be preserve, integrate, replace or retire. “Strategic AI” is not a fifth disposition.

Issue an asset receipt

Give each claimed AI asset a one-page receipt:

Receipt fieldRequired entry
Claimed assetData, evaluation, model, application, workflow or know-how
Observed evidenceTrace, dataset, test, contract, operating record and date
Buyer receivesCode, rights, accounts, artifacts, people and documentation
External dependencyProvider, license, data source, person or platform
Quality and cost boundaryTested cases, workload and assumptions
Control boundaryPermissions, approval, monitoring, failure and recovery
ConfidenceWhat was reproduced and what remained inaccessible
Transaction actionCondition, term input, first 100-day task, monitor or reject

Keep ordinary software findings in the broader technical review. This receipt exists because AI introduces a separate question: is the value in a transferable asset, a repeatable operating system or a demo that depends on access the buyer will not inherit?

Our technical due diligence guide covers the wider product, engineering and transaction review. AI due diligence is the specialist layer underneath an AI claim. It follows the result until the buyer can reproduce it, operate it and explain what remains outside the deal.

  • AI due diligence
  • artificial intelligence due diligence
  • AI acquisition
FAQ

Common questions, answered

What is AI due diligence?
AI due diligence is an evidence-based review of an AI capability's data rights, model and vendor dependencies, evaluation evidence, application controls, security, unit economics, operations, team knowledge, and transferability in an investment, acquisition, or partnership.
How is AI due diligence different from ordinary technical due diligence?
Ordinary technical diligence covers the wider software product and delivery system. AI diligence goes deeper on the evidence behind model behavior, training or retrieval data, evaluation sets, prompt and tool boundaries, model changes, inference economics, human oversight, and provider exit.
What evidence should an AI company provide to a buyer?
Useful evidence includes data provenance and rights, versioned evaluation sets, dated results, failure examples, model and prompt records, tool permissions, production traces, incident history, usage and cost data, vendor contracts, change tests, fallback behavior, and named operating owners.
Can benchmark scores prove that an AI product works?
No. Benchmarks can support comparison within their stated method, but the buyer still needs representative cases from the target product, acceptance rules tied to a user outcome, failure analysis, version history, and production evidence.
How should model-provider risk be reviewed?
Record the provider, contract, data terms, regions, quotas, model-change policy, safety controls, pricing units, fallback, portability, and replacement test. Then replay representative cases on the proposed fallback instead of accepting a diagram that says multi-model.

See it on your own data.

Book a 30-minute discovery call and we'll walk through your use case.