BY NUMBER7 AIEvidence
Required documents and source claims are present.
EVALUATION METHODOLOGY
Compare systems on the same operating boundary.
Freeze the document population, transaction definition, required outcome and manual-rescue policy before measuring automation.
50 representative documents→Defined transactions→Required outcomes→Manual rescues counted
Define success before seeing the result.
DIRECT ANSWER
How should AP automation be evaluated?
Use a representative frozen population, define a successful transaction outcome, count every manual rescue and separate extraction correctness from controlled accounting completion.
FREEZE THE POPULATION
Use representative work, not the cleanest demo documents.
Include routine documents, material exceptions, multi-page files, partial receipts, missing evidence and integration failures.
- 01
Select
Choose documents from the real operating distribution.
- 02
Classify
Record document, transaction and exception types.
- 03
Freeze
Do not replace failed documents after the test begins.
DEFINE SUCCESS
A successful document is not necessarily a completed transaction.
The required evidence, accounting data, controls, approval state and accepted accounting outcome must all be defined.
Accounting
Values, tax, coding and purchase context are acceptable.
Authority
Configured approval conditions are satisfied.
Outcome
The accounting system accepts and returns the result.
COUNT THE HUMAN REMAINDER
Manual rescue cannot disappear from the denominator.
Measure reviewer minutes, exception touches, rework, clarification, manual entry and failed-handoff correction.
Extraction correctness
Did the system read the source?
Transaction correctness
Was the financial state valid?
Straight-through rate
Which eligible transactions completed without rescue?
Human minutes
How much work remained per transaction?
Accepted outcomes
Which results reached the system of record?
THE EVALUATION PACKAGE
Make the result inspectable.
Deliver the frozen population, result table, exception taxonomy, manual-rescue log, evidence samples and operating recommendation.
50 representative documents→Defined transactions→Required outcomes→Manual rescues counted
Define success before seeing the result.
Apply the method to your documents.
Use the same denominator for AIdaptIQ and every alternative.