Bot Confidence Level

Written by Uday Kumar Updated

Purpose

This article explains how Auditoria.ai calculates and applies document-level confidence scores for invoices. This score helps assess the accuracy of invoice extraction, flag invoices for review, and support data integrity within your accounts payable workflow.

1. Invoice Data Validation Process

Auditoria.AI performs three validation checks on each invoice:

a. Invoice Information Validation

  • Fields checked: Vendor Name, Entity, Invoice Number, Invoice Date, Due Date, Purchase Order.
  • Method: Each field’s extraction confidence is calculated and compared to a threshold (typically 0.7).
    • Any critical field with confidence < 0.5 lowers the overall record confidence.

b. Amount Consistency Check

  • Fields checked: Total Amount, Net Amount, Total Tax Amount (or Total VAT).
  • Method: System verifies: Total Amount = Net Amount + Total Tax Amount
    • If this check fails, the invoice is flagged for review.
    • Any amount validation failure sets overall confidence to Low.
    • Note: This check is purely mathematical and does not use field-level confidence scores.

c. Line Items Check (Automated Extraction Process)

  • Method: System compares sum of line item amounts to Net Amount or Total Amount.
    • If sum(line items) > Total (or Net) Amount: Confidence Score = 0.2 (Low)
    • If sum(line items) = Total (or Net) Amount: Confidence Score = 0.95 (High)
    • If line item duplicates are removed or sum(line items) < Total (or Net) Amount: Confidence Score = 0.7 (Medium)
  • If line item confidence is < 0.7, the invoice is flagged for review.

2. Determining the Overall Document Confidence Rating

Aggregate confidence score is calculated, classifying invoices as:

Document Confidence Criteria Visual Indicator Confidence Range
High No fields flagged; amount check passes; line items ≥ 0.7 Green ≥ 0.7
Medium Any invoice info flagged, amount check fails, or line items < 0.7 Yellow 0.3 < Confidence < 0.7
Low Multiple issues, failed amount validation, or any field < 0.5 Orange ≤ 0.3

The visual indicator appears in the "Confidence Level" column for each record within the documents section.

3. Determining the Field-Level Confidence Rating

Fields in the invoice are visually highlighted based on their confidence scores, enabling users to quickly identify areas of uncertainty.

Field-Level Confidence Visual Indicator Confidence Range
High No highlight > 0.7
Medium Yellow 0.5 < Confidence ≤ 0.7
Low Orange ≤ 0.5
  • Color coding applies in both read and edit modes.
  • Only Low or Medium confidence fields are highlighted; High confidence fields remain unhighlighted.

Fields typically highlighted:

  • Due Date
  • Currency
  • Net Amount
  • Invoice Date
  • Total Amount
  • Invoice Number
  • Total Tax Amount
  • Service Start Date
  • Service End Date
  • Line Items

(This list may be updated. Please contact your Auditoria.ai representative for the most current information.)

4. Flagging Fields in Invoices for Manual Review

When the bot detects low or medium confidence, fields are flagged for manual review:

  • Header Level: e.g., Due Date, Payment Terms, etc. — flagged when confidence is low or medium (see color coding rules in section 3 above).
  • Line Item Level: e.g., Description, Amount, Price — flagged when confidence is low or medium.

For more information, contact your Customer Success Manager or reach out to our support team (support@auditoria.ai).