Run the evaluation.
Inspect the failures.

A versioned, reproducible work sample with visible sources and expected outcomes.

Published November 7, 2026. CivicAnswer evidence workbench v1.0. Synthetic concept work, not a client deployment or production model assessment.

CivicAnswer. Application screen.
CivicAnswerCivic information assistant.

This deterministic, extractive demonstration runs in your browser over 60 fictional Meridian source pages. It does not call a language model or submit a service request.

Run the published 50-case benchmark

Version 1.0. Expected source or refusal is compared with the engine result. The cases include supported questions, paraphrases and unsafe or out-of-scope prompts. These cases are not a representative measure of general AI quality.

Download the measured case results · Download the protocol

Inspect the fictional sources

The corpus and cases are published for reproducibility. A correct match to synthetic content does not establish accuracy on a real service.

Download all 60 source pages
  1. Start a permit application

    Applications begin with the fictional permit application form.

    Fictional source ID: start-permit. Section: Service information.

  2. Permit counter hours

    The fictional permit counter is open Monday through Friday, 9 a.m. to 4 p.m. Central time.

    Fictional source ID: permit-hours. Section: Service information.

  3. Permit plan documents

    The fictional application asks for a site plan and a description of the proposed work.

    Fictional source ID: permit-plan. Section: Service information.

  4. Permit review status

    Applicants can check a fictional permit review status with their demonstration reference number.

    Fictional source ID: permit-review. Section: Service information.

  5. Permit expiration

    A fictional permit expires twelve months after the date printed on it.

    Fictional source ID: permit-expiry. Section: Service information.

  6. Permit inspection

    A fictional inspection can be requested after the permit is issued.

    Fictional source ID: permit-inspection. Section: Service information.

  7. Fence permit

    A fictional fence permit is required before a new fence is installed.

    Fictional source ID: fence-permit. Section: Service information.

  8. Shed permit

    The fictional city requires a permit for a new shed.

    Fictional source ID: shed-permit. Section: Service information.

  9. Change a permit

    To change a fictional permit application, contact the permit counter before work begins.

    Fictional source ID: permit-change. Section: Service information.

  10. Permit appeal

    The fictional permit notice explains how to request a review of a decision.

    Fictional source ID: permit-appeal. Section: Service information.

  11. Permit copies

    A fictional permit copy can be requested at the permit counter.

    Fictional source ID: permit-copy. Section: Service information.

  12. Permit accessibility

    The fictional permit counter can provide an accessible format on request.

    Fictional source ID: permit-access. Section: Service information.

  13. Start water service

    To start fictional water service, complete the water service request form.

    Fictional source ID: water-start. Section: Service information.

  14. Stop water service

    To stop fictional water service, submit a service stop request.

    Fictional source ID: water-stop. Section: Service information.

  15. Water bill due date

    The fictional water bill shows its due date on the first page.

    Fictional source ID: water-bill. Section: Service information.

  16. Pay a water bill

    Fictional water bills can be paid using the water payment form.

    Fictional source ID: water-payment. Section: Service information.

  17. Report a water leak

    Report a fictional non-emergency street water leak through the water service form.

    Fictional source ID: water-leak. Section: Service information.

  18. Water meter reading

    The fictional water meter reading appears on the water bill.

    Fictional source ID: water-meter. Section: Service information.

  19. Water service contact

    The fictional water service desk is open weekdays from 9 a.m. to 4 p.m. Central time.

    Fictional source ID: water-contact. Section: Service information.

  20. Change water billing address

    Submit a fictional billing address change through the water service form.

    Fictional source ID: water-address. Section: Service information.

  21. Water payment assistance

    The fictional water service desk can explain available payment arrangements.

    Fictional source ID: water-assistance. Section: Service information.

  22. Water quality report

    The fictional annual water quality report is available from the water service desk.

    Fictional source ID: water-quality. Section: Service information.

  23. Water autopay

    The fictional water payment form includes an autopay enrollment option.

    Fictional source ID: water-autopay. Section: Service information.

  24. Water bill review

    Ask the fictional water service desk to review a water bill.

    Fictional source ID: water-dispute. Section: Service information.

  25. Pay a court fine

    Use the fictional court fine payment form and the reference number on the notice.

    Fictional source ID: pay-fine. Section: Service information.

  26. Court fine due date

    The fictional court notice lists the date by which a fine is due.

    Fictional source ID: fine-due. Section: Service information.

  27. Court counter hours

    The fictional court counter is open weekdays from 9 a.m. to 4 p.m. Central time.

    Fictional source ID: court-hours. Section: Service information.

  28. Find a court notice

    A fictional court notice can be requested from the court counter.

    Fictional source ID: court-notice. Section: Service information.

  29. Court payment record

    A fictional payment record can be requested from the court counter.

    Fictional source ID: court-record. Section: Service information.

  30. Court accessibility

    The fictional court counter accepts requests for accessible formats.

    Fictional source ID: court-access. Section: Service information.

  31. Court mailing address

    The fictional court accepts correspondence at 10 Civic Plaza, Meridian.

    Fictional source ID: court-address. Section: Service information.

  32. Court reference number

    The fictional case reference number is printed near the top of the notice.

    Fictional source ID: court-reference. Section: Service information.

  33. Court payment options

    The fictional court fine form describes the available demonstration payment options.

    Fictional source ID: court-payment-options. Section: Service information.

  34. Court fine review

    Contact the fictional court counter to ask about review of a notice.

    Fictional source ID: court-review. Section: Service information.

  35. Court hearing information

    A fictional hearing date, when assigned, is shown on the notice.

    Fictional source ID: court-hearing. Section: Service information.

  36. Court language support

    The fictional court counter can arrange language assistance on request.

    Fictional source ID: court-language. Section: Service information.

  37. Report a missed pickup

    Use the fictional missed pickup form to report a collection that was not completed. The form asks for a service address and the collection date.

    Fictional source ID: missed-pickup. Section: Service information.

  38. Find a collection day

    The fictional collection calendar lists collection days by service area.

    Fictional source ID: collection-day. Section: Service information.

  39. Cart placement

    Place a fictional collection cart at the curb before 7 a.m. on the scheduled day.

    Fictional source ID: cart-placement. Section: Service information.

  40. Recycle paper

    Clean paper and flattened cardboard belong in the fictional recycling cart.

    Fictional source ID: recycling-paper. Section: Service information.

  41. Recycle glass

    Empty glass bottles belong in the fictional recycling cart.

    Fictional source ID: recycling-glass. Section: Service information.

  42. Bulky item pickup

    A fictional bulky item pickup can be requested using the waste service form.

    Fictional source ID: waste-bulk. Section: Service information.

  43. Request a waste cart

    Request a fictional replacement waste cart through the waste service form.

    Fictional source ID: waste-cart. Section: Service information.

  44. Holiday collection

    The fictional holiday calendar shows collection changes.

    Fictional source ID: waste-holiday. Section: Service information.

  45. Yard waste

    The fictional yard waste calendar lists seasonal pickup dates.

    Fictional source ID: waste-yard. Section: Service information.

  46. Waste service hours

    The fictional waste service desk is open weekdays from 9 a.m. to 4 p.m. Central time.

    Fictional source ID: waste-contact. Section: Service information.

  47. Repair a collection cart

    A fictional damaged cart can be reported through the waste service form.

    Fictional source ID: waste-repair. Section: Service information.

  48. Commercial waste

    The fictional waste service desk answers questions about commercial collection.

    Fictional source ID: waste-commercial. Section: Service information.

  49. Start a business license

    Start a fictional business license application with the business license form.

    Fictional source ID: business-start. Section: Service information.

  50. Renew a business license

    Renew a fictional business license using the business license form.

    Fictional source ID: business-renew. Section: Service information.

  51. Business license counter hours

    The fictional business license counter is open weekdays from 9 a.m. to 4 p.m. Central time.

    Fictional source ID: business-hours. Section: Service information.

  52. Business address change

    Report a fictional business address change using the business license form.

    Fictional source ID: business-address. Section: Service information.

  53. Business license copy

    Request a fictional license copy from the business license counter.

    Fictional source ID: business-copy. Section: Service information.

  54. Business license status

    The fictional counter can check a license application using its reference number.

    Fictional source ID: business-status. Section: Service information.

  55. Business license documents

    The fictional application asks for the business name and mailing address.

    Fictional source ID: business-documents. Section: Service information.

  56. Close a business license

    Tell the fictional business license counter when a licensed business closes.

    Fictional source ID: business-close. Section: Service information.

  57. Business license expiration

    The fictional business license shows its expiration date on the certificate.

    Fictional source ID: business-expiry. Section: Service information.

  58. Business license location

    The fictional business license counter is at 10 Civic Plaza, Meridian.

    Fictional source ID: business-location. Section: Service information.

  59. Business license accessibility

    The fictional license counter can provide an accessible format on request.

    Fictional source ID: business-access. Section: Service information.

  60. Business license review

    The fictional business license counter can explain the application review process.

    Fictional source ID: business-review. Section: Service information.

Deployment boundary

The engine admits a narrow set of approved phrases or page titles and refuses other inputs. It does not infer, search the live web, authenticate residents or execute tools. Known paraphrase failures remain visible. This is an inspectable evaluation method, not a claim of general language understanding.

Scope a model, agent or automation engagement →

Read the evaluation planning guide →