Research Payload Family — Dry Runs
research-payload-candidates/vendor-evidence-procurement-renewal-exit@0.1.0
Synthetic procurement-to-exit specimen testing supplier evidence, accessibility acceptance, material change, renewal, portability, deletion, and recovery.
v0.1.0
Dry-run finding: focused revision will strengthen the candidate. The payload carried a fictional need from alternatives through supplier evidence, accessibility acceptance, material change, renewal, portability, deletion, and recovery. Candidate status continues. The next revision adds stable trace fields, shared result states, and an explicit multidisciplinary review step.
Specimen boundary
Every organization, product, price, document, test result, and event below is synthetic. The scenario tests the candidate payload’s control flow. Vendor fitness, legal compliance, procurement outcome, and production-system behavior remain matters for fitting real evidence and accountable decision-makers.
Payload under test: Vendor Evidence, Procurement, Renewal & Exit Portability — Research Payload Candidate (v0.1)
run_id: VEPRX-DRY-001
run_type: public_safe_synthetic_dry_run
as_of: 2026-10-02
data_standing: entirely_synthetic
consequence: low_stakes
candidate_version: 0.1.0Result at a glance
- Candidate determination: focused revision; candidate status continues.
- Specimen decision: retain the current accessible workflow and conditionally invite the fictional managed-service route to a sandbox pilot after named evidence and accessibility gaps close.
- Award or production acceptance: remains outside this dry run’s evidence ceiling.
- What the run establishes: the candidate can carry a low-stakes need from alternatives through evidence, contract, acceptance, change, renewal, and exit.
- What remains open: stable trace identifiers, evidence-result states, current-release accessibility evidence, complete audit export, backup-deletion evidence, explicit stop/reopen fields, and multidisciplinary review.
Official source basis
The UK Guidelines for AI Procurement treat AI procurement as lifecycle work involving need definition, alternative routes, data readiness, multidisciplinary evaluation, transparency, whole-life cost, ongoing testing, lock-in, knowledge transfer, and end-of-life planning. The guidance is comparative rather than governing U.S. procurement authority.
Section508.gov’s acquisition guidance places accessibility at the beginning of the ICT acquisition lifecycle, recommends market research across at least two possible solutions, and separates vendor conformance claims from hands-on validation. Its vendor-information guidance requests an Accessibility Conformance Report, supporting evaluation information, issue detail, accessible-content evidence for authoring tools, and testing access. The Accessibility Conformance Report guidance describes an ACR as evidence for assessing a product against specified accessibility requirements; local acceptance still comes from the receiving environment’s fitting observations.
This fictional U.S. federal scenario treats Section 508 as directly applicable. The UK guidance contributes lifecycle, change, lock-in, and exit questions while the receiving organization retains its own procurement, legal, privacy, security, and records authorities.
Bound scenario
Parameter | Synthetic entry |
Organization | Example Public Learning Office, a fictional U.S. federal training unit |
Need | Help staff draft nonbinding internal FAQs from an approved collection of public training manuals |
Affected population | Eighteen authors and reviewers, including keyboard-only and screen-reader workflows |
Current practice | Accessible templates plus manual document search and human review |
Desired outcome | A source-linked draft that preserves accessible structure and remains subject to human approval |
Decision stage | Market research and bounded sandbox-pilot decision |
Data | Public, agency-authored training material; no personal, controlled, or sensitive data |
Consequence | Low-stakes staff communication; no eligibility, enforcement, medical, legal, employment, or benefits decision |
Accountable receivers | Program owner, contracting officer, Section 508 specialist, technical owner, privacy/security reviewers, records owner |
Exit horizon | Twelve-month pilot with renewal review at month ten and an exit rehearsal before acceptance |
Evidence cutoff | 2026-10-02 |
Generated text remains a draft until an accountable reviewer approves it. The pilot uses the approved public corpus. A source citation earns trust when it resolves to the supporting passage and correct source version. Accessibility acceptance covers the named workflows and tested release.
Credible routes
Route | Description | Value sought | Main concentration |
R0 · Current workflow | Improve accessible templates, source index, and review guidance | Lower change burden and preserve known controls | Continuing staff search and synthesis effort |
R1 · CedarDraft Cloud | Fictional managed retrieval-and-drafting service over the approved corpus | Faster first drafts with source links and managed support | Proprietary model, service, audit history, and export behavior |
R2 · OpenDraft Kit | Fictional locally hosted open-source retrieval assistant | Greater component and data control | Internal integration, accessibility remediation, operations, and maintainer capacity |
All three remain in the comparison so the decision starts with the need rather than presuming an AI route.
Evidence inventory
Evidence ID | Item | Class | Coverage | Ceiling |
E-01 | UK Guidelines for AI Procurement | Official guidance | Need, data assessment, evaluation, lifecycle, change, lock-in, end of life | Comparative public-sector guidance |
E-02 | Section508.gov acquisition guidance | Official U.S. federal guidance | Requirements, market research, proposal evaluation, hands-on testing, acceptance | Acquisition-process guidance |
E-03 | Section508.gov vendor-information guidance | Official U.S. federal guidance | ACR, evaluation detail, authoring-tool output, demonstration, test access | Evidence-request guidance |
E-04 | Synthetic CedarDraft ACR for release 4.1 | Supplier-reported | Core interface and documentation | Supplier claim for an earlier version |
E-05 | Synthetic CedarDraft architecture and data-use brief | Supplier-reported | Hosting, model, corpus isolation, logging | Supplier description |
E-06 | Synthetic sandbox fixture results for release 4.3 | Locally observed within this dry run | Citation, keyboard, output, export, change regression | Scripted specimen |
E-07 | Synthetic draft contract schedule | Proposed contract language | Change notice, correction, export, deletion, transition | Proposed rather than committed |
E-08 | Independent security test | Open | Evidence unavailable in this run | Security assurance remains open |
E-09 | Backup-expiry deletion receipt | Open | Evidence unavailable in this run | Deletion completion remains open |
Lifecycle execution
Stage | Evidence used | Decision returned |
Need and alternatives | Current workflow, affected users, public corpus, three routes | Keep all three routes; proceed to bounded evidence comparison |
Market and shortlist | Architecture, accessibility, support, data, cost, and exit evidence requests | Shortlist R0 and R1; retain R2 as an exit-aware comparator |
Due diligence | Synthetic supplier materials plus official evidence requirements | R1 remains conditional; security and current accessibility coverage stay open |
Contract design | Requirement-to-acceptance-test matrix | Draft acceptance, change, remediation, export, deletion, and transition terms |
Acceptance | Twelve scripted FAQ fixtures and named accessibility tasks | Conditional pilot; production acceptance awaits fitting evidence |
Operation | Synthetic model-update event and regression comparison | Restrict update until regression closes and evidence refreshes |
Renewal | Outcome, accessibility, total-cost, change, and dependence review | Renewal decision reserved |
Exit | Export, neutral-archive import, continuity, and deletion rehearsal | Portability partial; deletion evidence partial |
Requirement-to-exit trace
ID | Requirement | Supplier evidence | Local acceptance test | Dry-run result | Contract consequence | Exit evidence |
REQ-01 | Every material draft claim retains the correct source and version | Product demonstration | Twelve source-grounded FAQ fixtures | Partial: 11/12 resolved correctly; one cited a superseded section | 12/12 threshold, correction window, regression test after change | Export carries source ID, version, and quoted support |
REQ-02 | Named authoring workflow is keyboard operable | Earlier-release ACR | Create, revise, review sources, export, and sign out using keyboard only | Failed: core drafting completed; focus escaped the export dialog | Remediation before acceptance; current-release retest | Neutral archive remains keyboard operable |
REQ-03 | Generated content supports accessible authoring | ACR plus supplier guidance | Inspect headings, lists, links, language, and errors | Partial: structure retained; one ambiguous link label required correction | Accessible-output samples and guidance become deliverables | Export preserves semantic structure |
REQ-04 | Material changes receive notice and renewed evidence | Supplier release policy | Re-run frozen fixture before and after change | Failed: citation completeness moved from 12/12 to 10/12 | Define material change; require notice, version, regression evidence, rollback | Prior accepted release and fixture remain recoverable |
REQ-05 | Customer material stays within approved use | Supplier brief | Inspect configuration, logs, contract, and deletion route | Open: statement is supplier-reported; contract commitment pending | Add enforceable use, retention, access, and audit terms | Export and deletion cover prompts, sources, logs, support copies |
REQ-06 | Complete portable export supports transition | JSON and CSV documentation | Export all twelve projects into neutral archive | Partial: content and sources exported; review decisions and audit events absent | Define export schema, timing, completeness, transition assistance | Import receipt lists records, omissions, schema, checksums |
REQ-07 | Customer data receives evidenced deletion | Policy describes active-data deletion | Submit deletion request and inspect receipt | Partial: active-record receipt present; backup expiry unavailable | Time-bound deletion, backup schedule, escalation, final attestation | Final receipt covers active, support, and backup copies |
REQ-08 | Work continues during service loss or exit | Export and support documentation | Complete one FAQ through current templates | Passed: manual accessible fallback remains usable | Maintain fallback and transition runbook | Fallback owns continuity until replacement acceptance |
Accessibility acceptance case
The ACR is treated as supplier evidence for its stated product version and scope. The dry run requires current-release evidence, supporting evaluation detail, issue severity, accessible-content evidence, and hands-on access because conformance documentation and repeatable local testing answer different questions.
Named workflows include entering the application, creating a project, selecting the approved corpus, drafting, inspecting sources, revising, resolving an error, exporting accessible content, recovering focus, and completing the essential path with the documented assistive-technology setup.
The evidence supports the observed core drafting path. The export-dialog focus failure becomes a remediation and retest condition before acceptance.
Material-change case
A change becomes material when it can alter an accepted requirement, risk, workflow, evidence basis, or exit posture. The buyer-facing observation therefore carries more decision weight than the supplier’s release label alone.
Whole-life cost and concentration
All amounts are illustrative scenario inputs.
Route | Visible cost | Missing cost | Concentration reading |
R0 · Current workflow | USD 0 new license cost | Staff search, drafting, review, and maintenance time unmeasured | Attention concentrated in experienced authors |
R1 · CedarDraft Cloud | USD 10,000 annual license; USD 2,000 setup; USD 2,500 optional exit assistance | Internal review, remediation, overage, and unresolved support effort | Proprietary service, model change, audit history, incomplete export |
R2 · OpenDraft Kit | USD 0 license | Hosting, integration, accessibility repair, monitoring, and support capacity unmeasured | Internal engineering and maintainer continuity |
The cost ledger remains partial, so it supports questions and evidence requests rather than a total-cost or return ranking.
Renewal and exit rehearsal
Renewal stays reserved until the receiving team observes usefulness and correction burden; current-release accessibility; incident, change, and rollback history; complete cost and usage records; current alternatives; export and transition results; deletion evidence; and unresolved concentration.
The rehearsal supports a recoverable transition design. Full exit-portability standing requires review-decision export, audit-event export, and backup-deletion evidence.
Bounded specimen recommendation
Keep the current workflow available and permit a bounded R1 sandbox pilot after the receiving organization has current-release accessibility evidence, a successful export-workflow retest, buyer-facing change and rollback terms, enforceable data-use boundaries, a complete export schema, backup-expiry evidence, and fitting security evidence. R2 remains a credible portability comparator; its internal support and accessibility workload require separate observation.
Candidate payload decision
Focused revision; candidate status continues. Four additions will make the next execution more repeatable and inspectable:
- Require stable trace fields linking requirement, claim, supplier evidence, local acceptance test, contract term, monitoring signal, and exit test.
- Add a shared result vocabulary:
passed,failed,partial,open,unavailable,expired,superseded, andinapplicable, each carrying evidence date and claim ceiling. - Define the run receipt, stopping condition, and reopening event as required output schemas.
- State that a synthetic specimen establishes control-flow coherence while an instrumented run and accountable multidisciplinary review remain promotion evidence.
The separate dry-run receipt records invocation identity, candidate digest, demand states, decision, and re-entry.