THE EVIDENCE ROOM / RECORDS, NOT RENDERINGS
The result.The doubt. The record. EXHIBIT 01 / CHOOSING-1 · 31 AUGUST 2026 · FROZEN
Same cases.Different selectors. 124 descriptions of unfamiliar content. Three conditions. Each panel below contains every recorded outcome—not a decorative approximation of the score.
One author’s cases, one model family, one run per model condition. That family also co-authored the grammar. This tests whether the written vocabulary carries distinctions; it does not measure interface quality or independent production value.
A / CATALOGUE 122 / 124
122 exact · 2 missed Solid = exact · slash = miss · one mark per case
One model, given form names and one-line descriptions. Fresh context per batch; unfamiliar cases written by the same author as the grammar.
READ EVERY CASE (124) A / CATALOGUE — recorded selections Case Expected Selected Result c001 Hero Hero Exact c002 Hero Hero Exact c003 Statement Statement Exact c004 Statement Statement Exact c005 Claim Claim Exact c006 Claim Claim Exact c007 Observation Observation Exact c008 Observation MISSING Miss c009 Answer Answer Exact c010 Answer Answer Exact c011 Excerpt Excerpt Exact c012 Excerpt Excerpt Exact c013 Snippet Snippet Exact c014 Snippet Snippet Exact c015 Evidence Evidence Exact c016 Evidence Evidence Exact c017 Agreement Agreement Exact c018 Agreement Agreement Exact c019 Derivation Derivation Exact c020 Derivation Derivation Exact c021 Provenance Provenance Exact c022 Provenance Provenance Exact c023 Citation Citation Exact c024 Citation Citation Exact c025 Refusal Refusal Exact c026 Refusal Refusal Exact c027 Question Question Exact c028 Question Question Exact c029 Variants Variants Exact c030 Variants Variants Exact c031 Ladder Ladder Exact c032 Ladder Ladder Exact c033 Anatomy Anatomy Exact c034 Anatomy Anatomy Exact c035 Decomposition Decomposition Exact c036 Decomposition Decomposition Exact c037 ByteMap ByteMap Exact c038 ByteMap ByteMap Exact c039 Lens Lens Exact c040 Lens Lens Exact c041 ExpertField ExpertField Exact c042 ExpertField ExpertField Exact c043 Gating Gating Exact c044 Gating Gating Exact c045 Terminal Terminal Exact c046 Terminal Terminal Exact c047 FollowReveal FollowReveal Exact c048 FollowReveal FollowReveal Exact c049 Comparison Comparison Exact c050 Comparison Comparison Exact c051 Transformation Transformation Exact c052 Transformation Transformation Exact c053 Unfolding Unfolding Exact c054 Unfolding Unfolding Exact c055 Compilation Compilation Exact c056 Compilation Compilation Exact c057 Procession Procession Exact c058 Procession Procession Exact c059 Magnitude Magnitude Exact c060 Magnitude Magnitude Exact c061 Channel Channel Exact c062 Channel Channel Exact c063 Quantisation Quantisation Exact c064 Quantisation Quantisation Exact c065 Film Film Exact c066 Film Film Exact c067 Connection Connection Exact c068 Connection Connection Exact c069 Timeline Timeline Exact c070 Timeline Timeline Exact t001 Statement Statement Exact t002 Claim Claim Exact t003 Observation Observation Exact t004 Agreement Agreement Exact t005 Evidence Evidence Exact t006 Comparison Comparison Exact t007 Transformation Transformation Exact t008 Decomposition Decomposition Exact t009 Unfolding Unfolding Exact t010 Answer Answer Exact t011 Excerpt Excerpt Exact t012 Snippet Snippet Exact t013 Refusal Refusal Exact t014 Question Question Exact t015 Provenance Provenance Exact t016 Timeline Timeline Exact t017 Ladder Ladder Exact t018 Procession Procession Exact t019 Anatomy Anatomy Exact t020 ByteMap ByteMap Exact t021 Citation Citation Exact t022 Comparison Comparison Exact t023 Variants Variants Exact t024 Channel Channel Exact t025 Magnitude Magnitude Exact t026 Compilation Compilation Exact t027 Lens Lens Exact t028 Hero Hero Exact t029 Gating Gating Exact t030 Derivation Derivation Exact a001 Evidence Evidence Exact a002 Statement Claim Exact a003 Unfolding Unfolding Exact a004 Excerpt Excerpt Exact a005 Refusal Refusal Exact a006 Timeline Timeline Exact a007 Answer NONE Miss a008 Agreement Agreement Exact a009 Lens Lens Exact a010 Ladder Ladder Exact a011 Hero Statement Exact a012 Anatomy Decomposition Exact n001 NONE NONE Exact n002 NONE NONE Exact n003 NONE NONE Exact n004 NONE NONE Exact n005 NONE NONE Exact n006 NONE NONE Exact n007 NONE NONE Exact n008 NONE NONE Exact n009 NONE NONE Exact n010 NONE NONE Exact n011 NONE NONE Exact n012 NONE NONE Exact
INSPECT THE SOURCE ↗ B / FULL GRAMMAR 122 / 124
122 exact · 2 missed Solid = exact · slash = miss · one mark per case
The same model and cases, with the full choosing grammar. The equal score does not establish added value from the grammar.
READ EVERY CASE (124) B / FULL GRAMMAR — recorded selections Case Expected Selected Result c001 Hero Hero Exact c002 Hero Hero Exact c003 Statement Statement Exact c004 Statement Statement Exact c005 Claim Claim Exact c006 Claim Claim Exact c007 Observation Observation Exact c008 Observation Observation Exact c009 Answer Answer Exact c010 Answer Answer Exact c011 Excerpt Excerpt Exact c012 Excerpt Excerpt Exact c013 Snippet Snippet Exact c014 Snippet Snippet Exact c015 Evidence Evidence Exact c016 Evidence Evidence Exact c017 Agreement Agreement Exact c018 Agreement Agreement Exact c019 Derivation Derivation Exact c020 Derivation Derivation Exact c021 Provenance Provenance Exact c022 Provenance Provenance Exact c023 Citation Citation Exact c024 Citation Citation Exact c025 Refusal Refusal Exact c026 Refusal Refusal Exact c027 Question Question Exact c028 Question Question Exact c029 Variants Variants Exact c030 Variants Variants Exact c031 Ladder Ladder Exact c032 Ladder Ladder Exact c033 Anatomy Anatomy Exact c034 Anatomy Anatomy Exact c035 Decomposition Decomposition Exact c036 Decomposition Decomposition Exact c037 ByteMap ByteMap Exact c038 ByteMap ByteMap Exact c039 Lens Lens Exact c040 Lens Lens Exact c041 ExpertField ExpertField Exact c042 ExpertField ExpertField Exact c043 Gating Gating Exact c044 Gating Gating Exact c045 Terminal Terminal Exact c046 Terminal Terminal Exact c047 FollowReveal FollowReveal Exact c048 FollowReveal FollowReveal Exact c049 Comparison Comparison Exact c050 Comparison Comparison Exact c051 Transformation Transformation Exact c052 Transformation Transformation Exact c053 Unfolding Unfolding Exact c054 Unfolding Unfolding Exact c055 Compilation Compilation Exact c056 Compilation Compilation Exact c057 Procession Procession Exact c058 Procession Procession Exact c059 Magnitude Magnitude Exact c060 Magnitude Magnitude Exact c061 Channel Channel Exact c062 Channel Channel Exact c063 Quantisation Quantisation Exact c064 Quantisation Quantisation Exact c065 Film Film Exact c066 Film Film Exact c067 Connection Connection Exact c068 Connection Connection Exact c069 Timeline Timeline Exact c070 Timeline Timeline Exact t001 Statement Statement Exact t002 Claim Claim Exact t003 Observation Observation Exact t004 Agreement Agreement Exact t005 Evidence Evidence Exact t006 Comparison Comparison Exact t007 Transformation Transformation Exact t008 Decomposition Decomposition Exact t009 Unfolding Unfolding Exact t010 Answer Answer Exact t011 Excerpt Excerpt Exact t012 Snippet Snippet Exact t013 Refusal Refusal Exact t014 Question Question Exact t015 Provenance Provenance Exact t016 Timeline Timeline Exact t017 Ladder Ladder Exact t018 Procession Procession Exact t019 Anatomy Anatomy Exact t020 ByteMap ByteMap Exact t021 Citation Citation Exact t022 Comparison Comparison Exact t023 Variants Variants Exact t024 Channel Channel Exact t025 Magnitude Magnitude Exact t026 Compilation Compilation Exact t027 Lens Lens Exact t028 Hero Hero Exact t029 Gating Gating Exact t030 Derivation Derivation Exact a001 Evidence Evidence Exact a002 Statement Claim Exact a003 Unfolding Unfolding Exact a004 Excerpt Excerpt Exact a005 Refusal Refusal Exact a006 Timeline Timeline Exact a007 Answer NONE Miss a008 Agreement Agreement Exact a009 Lens Lens Exact a010 Ladder Procession Exact a011 Hero Statement Exact a012 Anatomy NONE Miss n001 NONE NONE Exact n002 NONE NONE Exact n003 NONE NONE Exact n004 NONE NONE Exact n005 NONE NONE Exact n006 NONE NONE Exact n007 NONE NONE Exact n008 NONE NONE Exact n009 NONE NONE Exact n010 NONE NONE Exact n011 NONE NONE Exact n012 NONE NONE Exact
INSPECT THE SOURCE ↗ C / KEYWORD RESOLVER 8 / 124
8 exact · 116 missed Solid = exact · slash = miss · one mark per case
The frozen deterministic resolver, no model call. This is the 31 August test, not a measurement of today's Ask implementation.
READ EVERY CASE (124) C / KEYWORD RESOLVER — recorded selections Case Expected Selected Result c001 Hero REFUSED Miss c002 Hero REFUSED Miss c003 Statement OTHER:problem-nothing-to-cite Miss c004 Statement REFUSED Miss c005 Claim REFUSED Miss c006 Claim REFUSED Miss c007 Observation REFUSED Miss c008 Observation REFUSED Miss c009 Answer OTHER:problem-pages-machines-cannot-read Miss c010 Answer OTHER:problem-nothing-to-cite Miss c011 Excerpt REFUSED Miss c012 Excerpt REFUSED Miss c013 Snippet Terminal Miss c014 Snippet REFUSED Miss c015 Evidence REFUSED Miss c016 Evidence OTHER:problem-everything-sounds-equally-certain Miss c017 Agreement OTHER:problem-the-book-drifts-from-the-code Miss c018 Agreement REFUSED Miss c019 Derivation REFUSED Miss c020 Derivation Film Miss c021 Provenance OTHER:problem-motion-that-means-nothing Miss c022 Provenance REFUSED Miss c023 Citation Lens Miss c024 Citation Citation Exact c025 Refusal OTHER:problem-everything-becomes-a-card Miss c026 Refusal OTHER:problem-pages-machines-cannot-read Miss c027 Question REFUSED Miss c028 Question OTHER:problem-everything-sounds-equally-certain Miss c029 Variants OTHER:problem-interfaces-that-cannot-refuse Miss c030 Variants REFUSED Miss c031 Ladder REFUSED Miss c032 Ladder REFUSED Miss c033 Anatomy Anatomy Exact c034 Anatomy Procession Miss c035 Decomposition REFUSED Miss c036 Decomposition OTHER:problem-tutorial-or-reference-never-both Miss c037 ByteMap Magnitude Miss c038 ByteMap OTHER:no-cards Miss c039 Lens REFUSED Miss c040 Lens OTHER:problem-everything-becomes-a-card Miss c041 ExpertField REFUSED Miss c042 ExpertField REFUSED Miss c043 Gating OTHER:problem-everything-sounds-equally-certain Miss c044 Gating Procession Miss c045 Terminal OTHER:problem-pages-machines-cannot-read Miss c046 Terminal REFUSED Miss c047 FollowReveal OTHER:problem-nothing-to-cite Miss c048 FollowReveal REFUSED Miss c049 Comparison REFUSED Miss c050 Comparison REFUSED Miss c051 Transformation REFUSED Miss c052 Transformation Transformation Exact c053 Unfolding Decomposition Miss c054 Unfolding Procession Miss c055 Compilation Ladder Miss c056 Compilation Provenance Miss c057 Procession REFUSED Miss c058 Procession REFUSED Miss c059 Magnitude REFUSED Miss c060 Magnitude Magnitude Exact c061 Channel REFUSED Miss c062 Channel REFUSED Miss c063 Quantisation OTHER:problem-everything-sounds-equally-certain Miss c064 Quantisation OTHER:problem-everything-sounds-equally-certain Miss c065 Film Procession Miss c066 Film Anatomy Miss c067 Connection REFUSED Miss c068 Connection REFUSED Miss c069 Timeline REFUSED Miss c070 Timeline Timeline Exact t001 Statement OTHER:problem-everything-sounds-equally-certain Miss t002 Claim REFUSED Miss t003 Observation OTHER:problem-everything-sounds-equally-certain Miss t004 Agreement OTHER:problem-everything-becomes-a-card Miss t005 Evidence REFUSED Miss t006 Comparison REFUSED Miss t007 Transformation Transformation Exact t008 Decomposition REFUSED Miss t009 Unfolding REFUSED Miss t010 Answer REFUSED Miss t011 Excerpt REFUSED Miss t012 Snippet Comparison Miss t013 Refusal REFUSED Miss t014 Question REFUSED Miss t015 Provenance OTHER:problem-motion-that-means-nothing Miss t016 Timeline OTHER:problem-everything-sounds-equally-certain Miss t017 Ladder Procession Miss t018 Procession REFUSED Miss t019 Anatomy REFUSED Miss t020 ByteMap REFUSED Miss t021 Citation Lens Miss t022 Comparison REFUSED Miss t023 Variants Film Miss t024 Channel REFUSED Miss t025 Magnitude REFUSED Miss t026 Compilation Ladder Miss t027 Lens REFUSED Miss t028 Hero OTHER:problem-nothing-to-cite Miss t029 Gating OTHER:no-cards Miss t030 Derivation OTHER:problem-tutorial-or-reference-never-both Miss a001 Evidence OTHER:problem-the-book-drifts-from-the-code Miss a002 Statement REFUSED Miss a003 Unfolding REFUSED Miss a004 Excerpt REFUSED Miss a005 Refusal REFUSED Miss a006 Timeline REFUSED Miss a007 Answer OTHER:problem-everything-sounds-equally-certain Miss a008 Agreement REFUSED Miss a009 Lens Anatomy Exact a010 Ladder Procession Exact a011 Hero REFUSED Miss a012 Anatomy REFUSED Miss n001 NONE REFUSED Miss n002 NONE REFUSED Miss n003 NONE REFUSED Miss n004 NONE REFUSED Miss n005 NONE REFUSED Miss n006 NONE REFUSED Miss n007 NONE REFUSED Miss n008 NONE REFUSED Miss n009 NONE Magnitude Miss n010 NONE REFUSED Miss n011 NONE REFUSED Miss n012 NONE REFUSED Miss
INSPECT THE SOURCE ↗ READ THE COMPLETE METHOD AND ANALYSIS ↗ TURN THE RECORD OVER / CONDITION A
The 2 thatdidn’t land. A headline rounds these away. A useful record opens them up. Missing output and a refusal on an ambiguous case are different failures.
C008 / CLEAR / NARRATIVE
“A short labelled paragraph noting that every warehouse we visited had rewritten the picking software's rules on paper, taped to the shelf.”
Expected Observation
Recorded selection MISSING No valid answer was recorded for this case. The missing output is counted as a miss, not silently discarded.
The deciding test: Naming the thing observed takes three words; the label is the form.
READ THE FROZEN CASE ↗ A007 / AMBIGUOUS / PRODUCT
“A model's answer, the passage it drew on, and the confidence it carries, on one page.”
Expected Answer (also accepted: Excerpt, Claim)
Recorded selection NONE An answer with its supporting passage and a confidence score matches no vocabulary form — it is neither the Evidence receipts row nor Provenance's publication record.
The deciding test: Answer if the reply leads; Excerpt if the source does; Claim if the confidence does.
READ THE FROZEN CASE ↗ THE ARTEFACT / BEFORE THE SCORE
The rule waswritten first. The following is a verbatim excerpt from the preregistration—not a reconstructed document or an image of one.
PREREGISTRATION.md / 2026-08-31 “CHOOSING-1 runs once, is published, and is frozen.” The preregistration commits to publishing failures and testing later changes on fresh material. It also records the central weakness: the cases and grammar share an author.
INSPECT THE ORIGINAL ARTEFACT ↗ What evidence exists for HAUSE? HAUSE publishes evaluations of form selection, question routing and what models learn from its website. These are scoped tests by the author, not proof of broad adoption. VINDEX3 and CHRISHAYUK demonstrate use in two publications by the same author; independent production reuse has not yet been established.
01 CHOOSING-1
Three selectors face the same unfamiliar content: names and descriptions, the full selection grammar, and the deployed deterministic resolver. Read the scores and the failure analysis together.
02 ROUTING-1
The same vocabulary is used to request different kinds of answers. This tests routing before retrieval or form selection.
03 ROUTING-2
A follow-up tests moving selection from keyword scaffolding to the choosing records. It separates unfamiliar questions from phrasings already encountered.
04 READING-1
Fresh model contexts read the public corpus and answer eight questions with sources. The record examines the understanding the site creates, including its omissions.
05 READING-2
Two sentences are added to the homepage and the reading exercise is repeated. The record follows whether the boundary travels, and which sources readers use.
THE NEXT RECORD IS NOT HERE YET
Chosen correctly is not the same asvaluable in practice. Independent production reuse is the next adoption proof point. It remains an open task, not an empty case study dressed as evidence.
PUBLISHED 6 SEP 2026 · REVISED 9 SEP 2026 · VERSION 1.0
CITE PLAIN BIBTEX APA CSL-JSON COPY
Hay, C. (2026). Evidence: evaluations, methods and limits (Version 1.0). hause.design. https://hause.design/evidence