This note defines the measurement boundary for Fixture F-004. It operationalizes the versioned propose–challenge–decompose–prove–check–publish–invalidate lifecycle derived from the mathematical-practice audit. It is a shared benchmark contract for Candidates 004, 009, 010, 011, 014, 017, and 019.
Immutable identity envelope
Every episode starts with a sealed identity envelope
where identifies the episode; is the cryptographic hash of the exact problem statement; hashes its definitions and encodings; hashes the declared logic and semantics; hashes the admitted axioms; hashes the complete accessible library version; hashes the accessible corpus, retrieval index, and cutoff; hashes the checker, certificate calculus, and preprocessing reconstruction; and hashes the task-family generator and paired random seed. Every value is an immutable byte string. Hash equality establishes identity of registered bytes, not adequacy of the formalization or soundness of the implementation.
The accessible information record is
where each is a set of immutable artifact identifiers available through channel . The channels respectively cover training, prompt/context, retrieval, proof or tactic traces, evaluation feedback, and human hints or formalization. Availability is recorded independently of whether an artifact is retrieved or used.
Versioned lifecycle state
At event time in seconds from episode start, define
where is the set of open typed goals, is the queue of proposed operations, is the accessible immutable library view, is the set of examples and counterexamples, is the proof-and-dependency directed acyclic graph (DAG), is the set of proof, refutation, model, or test certificates, is the append-only event record, and is the typed publication state. The finite state space is
An event may transform the state only when its typed preconditions hold:
where is the versioned transition function and is the set
of admissible events in state . Tested records finite support only;
proved records acceptance of a derivation relative to ; refuted
requires an admissible counterexample or checked refutation; unknown preserves
timeouts, unsupported theories, and incomplete searches; disputed records an
unresolved challenge to formalization, assumptions, checking, or significance;
and retracted records invalidation or supersession without deleting history.
A published version is
where is the version hash, is the set of parent-version hashes, is the typed transformation, is the actor or process identifier, is the event time in seconds, is the state, is the evidence-and-certificate set, and is the measured cost record. A new version never overwrites its parents.
Proposals, tests, and counterexamples
Let be candidate proposition , its explicit definitions and parameters, its set of proof obligations, its declared source and transformation ancestry, and its proposal method. The proposal record is
For a universally quantified candidate , an exact counterexample is an element such that
is the declared admissible domain and is the encoded Boolean predicate. The counterexample record must prove or independently check both domain membership and predicate failure. Its size is measured under a preregistered task-native order; smallest-counterexample claims compare , not discovery time alone.
For a finite test multiset , empirical support is
where is the test count, is an indicator, and
is dimensionless. The record also names the generator,
distribution or enumeration boundary, random seed, arithmetic precision in
bits, and error interval in the predicate's native unit. Even
leaves the state tested unless a checked exhaustive reduction
or proof closes the universal obligation.
Abstraction obligations
Let be a concrete domain, an abstract domain, an abstraction map, and a concretization map. For a concrete property and abstract property , using the abstraction to prove requires the soundness obligation
When a claimed transfer also requires preservation of operation , declare an abstract operation and check
for the stated subset of . The equality is an exact semantic claim unless a typed approximation relation and tolerance are registered. Excluded cases, failed concretizations, reconstruction loss, and the human time used to choose are part of the result.
Decomposition and proof-DAG reconstruction
For target goal , let the proof DAG be
where is a set of goal, lemma, definition, axiom, or certificate nodes; contains directed dependency edges from a conclusion to each required premise; is the root node encoding ; and is the typed local reconstruction function stored for node . For each non-leaf node with dependency set , reconstruction requires
where is a checked artifact proving node and is the constructed artifact for node . Leaves must resolve to hashed axioms, definitions, admitted theorems, exact decision procedures, or independently checked certificates in .
Let be a topological ordering from leaves to root. Full-DAG reconstruction succeeds when every executes in that order and the independent checker accepts the resulting root artifact against and . A list of plausible lemmas, a cyclic graph, or individually checked children without a parent reconstruction function does not close .
Proof-dependency economy is reported, not assumed. If is the number of accessible library nodes and is the number in the root's transitive dependency closure, then
is a dimensionless dependency ratio. Smaller is useful only if reconstruction, robustness, and transfer remain non-inferior.
Generator, certificate, and checker separation
For instance bytes , generator , claimed verdict , certificate , preprocessing trace , and independent checker , acceptance is
where is the registered hash function and both indicator factors are dimensionless. Generator cannot set the checker's verdict. The identities, code lineage, parsers, libraries, axioms, hardware, and people shared by and are published as a shared-trust-root set ; process separation is not described as independent when contains the relevant possible fault.
For accepted artifact , record certificate size in
bytes, generation time in seconds, checking time
in seconds, checker peak memory
in bytes, and certificate lifecycle energy in joules.
An unsupported solver exit code or a certificate that does not bind the exact
instance and preprocessing trace cannot produce proved or refuted.
Leakage-safe task partitions
Let be the universe of theorem, proof, definition, example, counterexample, generated sibling, and source artifacts. Define a symmetric ancestor-related relation over that groups exact duplicates, renamings, restatements, specializations, isomorphic generated siblings, proof ancestors, and source-equivalent formalizations under the frozen detection protocol. Let denote the group containing artifact .
For training artifacts and confirmatory artifacts , the dependency-safe split condition is
Additionally, if is the transitive proof and library dependency closure of , require
unless the overlapping artifacts are explicitly declared as common premises available to every arm. Public benchmark queries, human corrections, and model updates after the split freeze are added to and disqualify the affected hidden family from confirmatory use.
Publication and reverse-dependency invalidation
Let the release dependency graph be , with edge meaning artifact depends on artifact . If changed or invalid artifact set is detected, its reverse-dependency invalidation set is
Every artifact in is quarantined from proved release
status until its exact version is rechecked or rebuilt against a replacement.
The prior record remains addressable and becomes retracted when its published
acceptance claim no longer holds; a challenge to formalization or significance
may instead enter disputed while the checked derivation remains recorded.
For planted invalidation set and submitted set , invalidation precision and recall are
Both are dimensionless; an empty submitted set receives zero precision and recall. Also report time to quarantine in seconds, stale artifact-hours before quarantine, rebuild time in seconds, repair human-hours, and recurrent bad acceptances after release.
Equal lifecycle budget
For method , the binding resource vector is
The first seven terms count training items, retrieval calls, proposals, tested instances, solver calls, checker calls, and search nodes. and are retained-state and certificate bytes; and are seconds; is person-hours; is joules at the declared measurement boundary; and is peak working memory in bytes.
Lifecycle energy is
with every term measured in joules across one declared hardware and facility boundary. Human formalization, steering, review, and repair remain person-hours and are not silently converted to joules. A method that exceeds any binding ceiling is infeasible for that paired instance; otherwise report a preregistered Pareto frontier rather than post-hoc cost normalization.
Outcome vector and component effects
For method , report
where the first five terms are artifact counts; is the dimensionless proportion of published proof DAGs reconstructed and rechecked from their retained dependencies; and are defined above; is seconds to the first checked result; is median certificate size in bytes; is person-hours; and is joules. Results are stratified by task family, state, and hidden regime rather than collapsed into a universal reasoning score.
Checked-result energy efficiency may be reported as
but only beside the full outcome vector, because a system can inflate with trivial tasks or low coverage. For component and outcome , the paired ablation effect is
where removes component without reallocating its unused budget. Report paired 95% uncertainty intervals over frozen problem-family and random- seed strata.
Contract retirement
The composed residual is retired when the strongest complete ordinary stack matches its checked closure, bad-acceptance rate, hidden-family transfer, proof-DAG reconstruction, invalidation quality, and lifecycle resource vector; when any gain disappears under ancestor- and dependency-safe splits; when counterexamples, abstraction obligations, certificates, or reverse-dependency events cannot be reconstructed independently; or when omitted formalization, review, checking, storage, repair, human-hour, or joule costs explain the gain.
Editable lifecycle diagram: versioned-proof-discovery-lifecycle.mmd.