GeneBench target identifiability
编译摘要
1. A reference target must be recoverable from the allowed evidence
GeneBench deliberately grades a realized-data quantity that an agent can recover from visible files, rather than an inaccessible hidden DGP parameter.
This gives a concrete target-identifiability rule:
authorized visible evidence
→ recoverable estimand
→ defensible reference2. Reference integrity includes admissible analytical variation
The benchmark accepts reasonable analysis variants while using ablations to reject paths that omit necessary correction or choose the wrong phenotype/estimand.
So reference truth is not match one hidden implementation.
3. Construction review is not run-level verification
Scientific, methodological and target-identifiability reviews validate benchmark construction. They do not provide an independent verdict for every agent trajectory.
4. 对标
- 对 Verifiable-Agent-Engineering：adds target identifiability before reference scoring.
- 对 scientific Agent evaluation：the grader must not demand a quantity that the provided data cannot identify.