Commit Graph
42 Commits
Author SHA1 Message Date
JinotechandClaude Opus 5 ab175ce253 build(stage1): populate the derived columns of the adjudication table
Fills reviewer_1_decision, reviewer_2_decision and conflict_reason for all 84
rows (252 cells) so adjudicators can work from one sheet. Every adjudicator
field stays blank: identity, date, final_*, notes and attestation are human
attestation and the script neither writes them nor overwrites existing values.

conflict_reason follows the validator's actual rule (decisions differ, or
reviewer_1 is not a plain approve) and states only the mechanical reason plus
both decisions - no interpretation. 63 rows differ, 21 agree but are not plain
approve, so all 84 require adjudication.

Adds a purpose-built script rather than fixing at the usual build source:
build_human_review_packets.py overwrites both signed reviewer CSVs with blank
templates at lines 39-40, so running it would destroy 84 rows of signed human
review. It was not run. The new script re-hashes both signed packets before and
after and exits FATAL if either changed.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-21 00:15:47 +12:00
JinotechandClaude Opus 5 71b0d7dd2a docs(progress): analyze the structure of the 63 discordant reviews
Read-only diagnostic. The 63 rows reduce to three systematic blocks, each a
single policy question rather than per-row judgment: YRBS numeric value-label
sourcing (27), GSHS population/mapping evidence (18), and language status
(18). Also records that YRBS 2023 Q27-Q29 can be closed from the local CDC
format program rather than adjudicated, and that the adjudication table's
three machine-derivable columns are still blank.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-21 00:03:12 +12:00
JinotechandClaude Opus 5 38f7268d8d docs(progress): record correction commit and push status
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-20 22:03:54 +12:00
JinotechandClaude Opus 5 21c7e211d0 fix(stage1): apply corrections both reviewers agreed on, downgrade unsourced status
Implements only what reviewer 1 and reviewer 2 independently and concordantly
required, at the build sources rather than in generated files:

- NSDUH 2022/2023/2024 YUSUITHK: strip the codebook editorial note about the
  2022 section move from question_text. It was never shown to respondents.
  The removed text is kept verbatim in notes.
- NSDUH 2021 YUSUITHK: drop the stray space before the final question mark.
- Solomon Islands items: review_status provisional -> needs_source. No country
  questionnaire, codebook or fact sheet ships under Dataset/; the only citation
  is the generic GSHS data dictionary. Keyed off the missing instrument, not
  hardcoded per country.

Also downgrades two design claims that A-20260920-067 verified as unsupported:
Jamaica and Wallis and Futuna report a census with a 100% school response rate
but carried the same Taylor-linearization plan as the two-stage cluster
samples. design_status becomes census_variance_treatment_unresolved and two
conflict records are added. variance_method itself is untouched - that is a
Stage 4 statistical decision needing its own evidence.

Deliberately not done: the instruction sentence missing from the 2021 stem is
left absent rather than written in, since that would be composing official
question text; and the 84 adjudications remain human work. Only 21 of 84 rows
are concordant, so 63 need adjudication.

84 item_version_id unchanged, response_dictionary byte-identical, both signed
reviewer CSVs unchanged. Gate 1 audit passes all seven machine deliverables and
stays blocked solely on two_actual_human_reviewers.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-20 22:03:41 +12:00
JinotechandClaude Opus 5 bf7bfb7a35 docs(progress): record rebuild commit and push status
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-20 21:49:47 +12:00
JinotechandClaude Opus 5 4c7f42bfe4 build(stage1): rebuild primary outcome package in the locked environment
Runs the four Stage 1 build scripts under .venv-research (python 3.12.14,
pandas 3.0.6, numpy 2.5.3, pyarrow 25.0.1, duckdb 1.5.5 - all matching
python-requirements.lock.txt), clearing the environment mismatch that halted
A-20260920-068. Brings generated artifacts back in line with the sources
corrected in 0c9645e.

Diff verified item by item: all 84 item_version_id unchanged, response
dictionary keys identical, and the only changes are the four authorized
corrections - YRBS 1995/1997 Louisiana exclusion, NSDUH attempt source
attribution and verification status, the five unattested inherited codes
marked needs_source, and the Morocco / Wallis and Futuna questionnaire
references switched to the stored text language.

Both signed reviewer CSVs are byte-identical before and after. Gate 1
acceptance audit still passes all seven machine deliverables and remains
blocked solely on two_actual_human_reviewers; Gate 1 stays in_progress.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-20 21:49:17 +12:00
JinotechandClaude Opus 5 b135c803a4 docs(progress): correct push status to pushed after successful retry
The first push attempt failed with an expired credential; retrying the same
command after committing the record succeeded. All seven pending commits are
now on origin/main and local is 0 ahead. Clears the push_pending status
carried by A-20260920-066/067/068.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-20 20:34:18 +12:00
JinotechandClaude Opus 5 96e03e3cce docs(progress): record push attempt blocked by credential expiry
Stage 1 remains in_progress. Remote git.jinome.org is reachable from the
Windows locked environment; the blocker is an expired GCM refresh token with
no access-token entry, and this session runs with GCM_INTERACTIVE=never, so
re-authorization must be done by the user. No credentials were read, modified
or cleared. Stale .git/index.lock and .git/refs/heads/.writetest from an
earlier crashed git process were removed and the index resynced with HEAD.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-20 20:33:47 +12:00
JinotechandClaude Opus 5 e4a3c65130 docs(progress): record Stage 1 rebuild halted on environment mismatch
A-20260920-068. Backup taken, no build script run, generated artefacts
untouched. This shell has Python 3.10.12 / pandas 2.3.3 and no pyarrow,
while the project pins Python 3.12.14 / pandas 3.0.6 / pyarrow 25.0.1;
pyarrow cannot be installed here (proxy 403) and .venv-research is a
Windows venv. Rebuilding under pandas 2.x would make the item bank and
response dictionary irreproducible against the recorded environment.

Records the exact commands to run in the pinned Windows environment and
the diff expected from the corrections in 0c9645e.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_016yuKikAXbByLvsUnh55SRd
2026-09-20 08:29:49 +00:00
JinotechandClaude Opus 5 7cf3c9334b docs(progress): record independent verification of signed reviews
A-20260920-067. All ten checkable claims in the reviewer 2 findings were
re-verified directly against local sources rather than against the
project audit trail, and all ten hold. Records the evidence per claim,
the three source-level corrections in 0c9645e, the verified findings
left uncorrected as out of scope this round, and push_pending.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_016yuKikAXbByLvsUnh55SRd
2026-09-20 08:25:12 +00:00
JinotechandClaude Opus 5 303471857f docs(progress): record review commit and pending push
Correct A-20260920-065, which stated the four human identity and
signature fields were empty; both reviewer packets were signed after
that entry was written.

Add A-20260920-066 covering this Git action: the 37-file CRLF flip
carried no content change and was neutralised with .gitattributes
rather than committed as 23k lines of noise; validator output is
recorded as failed on review_date format and outstanding adjudication.

Push status is push_pending, not pushed: git.jinome.org is unreachable
from both execution environments in this session (proxy returns HTTP
403 on CONNECT). No credentials were read or changed.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_016yuKikAXbByLvsUnh55SRd
2026-09-20 08:05:28 +00:00
Jinotech 27246a3d8a docs(progress): confirm review diagnostic push recovery 2026-09-20 16:42:36 +12:00
Jinotech cbe57fe2d4 docs(progress): record review diagnostic push failure 2026-09-20 16:42:18 +12:00
Jinotech 2c4012fa6d docs(stage1): record human reviewer attestation boundary 2026-09-20 16:42:00 +12:00
Jinotech 62ef74c055 docs(progress): record human review package push 2026-09-20 09:30:02 +12:00
Jinotech 8f5cbc9415 build(stage1): prepare independent human review 2026-09-20 09:29:44 +12:00
Jinotech d6bc303abf docs(progress): record design audit push 2026-09-20 09:24:34 +12:00
Jinotech 22d58f0d46 fix(stage1): verify survey design fields 2026-09-20 09:24:14 +12:00
Jinotech 9508c01b62 docs(progress): close response layer push 2026-09-20 09:12:37 +12:00
Jinotech 9497d1c3e5 docs(progress): record response layer push failure 2026-09-20 09:11:50 +12:00
Jinotech 89c20f32c7 build(stage1): create primary outcome response layer 2026-09-20 09:11:16 +12:00
Jinotech 2bc0062aef docs(progress): record YRBS import push 2026-09-20 09:05:06 +12:00
Jinotech a6df01da7e import(stage1): validate YRBS 2021 and 2023 layouts 2026-09-20 09:04:42 +12:00
Jinotech 64e05f42d0 docs(progress): record primary outcome package push 2026-09-20 08:59:27 +12:00
Jinotech f7e0dbbc22 build(stage1): create primary outcome review package 2026-09-20 08:58:52 +12:00
Jinotech c8dee9b8e8 docs(progress): record Solomon source push 2026-09-20 08:49:49 +12:00
Jinotech e5e301ef54 docs(stage1): source Solomon GSHS outcomes 2026-09-20 08:49:27 +12:00
Jinotech 300e2df619 docs(progress): record YRBS audit push 2026-09-20 08:46:17 +12:00
Jinotech a7ac525c2c fix(stage1): correct YRBS outcome mappings 2026-09-20 08:45:46 +12:00
Jinotech fecdb6d238 docs(progress): record GSHS audit push 2026-09-20 08:35:53 +12:00
Jinotech f0a4538242 feat(stage1): audit GSHS outcome components 2026-09-20 08:35:13 +12:00
Jinotech b86ab7eacf docs(progress): close NSDUH source audit push 2026-09-20 08:17:11 +12:00
Jinotech 7d50ae61ca feat(stage1): verify NSDUH youth attempt availability 2026-09-20 08:16:33 +12:00
Jinotech c84ff48688 docs(progress): close stage1 registry push 2026-09-20 08:07:36 +12:00
Jinotech ca67e1f744 docs(progress): record remote authentication failure 2026-09-20 08:06:36 +12:00
Jinotech fb30b60985 feat(stage1): register primary outcome candidates 2026-09-20 08:05:50 +12:00
Jinotech 5c31417935 feat(stage1): audit survey input structures 2026-09-20 07:18:51 +12:00
Jinotech f34add281f chore(git): finalize remote repository setup 2026-09-20 07:05:58 +12:00
Jinotech e162e64659 docs(progress): record remote creation login blocker 2026-09-20 07:00:48 +12:00
Jinotech be05fb053a chore(git): record remote push failure 2026-09-20 06:56:04 +12:00
Jinotech 26ec4ca7b9 docs(progress): estimate remaining research workload 2026-09-20 05:20:07 +12:00
Jinotech 1e7cc2a71b chore(repo): initialize reproducible research workspace 2026-09-20 05:17:11 +12:00