fix(stage1): apply corrections both reviewers agreed on, downgrade unsourced status

Implements only what reviewer 1 and reviewer 2 independently and concordantly required, at the build sources rather than in generated files: - NSDUH 2022/2023/2024 YUSUITHK: strip the codebook editorial note about the 2022 section move from question_text. It was never shown to respondents. The removed text is kept verbatim in notes. - NSDUH 2021 YUSUITHK: drop the stray space before the final question mark. - Solomon Islands items: review_status provisional -> needs_source. No country questionnaire, codebook or fact sheet ships under Dataset/; the only citation is the generic GSHS data dictionary. Keyed off the missing instrument, not hardcoded per country. Also downgrades two design claims that A-20260920-067 verified as unsupported: Jamaica and Wallis and Futuna report a census with a 100% school response rate but carried the same Taylor-linearization plan as the two-stage cluster samples. design_status becomes census_variance_treatment_unresolved and two conflict records are added. variance_method itself is untouched - that is a Stage 4 statistical decision needing its own evidence. Deliberately not done: the instruction sentence missing from the 2021 stem is left absent rather than written in, since that would be composing official question text; and the 84 adjudications remain human work. Only 21 of 84 rows are concordant, so 63 need adjudication. 84 item_version_id unchanged, response_dictionary byte-identical, both signed reviewer CSVs unchanged. Gate 1 audit passes all seven machine deliverables and stays blocked solely on two_actual_human_reviewers. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-09-20 22:03:41 +12:00
parent bf7bfb7a35
commit 21c7e211d0
10 changed files with 153 additions and 29 deletions
@@ -24,6 +24,37 @@ def load_json(name: str) -> dict[str, Any]:
        return json.load(handle)


+# WHO GSHS fact sheets state a census was used for these two components
+# ("A census was used..." / "Un recensement a ete utilise..."), each with a 100%
+# school response rate. They currently carry the same weight/PSU/stratum fields
+# and Taylor-linearization plan as the two-stage cluster samples, which is not
+# established for a census. The fields are retained; the variance treatment is
+# marked unresolved rather than source-verified.
+GSHS_CENSUS_COMPONENTS = {
+    "JAM_2023_GSHS_v01::jam_st_cath_2023",
+    "WLF_2023_GSHS_v01::wlf_2023",
+}
+
+BASE_DESIGN_NOTE = (
+    "For all 21,533 respondents in the seven primary-outcome components, canonical "
+    "weight/PSU/stratum fields are complete, positive, and numerically identical to "
+    "raw_weight/raw_psu/raw_stratum. Namespace by component before pooling."
+)
+
+CENSUS_DESIGN_NOTE = (
+    " The WHO fact sheet for this component reports a census with a 100% school "
+    "response rate. Design-based variance under a census is not the same as under "
+    "the two-stage cluster samples, and no source establishes the Taylor "
+    "linearization plan here; resolve before any design-based variance estimate."
+)
+
+
+def gshs_design_note(component_id: str) -> str:
+    if component_id in GSHS_CENSUS_COMPONENTS:
+        return BASE_DESIGN_NOTE + CENSUS_DESIGN_NOTE
+    return BASE_DESIGN_NOTE
+
+
 def write_csv(name: str, rows: list[dict[str, Any]], fields: Iterable[str]) -> None:
    path = STAGE1 / name
    with path.open("w", encoding="utf-8-sig", newline="") as handle:
@@ -170,6 +201,10 @@ def build() -> dict[str, int]:
        )
        source_file = questionnaire.get("source_file", "") if questionnaire else ""
        source_url = "" if source_file else component.get("catalog_url", "")
+        # No country questionnaire, codebook or fact sheet ships for this component, so its
+        # only citation is the generic GSHS data dictionary. Both primary-outcome reviewers
+        # independently returned needs_source for all three of its items.
+        item_review_status = "provisional" if questionnaire else "needs_source"
        language = "; ".join(package.get("source_language_evidence") or []) or "source language not established"
        questions = package.get("question_numbers") or {}
        construct_to_q = {"suicide_ideation": questions.get("ideation"), "suicide_plan": questions.get("plan"), "suicide_attempt": questions.get("attempt")}
@@ -201,7 +236,7 @@ def build() -> dict[str, int]:
                "source_file": source_file or template.get("source_file"),
                "source_url": source_url or template.get("source_url"),
                "page_or_section": construct_to_q[construct] or template.get("page_or_section"),
-                "reviewer_1": "", "reviewer_2": "", "review_status": "provisional",
+                "reviewer_1": "", "reviewer_2": "", "review_status": item_review_status,
                "notes": "Raw administered item only; the raw_mh_b_* field is a derived/duplicate representation, not another administered item.",
            }, options, missing_row=True)
        conflicts.append({
@@ -215,14 +250,28 @@ def build() -> dict[str, int]:
            "analysis_consequence": "May be used for pipeline development, not confirmatory language comparison.",
            "status": "open", "reviewer_1": "", "reviewer_2": "",
        })
+        if component["component_id"] in GSHS_CENSUS_COMPONENTS:
+            conflicts.append({
+                "conflict_id": f"GSHS_CENSUS_DESIGN::{component['component_id']}",
+                "survey": "GSHS", "year": str(component.get("collection_start", ""))[:4],
+                "component_id": component["component_id"], "source_variable": "all_primary_outcomes",
+                "conflict_type": "design_treatment_not_established_for_census",
+                "source_a": component.get("catalog_url", ""),
+                "source_b": "WHO GSHS country fact sheet (census statement, 100% school response rate)",
+                "description": "The fact sheet reports a census, but weight/PSU/stratum handling and the Taylor linearization plan are recorded identically to the two-stage cluster-sample components.",
+                "resolution": "unresolved; design_status downgraded to census_variance_treatment_unresolved pending a source-based variance decision",
+                "analysis_consequence": "Exclude from design-based variance estimates until resolved; descriptive use must state the census basis.",
+                "status": "open", "reviewer_1": "", "reviewer_2": "",
+            })
        designs.append({
            "survey_id": survey_id, "component_id": component["component_id"], "survey": "GSHS",
            "country": component.get("country", ""), "year": str(component.get("collection_start", ""))[:4],
            "population": component.get("population", ""), "weight_field": "sample_weight", "psu_field": "sampling_psu",
            "stratum_field": "sampling_stratum", "variance_method": "complex-survey design using weight, stratum, and PSU; Taylor linearization planned",
            "namespace_rule": "prefix PSU and stratum with component_id before pooling",
-            "design_source": f"{component.get('catalog_url', '')}; WHO GSHS methodology and data catalog", "design_status": "source_verified_fields",
-            "notes": "For all 21,533 respondents in the seven primary-outcome components, canonical weight/PSU/stratum fields are complete, positive, and numerically identical to raw_weight/raw_psu/raw_stratum. Namespace by component before pooling.",
+            "design_source": f"{component.get('catalog_url', '')}; WHO GSHS methodology and data catalog",
+            "design_status": "census_variance_treatment_unresolved" if component["component_id"] in GSHS_CENSUS_COMPONENTS else "source_verified_fields",
+            "notes": gshs_design_note(component["component_id"]),
            "review_status": "provisional",
        })

@@ -8,6 +8,7 @@ from __future__ import annotations

 import html
 import json
+import re
 from collections import Counter
 from pathlib import Path

@@ -73,6 +74,28 @@ def clean_text(value: object) -> str:
    return html.unescape(str(value or "")).strip()


+# The DAS variable dictionary prefixes some youth suicide items with a codebook
+# editorial note about section moves. That note was never shown to respondents,
+# so it is stripped from question_text and kept separately. Both primary-outcome
+# reviewers issued approve_with_correction requiring this removal.
+CODEBOOK_NOTE = re.compile(
+    r"^(Note:\s*Beginning in \d{4},.*?were moved from the youth mental health "
+    r"service utilization section to the youth experiences section\.)\s*"
+)
+
+
+def split_codebook_note(text: str) -> tuple[str, str | None]:
+    match = CODEBOOK_NOTE.match(text)
+    if not match:
+        return text, None
+    return text[match.end():].strip(), match.group(1)
+
+
+def normalize_stem_spacing(text: str) -> str:
+    """Drop the stray space the DAS rendering leaves before a final '?'."""
+    return re.sub(r"\s+\?$", "?", text)
+
+
 def parse_json_object(value: object) -> object:
    text = clean_text(value)
    if not text:
@@ -187,6 +210,8 @@ def build_nsduh() -> tuple[list[dict], list[dict], list[dict]]:

    def common(row: dict, construct: str, record_type: str) -> dict:
        variable = row["variable"]
+        stem, codebook_note = split_codebook_note(clean_text(row["original_question_or_definition"]))
+        stem = normalize_stem_spacing(stem)
        return {
            "survey": "NSDUH",
            "year": int(row["year"]),
@@ -195,7 +220,8 @@ def build_nsduh() -> tuple[list[dict], list[dict], list[dict]]:
            "record_type": record_type,
            "population": "youth module; exact age/eligibility and skip logic pending codebook review",
            "time_window": "past 12 months",
-            "question_text": clean_text(row["original_question_or_definition"]) or None,
+            "question_text": stem or None,
+            "codebook_note_removed": codebook_note,
            "source_label": clean_text(row["official_title"]),
            "source_file": str(source.relative_to(ROOT)).replace("\\", "/"),
            "source_url": clean_text(row["official_source"]),
@@ -211,7 +237,13 @@ def build_nsduh() -> tuple[list[dict], list[dict], list[dict]]:

    for row in frame[frame["variable"].isin(NSDUH_YOUTH_RAW)].to_dict("records"):
        item = common(row, NSDUH_YOUTH_RAW[row["variable"]], "raw_candidate")
-        item["notes"] = "Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified."
+        note = "Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified."
+        if item.get("codebook_note_removed"):
+            note += (
+                " A codebook editorial note about the 2022 section move was removed from"
+                f" question_text and is retained here verbatim: {item['codebook_note_removed']}"
+            )
+        item["notes"] = note
        raw_records.append(item)

    for year, source_url in NSDUH_ATTEMPT_SOURCES.items():
@@ -29,8 +29,8 @@
    },
    "source_conflicts": {
      "passed": true,
-      "rows": 32,
-      "open": 11
+      "rows": 34,
+      "open": 13
    },
    "two_actual_human_reviewers": {
      "passed": false,
@@ -14,9 +14,9 @@ GSHS::JAM_2023_GSHS_v01::jam_st_cath_2023::raw_mh_attemptsui,GSHS::suicide_attem
 GSHS::MNG_2023_GSHS_v01::mng2023::raw_mh_considersui,GSHS::suicide_ideation::past_12_months,GSHS::MNG_2023_GSHS_v01,MNG_2023_GSHS_v01::mng2023,GSHS,Mongolia,2023,national,school-attending students; exact sampled ages/grades remain pending component source review,raw_mh_considersui,"During the past 12 months, did you seriously consider attempting suicide?",32ff301e6e09c2a1a19632bafd61441229513d9f8b828d6e92e0918e0580df46,suicide_ideation,past 12 months,binary,English; Mongolian; actual administered language not established,MNG_2023_GSHS_v01,available_in_local_component,provisional_pipeline_development_only,Dataset/GSHS-全球学生健康调查数据/GSHS/Questionnaire/GSHS Per Country/Mongolia 2023/Mongolia-GSHS-Questionnaire-ENGLISH.docx,,Q36,,,provisional,"Raw administered item only; the raw_mh_b_* field is a derived/duplicate representation, not another administered item."
 GSHS::MNG_2023_GSHS_v01::mng2023::raw_mh_plansui,GSHS::suicide_plan::past_12_months,GSHS::MNG_2023_GSHS_v01,MNG_2023_GSHS_v01::mng2023,GSHS,Mongolia,2023,national,school-attending students; exact sampled ages/grades remain pending component source review,raw_mh_plansui,"During the past 12 months, did you make a plan about how you would attempt suicide?",f29777fd4c84bd3678e8a8e4ce69ee7e8ef49e0566c9ad5cf859e5e501ab0505,suicide_plan,past 12 months,binary,English; Mongolian; actual administered language not established,MNG_2023_GSHS_v01,available_in_local_component,provisional_pipeline_development_only,Dataset/GSHS-全球学生健康调查数据/GSHS/Questionnaire/GSHS Per Country/Mongolia 2023/Mongolia-GSHS-Questionnaire-ENGLISH.docx,,Q37,,,provisional,"Raw administered item only; the raw_mh_b_* field is a derived/duplicate representation, not another administered item."
 GSHS::MNG_2023_GSHS_v01::mng2023::raw_mh_attemptsui,GSHS::suicide_attempt::past_12_months,GSHS::MNG_2023_GSHS_v01,MNG_2023_GSHS_v01::mng2023,GSHS,Mongolia,2023,national,school-attending students; exact sampled ages/grades remain pending component source review,raw_mh_attemptsui,"During the past 12 months, how many times did you attempt suicide?",490c698e57394e23acab27853ed35a385a3999b92694015bcd0e940542b30f07,suicide_attempt,past 12 months,ordinal_frequency,English; Mongolian; actual administered language not established,MNG_2023_GSHS_v01,available_in_local_component,provisional_pipeline_development_only,Dataset/GSHS-全球学生健康调查数据/GSHS/Questionnaire/GSHS Per Country/Mongolia 2023/Mongolia-GSHS-Questionnaire-ENGLISH.docx,,Q38,,,provisional,"Raw administered item only; the raw_mh_b_* field is a derived/duplicate representation, not another administered item."
-GSHS::SLB_2023_GSHS_v01::slb_2023::raw_mh_considersui,GSHS::suicide_ideation::past_12_months,GSHS::SLB_2023_GSHS_v01,SLB_2023_GSHS_v01::slb_2023,GSHS,Solomon Islands,2023,component,school-going adolescents aged 13-17 years; Form 1-Form 6; all students in selected classes eligible,raw_mh_considersui,"During the past 12 months, did you seriously consider attempting suicide?",32ff301e6e09c2a1a19632bafd61441229513d9f8b828d6e92e0918e0580df46,suicide_ideation,past 12 months,binary,English catalog literal-question metadata; actual administered language not established,SLB_2023_GSHS_v01,available_in_local_component,provisional_pipeline_development_only,Dataset/GSHS-全球学生健康调查数据/GSHS/02_documentation/GSHS_数据字典.xlsx,https://extranet.who.int/ncdsmicrodata/index.php/catalog/992,Master_Columns plus component-specific questionnaire/codebook references in component audit,,,provisional,"Raw administered item only; the raw_mh_b_* field is a derived/duplicate representation, not another administered item."
-GSHS::SLB_2023_GSHS_v01::slb_2023::raw_mh_plansui,GSHS::suicide_plan::past_12_months,GSHS::SLB_2023_GSHS_v01,SLB_2023_GSHS_v01::slb_2023,GSHS,Solomon Islands,2023,component,school-going adolescents aged 13-17 years; Form 1-Form 6; all students in selected classes eligible,raw_mh_plansui,"During the past 12 months, did you make a plan about how you would attempt suicide?",f29777fd4c84bd3678e8a8e4ce69ee7e8ef49e0566c9ad5cf859e5e501ab0505,suicide_plan,past 12 months,binary,English catalog literal-question metadata; actual administered language not established,SLB_2023_GSHS_v01,available_in_local_component,provisional_pipeline_development_only,Dataset/GSHS-全球学生健康调查数据/GSHS/02_documentation/GSHS_数据字典.xlsx,https://extranet.who.int/ncdsmicrodata/index.php/catalog/992,Master_Columns plus component-specific questionnaire/codebook references in component audit,,,provisional,"Raw administered item only; the raw_mh_b_* field is a derived/duplicate representation, not another administered item."
-GSHS::SLB_2023_GSHS_v01::slb_2023::raw_mh_attemptsui,GSHS::suicide_attempt::past_12_months,GSHS::SLB_2023_GSHS_v01,SLB_2023_GSHS_v01::slb_2023,GSHS,Solomon Islands,2023,component,school-going adolescents aged 13-17 years; Form 1-Form 6; all students in selected classes eligible,raw_mh_attemptsui,"During the past 12 months, how many times did you attempt suicide?",490c698e57394e23acab27853ed35a385a3999b92694015bcd0e940542b30f07,suicide_attempt,past 12 months,ordinal_frequency,English catalog literal-question metadata; actual administered language not established,SLB_2023_GSHS_v01,available_in_local_component,provisional_pipeline_development_only,Dataset/GSHS-全球学生健康调查数据/GSHS/02_documentation/GSHS_数据字典.xlsx,https://extranet.who.int/ncdsmicrodata/index.php/catalog/992,Master_Columns plus component-specific questionnaire/codebook references in component audit,,,provisional,"Raw administered item only; the raw_mh_b_* field is a derived/duplicate representation, not another administered item."
+GSHS::SLB_2023_GSHS_v01::slb_2023::raw_mh_considersui,GSHS::suicide_ideation::past_12_months,GSHS::SLB_2023_GSHS_v01,SLB_2023_GSHS_v01::slb_2023,GSHS,Solomon Islands,2023,component,school-going adolescents aged 13-17 years; Form 1-Form 6; all students in selected classes eligible,raw_mh_considersui,"During the past 12 months, did you seriously consider attempting suicide?",32ff301e6e09c2a1a19632bafd61441229513d9f8b828d6e92e0918e0580df46,suicide_ideation,past 12 months,binary,English catalog literal-question metadata; actual administered language not established,SLB_2023_GSHS_v01,available_in_local_component,provisional_pipeline_development_only,Dataset/GSHS-全球学生健康调查数据/GSHS/02_documentation/GSHS_数据字典.xlsx,https://extranet.who.int/ncdsmicrodata/index.php/catalog/992,Master_Columns plus component-specific questionnaire/codebook references in component audit,,,needs_source,"Raw administered item only; the raw_mh_b_* field is a derived/duplicate representation, not another administered item."
+GSHS::SLB_2023_GSHS_v01::slb_2023::raw_mh_plansui,GSHS::suicide_plan::past_12_months,GSHS::SLB_2023_GSHS_v01,SLB_2023_GSHS_v01::slb_2023,GSHS,Solomon Islands,2023,component,school-going adolescents aged 13-17 years; Form 1-Form 6; all students in selected classes eligible,raw_mh_plansui,"During the past 12 months, did you make a plan about how you would attempt suicide?",f29777fd4c84bd3678e8a8e4ce69ee7e8ef49e0566c9ad5cf859e5e501ab0505,suicide_plan,past 12 months,binary,English catalog literal-question metadata; actual administered language not established,SLB_2023_GSHS_v01,available_in_local_component,provisional_pipeline_development_only,Dataset/GSHS-全球学生健康调查数据/GSHS/02_documentation/GSHS_数据字典.xlsx,https://extranet.who.int/ncdsmicrodata/index.php/catalog/992,Master_Columns plus component-specific questionnaire/codebook references in component audit,,,needs_source,"Raw administered item only; the raw_mh_b_* field is a derived/duplicate representation, not another administered item."
+GSHS::SLB_2023_GSHS_v01::slb_2023::raw_mh_attemptsui,GSHS::suicide_attempt::past_12_months,GSHS::SLB_2023_GSHS_v01,SLB_2023_GSHS_v01::slb_2023,GSHS,Solomon Islands,2023,component,school-going adolescents aged 13-17 years; Form 1-Form 6; all students in selected classes eligible,raw_mh_attemptsui,"During the past 12 months, how many times did you attempt suicide?",490c698e57394e23acab27853ed35a385a3999b92694015bcd0e940542b30f07,suicide_attempt,past 12 months,ordinal_frequency,English catalog literal-question metadata; actual administered language not established,SLB_2023_GSHS_v01,available_in_local_component,provisional_pipeline_development_only,Dataset/GSHS-全球学生健康调查数据/GSHS/02_documentation/GSHS_数据字典.xlsx,https://extranet.who.int/ncdsmicrodata/index.php/catalog/992,Master_Columns plus component-specific questionnaire/codebook references in component audit,,,needs_source,"Raw administered item only; the raw_mh_b_* field is a derived/duplicate representation, not another administered item."
 GSHS::WLF_2023_GSHS_v01::wlf_2023::raw_mh_considersui,GSHS::suicide_ideation::past_12_months,GSHS::WLF_2023_GSHS_v01,WLF_2023_GSHS_v01::wlf_2023,GSHS,Wallis and Futuna,2023,national,school-attending students; exact sampled ages/grades remain pending component source review,raw_mh_considersui,"During the past 12 months, did you seriously consider attempting suicide?",32ff301e6e09c2a1a19632bafd61441229513d9f8b828d6e92e0918e0580df46,suicide_ideation,past 12 months,binary,French; English reference; actual administered language not established,WLF_2023_GSHS_v01,available_in_local_component,provisional_pipeline_development_only,Dataset/GSHS-全球学生健康调查数据/GSHS/Questionnaire/GSHS Per Country/Wallis and Futuna 2023/Wallis and Futuna - GSHS Questionnaire - Final - English.docx,,Q29,,,provisional,"Raw administered item only; the raw_mh_b_* field is a derived/duplicate representation, not another administered item."
 GSHS::WLF_2023_GSHS_v01::wlf_2023::raw_mh_plansui,GSHS::suicide_plan::past_12_months,GSHS::WLF_2023_GSHS_v01,WLF_2023_GSHS_v01::wlf_2023,GSHS,Wallis and Futuna,2023,national,school-attending students; exact sampled ages/grades remain pending component source review,raw_mh_plansui,"During the past 12 months, did you make a plan about how you would attempt suicide?",f29777fd4c84bd3678e8a8e4ce69ee7e8ef49e0566c9ad5cf859e5e501ab0505,suicide_plan,past 12 months,binary,French; English reference; actual administered language not established,WLF_2023_GSHS_v01,available_in_local_component,provisional_pipeline_development_only,Dataset/GSHS-全球学生健康调查数据/GSHS/Questionnaire/GSHS Per Country/Wallis and Futuna 2023/Wallis and Futuna - GSHS Questionnaire - Final - English.docx,,Q30,,,provisional,"Raw administered item only; the raw_mh_b_* field is a derived/duplicate representation, not another administered item."
 GSHS::WLF_2023_GSHS_v01::wlf_2023::raw_mh_attemptsui,GSHS::suicide_attempt::past_12_months,GSHS::WLF_2023_GSHS_v01,WLF_2023_GSHS_v01::wlf_2023,GSHS,Wallis and Futuna,2023,national,school-attending students; exact sampled ages/grades remain pending component source review,raw_mh_attemptsui,"During the past 12 months, how many times did you attempt suicide?",490c698e57394e23acab27853ed35a385a3999b92694015bcd0e940542b30f07,suicide_attempt,past 12 months,ordinal_frequency,French; English reference; actual administered language not established,WLF_2023_GSHS_v01,available_in_local_component,provisional_pipeline_development_only,Dataset/GSHS-全球学生健康调查数据/GSHS/Questionnaire/GSHS Per Country/Wallis and Futuna 2023/Wallis and Futuna - GSHS Questionnaire - Final - English.docx,,Q31,,,provisional,"Raw administered item only; the raw_mh_b_* field is a derived/duplicate representation, not another administered item."
@@ -71,13 +71,13 @@ YRBS::2021::Q28,YRBS::suicide_attempt::past_12_months,YRBS::2021,YRBS_NATIONAL::
 YRBS::2023::Q27,YRBS::suicide_ideation::past_12_months,YRBS::2023,YRBS_NATIONAL::2023,YRBS,United States,2023,national,students in grades 9-12 attending public and private schools in the United States; detailed eligibility remains subject to annual design review,Q27,"During the past 12 months, did you ever seriously consider attempting suicide?",0b2df6b623cc9cd5521af275980c1b6a582eca3a15b67906ec05e822b0a67973,suicide_ideation,past 12 months,binary,English questionnaire source; actual accommodation/language coverage not established by this audit,YRBS national questionnaire 2023,available_full_table,provisional_pipeline_development_only,Dataset/YRBS_National_1991_2023/documentation/Questionnaire/2023_YRBS_National_HS_Questionnaire.pdf,,page 9; data guide page 29,,,provisional,blank/null retained as unresolved missing; annual guide reports Missing but does not distinguish reason
 YRBS::2023::Q28,YRBS::suicide_plan::past_12_months,YRBS::2023,YRBS_NATIONAL::2023,YRBS,United States,2023,national,students in grades 9-12 attending public and private schools in the United States; detailed eligibility remains subject to annual design review,Q28,"During the past 12 months, did you make a plan about how you would attempt suicide?",f29777fd4c84bd3678e8a8e4ce69ee7e8ef49e0566c9ad5cf859e5e501ab0505,suicide_plan,past 12 months,binary,English questionnaire source; actual accommodation/language coverage not established by this audit,YRBS national questionnaire 2023,available_full_table,provisional_pipeline_development_only,Dataset/YRBS_National_1991_2023/documentation/Questionnaire/2023_YRBS_National_HS_Questionnaire.pdf,,page 9; data guide page 29,,,provisional,blank/null retained as unresolved missing; annual guide reports Missing but does not distinguish reason
 YRBS::2023::Q29,YRBS::suicide_attempt::past_12_months,YRBS::2023,YRBS_NATIONAL::2023,YRBS,United States,2023,national,students in grades 9-12 attending public and private schools in the United States; detailed eligibility remains subject to annual design review,Q29,"During the past 12 months, how many times did you actually attempt suicide?",99ac037649ef18c5d98cfef87c554969bb89198e79635ffabdca871818c07d03,suicide_attempt,past 12 months,ordinal_frequency,English questionnaire source; actual accommodation/language coverage not established by this audit,YRBS national questionnaire 2023,available_full_table,provisional_pipeline_development_only,Dataset/YRBS_National_1991_2023/documentation/Questionnaire/2023_YRBS_National_HS_Questionnaire.pdf,,page 9; data guide page 29,,,provisional,blank/null retained as unresolved missing; annual guide reports Missing but does not distinguish reason
-NSDUH::2021::YUSUITHK,NSDUH::suicide_ideation::past_12_months,NSDUH::2021,NSDUH_YOUTH::2021,NSDUH,United States,2021,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUITHK,"The next few questions are about thoughts of suicide. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself ?",655dea94026d96937a368ed77fad63361078c7fecfcc1cd0bee8ae3b62cb8267,suicide_ideation,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2021 youth module,available_in_local_public_use_table,provisional_pipeline_development_only,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2021-DS0001/?format=json,YUSUITHK,,,provisional,Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified.
+NSDUH::2021::YUSUITHK,NSDUH::suicide_ideation::past_12_months,NSDUH::2021,NSDUH_YOUTH::2021,NSDUH,United States,2021,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUITHK,"The next few questions are about thoughts of suicide. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",7276c7765534b68690a1ba14199a28064b7be26f0463f4e26336b2b99a612841,suicide_ideation,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2021 youth module,available_in_local_public_use_table,provisional_pipeline_development_only,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2021-DS0001/?format=json,YUSUITHK,,,provisional,Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified.
 NSDUH::2021::YUSUIPLN,NSDUH::suicide_plan::past_12_months,NSDUH::2021,NSDUH_YOUTH::2021,NSDUH,United States,2021,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUIPLN,"During the past 12 months, did you make any plans to kill yourself?",66e41d31c31186b2c4804776d2c0d867ec70fb71113001338680724e9aef05d1,suicide_plan,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2021 youth module,available_in_local_public_use_table,provisional_pipeline_development_only,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2021-DS0001/?format=json,YUSUIPLN,,,provisional,Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified.
-NSDUH::2022::YUSUITHK,NSDUH::suicide_ideation::past_12_months,NSDUH::2022,NSDUH_YOUTH::2022,NSDUH,United States,2022,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUITHK,"Note: Beginning in 2022, questions YSUI01, YCOV9, YSUI02, YCOV10, YSUI03, YCOV11, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section. The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",2e47c89fadeeb1ba172a1c3f701e18bbd0f9918dfd3042bb133777e39c9d6bf5,suicide_ideation,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2022 youth module,available_in_local_public_use_table,provisional_pipeline_development_only,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2022-DS0001/?format=json,YUSUITHK,,,provisional,Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified.
+NSDUH::2022::YUSUITHK,NSDUH::suicide_ideation::past_12_months,NSDUH::2022,NSDUH_YOUTH::2022,NSDUH,United States,2022,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUITHK,"The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",5a5ea936e3209b50b0f6f6b0d502f3c2c791b096870a05231f554b2b96f978da,suicide_ideation,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2022 youth module,available_in_local_public_use_table,provisional_pipeline_development_only,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2022-DS0001/?format=json,YUSUITHK,,,provisional,"Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified. A codebook editorial note about the 2022 section move was removed from question_text and is retained here verbatim: Note: Beginning in 2022, questions YSUI01, YCOV9, YSUI02, YCOV10, YSUI03, YCOV11, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section."
 NSDUH::2022::YUSUIPLN,NSDUH::suicide_plan::past_12_months,NSDUH::2022,NSDUH_YOUTH::2022,NSDUH,United States,2022,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUIPLN,"During the past 12 months, did you make any plans to kill yourself?",66e41d31c31186b2c4804776d2c0d867ec70fb71113001338680724e9aef05d1,suicide_plan,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2022 youth module,available_in_local_public_use_table,provisional_pipeline_development_only,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2022-DS0001/?format=json,YUSUIPLN,,,provisional,Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified.
-NSDUH::2023::YUSUITHK,NSDUH::suicide_ideation::past_12_months,NSDUH::2023,NSDUH_YOUTH::2023,NSDUH,United States,2023,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUITHK,"Note: Beginning in 2022, questions YSUI01, YCOV9, YSUI02, YCOV10, YSUI03, YCOV11, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section. The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",2e47c89fadeeb1ba172a1c3f701e18bbd0f9918dfd3042bb133777e39c9d6bf5,suicide_ideation,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2023 youth module,available_in_local_public_use_table,provisional_pipeline_development_only,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2023-DS0001/?format=json,YUSUITHK,,,provisional,Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified.
+NSDUH::2023::YUSUITHK,NSDUH::suicide_ideation::past_12_months,NSDUH::2023,NSDUH_YOUTH::2023,NSDUH,United States,2023,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUITHK,"The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",5a5ea936e3209b50b0f6f6b0d502f3c2c791b096870a05231f554b2b96f978da,suicide_ideation,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2023 youth module,available_in_local_public_use_table,provisional_pipeline_development_only,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2023-DS0001/?format=json,YUSUITHK,,,provisional,"Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified. A codebook editorial note about the 2022 section move was removed from question_text and is retained here verbatim: Note: Beginning in 2022, questions YSUI01, YCOV9, YSUI02, YCOV10, YSUI03, YCOV11, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section."
 NSDUH::2023::YUSUIPLN,NSDUH::suicide_plan::past_12_months,NSDUH::2023,NSDUH_YOUTH::2023,NSDUH,United States,2023,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUIPLN,"During the past 12 months, did you make any plans to kill yourself?",66e41d31c31186b2c4804776d2c0d867ec70fb71113001338680724e9aef05d1,suicide_plan,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2023 youth module,available_in_local_public_use_table,provisional_pipeline_development_only,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2023-DS0001/?format=json,YUSUIPLN,,,provisional,Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified.
-NSDUH::2024::YUSUITHK,NSDUH::suicide_ideation::past_12_months,NSDUH::2024,NSDUH_YOUTH::2024,NSDUH,United States,2024,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUITHK,"Note: Beginning in 2022, questions YSUI01, YSUI02, YSUI03, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section. The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",7a688bc54040f6ff682b5b8194237060f829dc16cf91cf448865a76d7d7c3100,suicide_ideation,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2024 youth module,available_in_local_public_use_table,provisional_pipeline_development_only,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2024-DS0001/?format=json,YUSUITHK,,,provisional,Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified.
+NSDUH::2024::YUSUITHK,NSDUH::suicide_ideation::past_12_months,NSDUH::2024,NSDUH_YOUTH::2024,NSDUH,United States,2024,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUITHK,"The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",5a5ea936e3209b50b0f6f6b0d502f3c2c791b096870a05231f554b2b96f978da,suicide_ideation,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2024 youth module,available_in_local_public_use_table,provisional_pipeline_development_only,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2024-DS0001/?format=json,YUSUITHK,,,provisional,"Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified. A codebook editorial note about the 2022 section move was removed from question_text and is retained here verbatim: Note: Beginning in 2022, questions YSUI01, YSUI02, YSUI03, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section."
 NSDUH::2024::YUSUIPLN,NSDUH::suicide_plan::past_12_months,NSDUH::2024,NSDUH_YOUTH::2024,NSDUH,United States,2024,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUIPLN,"During the past 12 months, did you make any plans to kill yourself?",66e41d31c31186b2c4804776d2c0d867ec70fb71113001338680724e9aef05d1,suicide_plan,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2024 youth module,available_in_local_public_use_table,provisional_pipeline_development_only,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2024-DS0001/?format=json,YUSUIPLN,,,provisional,Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified.
 NSDUH::2021::YUSUICTRY,NSDUH::suicide_attempt::past_12_months,NSDUH::2021,NSDUH_YOUTH::2021,NSDUH,United States,2021,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUICTRY,"During the past 12 months, did you try to kill yourself?",f870f158cf7b2a15b314ea5a07674ea5e3ca14a2155652cddb7f2f50806666e8,suicide_attempt,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2021 youth module,administered_but_not_available_in_local_public_use_package,not_analyzable_without_authorized_source,Dataset/NSDUH/2021NSDUHMRBWebSpecs101422.pdf,https://www.samhsa.gov/data/sites/default/files/2021-09/NSDUHRDCCodebook2021.pdf,YSUI03,,,provisional,"Asked of all adolescents aged 12-17, regardless of ideation response, per the local MRB specification. Codes 85/94/97/98/99 are inherited from YUSUITHK and unattested for this variable. Current local public-use schema omits the raw and recoded attempt variables; this row is not analyzable without an authorized source."
 NSDUH::2022::YUSUICTRY,NSDUH::suicide_attempt::past_12_months,NSDUH::2022,NSDUH_YOUTH::2022,NSDUH,United States,2022,national household survey youth module,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,YUSUICTRY,"During the past 12 months, did you try to kill yourself?",f870f158cf7b2a15b314ea5a07674ea5e3ca14a2155652cddb7f2f50806666e8,suicide_attempt,past 12 months,categorical_binary_with_explicit_uncertainty,English source metadata; administered-language/accommodation coverage not established,NSDUH 2022 youth module,administered_but_not_available_in_local_public_use_package,not_analyzable_without_authorized_source,Dataset/NSDUH/2022NSDUHmrbCAISpecs070722.pdf,https://www.samhsa.gov/data/sites/default/files/NSDUH-RDC/NSDUHRDCCodebook2022.pdf,YSUI03,,,provisional,"Asked of all adolescents aged 12-17, regardless of ideation response, per the local MRB specification. Codes 85/94/97/98/99 are inherited from YUSUITHK and unattested for this variable. Current local public-use schema omits the raw and recoded attempt variables; this row is not analyzable without an authorized source."
@@ -71,13 +71,13 @@ YRBS::2021::Q28,YRBS,YRBS_NATIONAL::2021,suicide_attempt,"During the past 12 mon
 YRBS::2023::Q27,YRBS,YRBS_NATIONAL::2023,suicide_ideation,"During the past 12 months, did you ever seriously consider attempting suicide?",3,students in grades 9-12 attending public and private schools in the United States; detailed eligibility remains subject to annual design review,English questionnaire source; actual accommodation/language coverage not established by this audit,Dataset/YRBS_National_1991_2023/documentation/Questionnaire/2023_YRBS_National_HS_Questionnaire.pdf,,page 9; data guide page 29,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
 YRBS::2023::Q28,YRBS,YRBS_NATIONAL::2023,suicide_plan,"During the past 12 months, did you make a plan about how you would attempt suicide?",3,students in grades 9-12 attending public and private schools in the United States; detailed eligibility remains subject to annual design review,English questionnaire source; actual accommodation/language coverage not established by this audit,Dataset/YRBS_National_1991_2023/documentation/Questionnaire/2023_YRBS_National_HS_Questionnaire.pdf,,page 9; data guide page 29,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
 YRBS::2023::Q29,YRBS,YRBS_NATIONAL::2023,suicide_attempt,"During the past 12 months, how many times did you actually attempt suicide?",6,students in grades 9-12 attending public and private schools in the United States; detailed eligibility remains subject to annual design review,English questionnaire source; actual accommodation/language coverage not established by this audit,Dataset/YRBS_National_1991_2023/documentation/Questionnaire/2023_YRBS_National_HS_Questionnaire.pdf,,page 9; data guide page 29,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
-NSDUH::2021::YUSUITHK,NSDUH,NSDUH_YOUTH::2021,suicide_ideation,"The next few questions are about thoughts of suicide. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself ?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2021-DS0001/?format=json,YUSUITHK,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
+NSDUH::2021::YUSUITHK,NSDUH,NSDUH_YOUTH::2021,suicide_ideation,"The next few questions are about thoughts of suicide. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2021-DS0001/?format=json,YUSUITHK,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
 NSDUH::2021::YUSUIPLN,NSDUH,NSDUH_YOUTH::2021,suicide_plan,"During the past 12 months, did you make any plans to kill yourself?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2021-DS0001/?format=json,YUSUIPLN,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
-NSDUH::2022::YUSUITHK,NSDUH,NSDUH_YOUTH::2022,suicide_ideation,"Note: Beginning in 2022, questions YSUI01, YCOV9, YSUI02, YCOV10, YSUI03, YCOV11, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section. The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2022-DS0001/?format=json,YUSUITHK,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
+NSDUH::2022::YUSUITHK,NSDUH,NSDUH_YOUTH::2022,suicide_ideation,"The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2022-DS0001/?format=json,YUSUITHK,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
 NSDUH::2022::YUSUIPLN,NSDUH,NSDUH_YOUTH::2022,suicide_plan,"During the past 12 months, did you make any plans to kill yourself?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2022-DS0001/?format=json,YUSUIPLN,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
-NSDUH::2023::YUSUITHK,NSDUH,NSDUH_YOUTH::2023,suicide_ideation,"Note: Beginning in 2022, questions YSUI01, YCOV9, YSUI02, YCOV10, YSUI03, YCOV11, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section. The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2023-DS0001/?format=json,YUSUITHK,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
+NSDUH::2023::YUSUITHK,NSDUH,NSDUH_YOUTH::2023,suicide_ideation,"The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2023-DS0001/?format=json,YUSUITHK,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
 NSDUH::2023::YUSUIPLN,NSDUH,NSDUH_YOUTH::2023,suicide_plan,"During the past 12 months, did you make any plans to kill yourself?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2023-DS0001/?format=json,YUSUIPLN,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
-NSDUH::2024::YUSUITHK,NSDUH,NSDUH_YOUTH::2024,suicide_ideation,"Note: Beginning in 2022, questions YSUI01, YSUI02, YSUI03, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section. The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2024-DS0001/?format=json,YUSUITHK,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
+NSDUH::2024::YUSUITHK,NSDUH,NSDUH_YOUTH::2024,suicide_ideation,"The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2024-DS0001/?format=json,YUSUITHK,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
 NSDUH::2024::YUSUIPLN,NSDUH,NSDUH_YOUTH::2024,suicide_plan,"During the past 12 months, did you make any plans to kill yourself?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv,https://datatools.samhsa.gov/api/surveys/NSDUH-2024-DS0001/?format=json,YUSUIPLN,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
 NSDUH::2021::YUSUICTRY,NSDUH,NSDUH_YOUTH::2021,suicide_attempt,"During the past 12 months, did you try to kill yourself?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/NSDUH/2021NSDUHMRBWebSpecs101422.pdf,https://www.samhsa.gov/data/sites/default/files/2021-09/NSDUHRDCCodebook2021.pdf,YSUI03,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
 NSDUH::2022::YUSUICTRY,NSDUH,NSDUH_YOUTH::2022,suicide_attempt,"During the past 12 months, did you try to kill yourself?",9,adolescents aged 12-17; final eligibility and skip logic require annual guide sign-off,English source metadata; administered-language/accommodation coverage not established,Dataset/NSDUH/2022NSDUHmrbCAISpecs070722.pdf,https://www.samhsa.gov/data/sites/default/files/NSDUH-RDC/NSDUHRDCCodebook2022.pdf,YSUI03,,,,,,,,,provisional_pending_two_human_reviewers,"Verify official wording, construct, population/eligibility, administered language, response codes, skip logic, and missing rules independently; do not treat this generated row as a human review."
@@ -7,7 +7,7 @@ Generated from the direct-source registry and audits by `build_primary_outcome_p
 - item instances: 84
 - response-dictionary rows: 396
 - survey/component design rows: 28
- source conflicts or evidence gaps: 32
+- source conflicts or evidence gaps: 34
 - human reviewers recorded: 0

 The package does not satisfy Gate 1 by itself. `responses_long.parquet` has passed structural validation, but two actual human reviewers must independently sign every primary-outcome item; NSDUH youth attempt is absent from local public-use microdata; and several design and administered-language fields remain provisional.
@@ -1682,7 +1682,8 @@
      "record_type": "raw_candidate",
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
-      "question_text": "The next few questions are about thoughts of suicide. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself ?",
+      "question_text": "The next few questions are about thoughts of suicide. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",
+      "codebook_note_removed": null,
      "source_label": "YOUTH SERIOUSLY THINK ABOUT KILLING SELF PST 12 MOS",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2021-DS0001/?format=json",
@@ -1705,6 +1706,7 @@
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
      "question_text": "During the past 12 months, did you make any plans to kill yourself?",
+      "codebook_note_removed": null,
      "source_label": "YOUTH MAKE PLANS TO KILL YOURSELF PST 12 MOS",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2021-DS0001/?format=json",
@@ -1726,7 +1728,8 @@
      "record_type": "raw_candidate",
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
-      "question_text": "Note: Beginning in 2022, questions YSUI01, YCOV9, YSUI02, YCOV10, YSUI03, YCOV11, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section. The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",
+      "question_text": "The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",
+      "codebook_note_removed": "Note: Beginning in 2022, questions YSUI01, YCOV9, YSUI02, YCOV10, YSUI03, YCOV11, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section.",
      "source_label": "YOUTH SERIOUSLY THINK ABOUT KILLING SELF PST 12 MOS",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2022-DS0001/?format=json",
@@ -1738,7 +1741,7 @@
      "reviewer_1": null,
      "reviewer_2": null,
      "link_status": "not_evaluated",
-      "notes": "Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified."
+      "notes": "Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified. A codebook editorial note about the 2022 section move was removed from question_text and is retained here verbatim: Note: Beginning in 2022, questions YSUI01, YCOV9, YSUI02, YCOV10, YSUI03, YCOV11, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section."
    },
    {
      "survey": "NSDUH",
@@ -1749,6 +1752,7 @@
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
      "question_text": "During the past 12 months, did you make any plans to kill yourself?",
+      "codebook_note_removed": null,
      "source_label": "YOUTH MAKE PLANS TO KILL YOURSELF PST 12 MOS",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2022-DS0001/?format=json",
@@ -1770,7 +1774,8 @@
      "record_type": "raw_candidate",
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
-      "question_text": "Note: Beginning in 2022, questions YSUI01, YCOV9, YSUI02, YCOV10, YSUI03, YCOV11, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section. The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",
+      "question_text": "The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",
+      "codebook_note_removed": "Note: Beginning in 2022, questions YSUI01, YCOV9, YSUI02, YCOV10, YSUI03, YCOV11, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section.",
      "source_label": "YOUTH SERIOUSLY THINK ABOUT KILLING SELF PST 12 MOS",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2023-DS0001/?format=json",
@@ -1782,7 +1787,7 @@
      "reviewer_1": null,
      "reviewer_2": null,
      "link_status": "not_evaluated",
-      "notes": "Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified."
+      "notes": "Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified. A codebook editorial note about the 2022 section move was removed from question_text and is retained here verbatim: Note: Beginning in 2022, questions YSUI01, YCOV9, YSUI02, YCOV10, YSUI03, YCOV11, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section."
    },
    {
      "survey": "NSDUH",
@@ -1793,6 +1798,7 @@
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
      "question_text": "During the past 12 months, did you make any plans to kill yourself?",
+      "codebook_note_removed": null,
      "source_label": "YOUTH MAKE PLANS TO KILL YOURSELF PST 12 MOS",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2023-DS0001/?format=json",
@@ -1814,7 +1820,8 @@
      "record_type": "raw_candidate",
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
-      "question_text": "Note: Beginning in 2022, questions YSUI01, YSUI02, YSUI03, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section. The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",
+      "question_text": "The next few questions are about thoughts of suicide. You can answer “I’m not sure” or “I don’t want to answer” to any question. At any time in the past 12 months, that is from [DATEFILL] up to and including today, did you seriously think about trying to kill yourself?",
+      "codebook_note_removed": "Note: Beginning in 2022, questions YSUI01, YSUI02, YSUI03, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section.",
      "source_label": "YOUTH SERIOUSLY THINK ABOUT KILLING SELF PST 12 MOS",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2024-DS0001/?format=json",
@@ -1826,7 +1833,7 @@
      "reviewer_1": null,
      "reviewer_2": null,
      "link_status": "not_evaluated",
-      "notes": "Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified."
+      "notes": "Keep 'not sure' and refusal/nonresponse distinct until skip and missing rules are verified. A codebook editorial note about the 2022 section move was removed from question_text and is retained here verbatim: Note: Beginning in 2022, questions YSUI01, YSUI02, YSUI03, YSUI04, and YSUI05 were moved from the youth mental health service utilization section to the youth experiences section."
    },
    {
      "survey": "NSDUH",
@@ -1837,6 +1844,7 @@
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
      "question_text": "During the past 12 months, did you make any plans to kill yourself?",
+      "codebook_note_removed": null,
      "source_label": "YOUTH MAKE PLANS TO KILL YOURSELF PST 12 MOS",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2024-DS0001/?format=json",
@@ -2109,6 +2117,7 @@
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
      "question_text": null,
+      "codebook_note_removed": null,
      "source_label": "RC-YOUTH SERIOUSLY THOUGHT ABOUT KILLING SELF PAST YEAR",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2021-DS0001/?format=json",
@@ -2131,6 +2140,7 @@
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
      "question_text": null,
+      "codebook_note_removed": null,
      "source_label": "RC-YOUTH MADE PLANS TO KILL SELF IN PAST YEAR",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2021-DS0001/?format=json",
@@ -2153,6 +2163,7 @@
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
      "question_text": null,
+      "codebook_note_removed": null,
      "source_label": "RC-YOUTH SERIOUSLY THOUGHT ABOUT KILLING SELF PAST YEAR",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2022-DS0001/?format=json",
@@ -2175,6 +2186,7 @@
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
      "question_text": null,
+      "codebook_note_removed": null,
      "source_label": "RC-YOUTH MADE PLANS TO KILL SELF IN PAST YEAR",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2022-DS0001/?format=json",
@@ -2197,6 +2209,7 @@
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
      "question_text": null,
+      "codebook_note_removed": null,
      "source_label": "RC-YOUTH SERIOUSLY THOUGHT ABOUT KILLING SELF PAST YEAR",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2023-DS0001/?format=json",
@@ -2219,6 +2232,7 @@
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
      "question_text": null,
+      "codebook_note_removed": null,
      "source_label": "RC-YOUTH MADE PLANS TO KILL SELF IN PAST YEAR",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2023-DS0001/?format=json",
@@ -2241,6 +2255,7 @@
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
      "question_text": null,
+      "codebook_note_removed": null,
      "source_label": "RC-YOUTH SERIOUSLY THOUGHT ABOUT KILLING SELF PAST YEAR",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2024-DS0001/?format=json",
@@ -2263,6 +2278,7 @@
      "population": "youth module; exact age/eligibility and skip logic pending codebook review",
      "time_window": "past 12 months",
      "question_text": null,
+      "codebook_note_removed": null,
      "source_label": "RC-YOUTH MADE PLANS TO KILL SELF IN PAST YEAR",
      "source_file": "Dataset/可直接分析数据包_NSDUH_YRBS/NSDUH/nsduh_complete_variable_dictionary.csv",
      "source_url": "https://datatools.samhsa.gov/api/surveys/NSDUH-2024-DS0001/?format=json",
@@ -3,9 +3,11 @@ GSHS_LANGUAGE::2023_MAR_GSHS_v01::mar_fez2023,GSHS,2023,2023_MAR_GSHS_v01::mar_f
 GSHS_LANGUAGE::GHA_2022_GSHS_v01::gha_sek_tak2022,GSHS,2022,GHA_2022_GSHS_v01::gha_sek_tak2022,all_primary_outcomes,evidence_gap_administered_language,Dataset/GSHS-全球学生健康调查数据/GSHS/Questionnaire/GSHS Per Country/Ghana 2022/Sekondi-Takoradi-2022_GSHS_Questionnaire-Final.pdf,,Available questionnaire language evidence does not establish the language administered to every respondent.,unresolved; retain language as provisional and exclude language-DIF claims,"May be used for pipeline development, not confirmatory language comparison.",open,,
 GSHS_LANGUAGE::IND_2022_GSHS_v01::ind_jaipur_2022,GSHS,2022,IND_2022_GSHS_v01::ind_jaipur_2022,all_primary_outcomes,evidence_gap_administered_language,Dataset/GSHS-全球学生健康调查数据/GSHS/Questionnaire/GSHS Per Country/India 2022/Jaipur-2022_GSHS_Questionnaire-Final.docx,,Available questionnaire language evidence does not establish the language administered to every respondent.,unresolved; retain language as provisional and exclude language-DIF claims,"May be used for pipeline development, not confirmatory language comparison.",open,,
 GSHS_LANGUAGE::JAM_2023_GSHS_v01::jam_st_cath_2023,GSHS,2023,JAM_2023_GSHS_v01::jam_st_cath_2023,all_primary_outcomes,evidence_gap_administered_language,Dataset/GSHS-全球学生健康调查数据/GSHS/Questionnaire/GSHS Per Country/Jamaica 2023/FINAL_St. Catherine-2023-GSHS-Questionnaire.docx,,Available questionnaire language evidence does not establish the language administered to every respondent.,unresolved; retain language as provisional and exclude language-DIF claims,"May be used for pipeline development, not confirmatory language comparison.",open,,
+GSHS_CENSUS_DESIGN::JAM_2023_GSHS_v01::jam_st_cath_2023,GSHS,2023,JAM_2023_GSHS_v01::jam_st_cath_2023,all_primary_outcomes,design_treatment_not_established_for_census,https://extranet.who.int/ncdsmicrodata/index.php/catalog/983,"WHO GSHS country fact sheet (census statement, 100% school response rate)","The fact sheet reports a census, but weight/PSU/stratum handling and the Taylor linearization plan are recorded identically to the two-stage cluster-sample components.",unresolved; design_status downgraded to census_variance_treatment_unresolved pending a source-based variance decision,Exclude from design-based variance estimates until resolved; descriptive use must state the census basis.,open,,
 GSHS_LANGUAGE::MNG_2023_GSHS_v01::mng2023,GSHS,2023,MNG_2023_GSHS_v01::mng2023,all_primary_outcomes,evidence_gap_administered_language,Dataset/GSHS-全球学生健康调查数据/GSHS/Questionnaire/GSHS Per Country/Mongolia 2023/Mongolia-GSHS-Questionnaire-ENGLISH.docx,,Available questionnaire language evidence does not establish the language administered to every respondent.,unresolved; retain language as provisional and exclude language-DIF claims,"May be used for pipeline development, not confirmatory language comparison.",open,,
 GSHS_LANGUAGE::SLB_2023_GSHS_v01::slb_2023,GSHS,2023,SLB_2023_GSHS_v01::slb_2023,all_primary_outcomes,evidence_gap_administered_language,https://extranet.who.int/ncdsmicrodata/index.php/catalog/992,,Available questionnaire language evidence does not establish the language administered to every respondent.,unresolved; retain language as provisional and exclude language-DIF claims,"May be used for pipeline development, not confirmatory language comparison.",open,,
 GSHS_LANGUAGE::WLF_2023_GSHS_v01::wlf_2023,GSHS,2023,WLF_2023_GSHS_v01::wlf_2023,all_primary_outcomes,evidence_gap_administered_language,Dataset/GSHS-全球学生健康调查数据/GSHS/Questionnaire/GSHS Per Country/Wallis and Futuna 2023/Wallis and Futuna - GSHS Questionnaire - Final - English.docx,,Available questionnaire language evidence does not establish the language administered to every respondent.,unresolved; retain language as provisional and exclude language-DIF claims,"May be used for pipeline development, not confirmatory language comparison.",open,,
+GSHS_CENSUS_DESIGN::WLF_2023_GSHS_v01::wlf_2023,GSHS,2023,WLF_2023_GSHS_v01::wlf_2023,all_primary_outcomes,design_treatment_not_established_for_census,https://extranet.who.int/ncdsmicrodata/index.php/catalog/994,"WHO GSHS country fact sheet (census statement, 100% school response rate)","The fact sheet reports a census, but weight/PSU/stratum handling and the Taylor linearization plan are recorded identically to the two-stage cluster-sample components.",unresolved; design_status downgraded to census_variance_treatment_unresolved pending a source-based variance decision,Exclude from design-based variance estimates until resolved; descriptive use must state the census basis.,open,,
 YRBS_MAPPING::1995::suicide_ideation,YRBS,1995,YRBS_NATIONAL::1995,Q22,registry_to_data_variable_mapping,Dataset/YRBS_National_1991_2023/documentation/Questionnaire/1995_xxh_questionnaire.pdf,Dataset/YRBS_National_1991_2023/documentation/UserGuide/YRBS_1995_National_User_Guide.pdf,Previous registry used Q30; direct annual data guide maps the printed question to Q22.,Corrected registry mapping to Q22; printed questionnaire number retained separately.,Use corrected data variable; do not reuse the superseded mapping.,resolved_by_direct_source_audit,,
 YRBS_MAPPING::1995::suicide_plan,YRBS,1995,YRBS_NATIONAL::1995,Q23,registry_to_data_variable_mapping,Dataset/YRBS_National_1991_2023/documentation/Questionnaire/1995_xxh_questionnaire.pdf,Dataset/YRBS_National_1991_2023/documentation/UserGuide/YRBS_1995_National_User_Guide.pdf,Previous registry used Q31; direct annual data guide maps the printed question to Q23.,Corrected registry mapping to Q23; printed questionnaire number retained separately.,Use corrected data variable; do not reuse the superseded mapping.,resolved_by_direct_source_audit,,
 YRBS_MAPPING::1995::suicide_attempt,YRBS,1995,YRBS_NATIONAL::1995,Q24,registry_to_data_variable_mapping,Dataset/YRBS_National_1991_2023/documentation/Questionnaire/1995_xxh_questionnaire.pdf,Dataset/YRBS_National_1991_2023/documentation/UserGuide/YRBS_1995_National_User_Guide.pdf,Previous registry used Q32; direct annual data guide maps the printed question to Q24.,Corrected registry mapping to Q24; printed questionnaire number retained separately.,Use corrected data variable; do not reuse the superseded mapping.,resolved_by_direct_source_audit,,
@@ -2,10 +2,10 @@
 GSHS::2023_MAR_GSHS_v01,2023_MAR_GSHS_v01::mar_fez2023,GSHS,Morocco,2023,school-attending students; exact sampled ages/grades remain pending component source review,sample_weight,sampling_psu,sampling_stratum,"complex-survey design using weight, stratum, and PSU; Taylor linearization planned",prefix PSU and stratum with component_id before pooling,https://extranet.who.int/ncdsmicrodata/index.php/catalog/982; WHO GSHS methodology and data catalog,source_verified_fields,provisional,"For all 21,533 respondents in the seven primary-outcome components, canonical weight/PSU/stratum fields are complete, positive, and numerically identical to raw_weight/raw_psu/raw_stratum. Namespace by component before pooling."
 GSHS::GHA_2022_GSHS_v01,GHA_2022_GSHS_v01::gha_sek_tak2022,GSHS,Ghana,2022,school-attending students; exact sampled ages/grades remain pending component source review,sample_weight,sampling_psu,sampling_stratum,"complex-survey design using weight, stratum, and PSU; Taylor linearization planned",prefix PSU and stratum with component_id before pooling,https://extranet.who.int/ncdsmicrodata/index.php/catalog/981; WHO GSHS methodology and data catalog,source_verified_fields,provisional,"For all 21,533 respondents in the seven primary-outcome components, canonical weight/PSU/stratum fields are complete, positive, and numerically identical to raw_weight/raw_psu/raw_stratum. Namespace by component before pooling."
 GSHS::IND_2022_GSHS_v01,IND_2022_GSHS_v01::ind_jaipur_2022,GSHS,India,2022,school-attending students; exact sampled ages/grades remain pending component source review,sample_weight,sampling_psu,sampling_stratum,"complex-survey design using weight, stratum, and PSU; Taylor linearization planned",prefix PSU and stratum with component_id before pooling,https://extranet.who.int/ncdsmicrodata/index.php/catalog/984; WHO GSHS methodology and data catalog,source_verified_fields,provisional,"For all 21,533 respondents in the seven primary-outcome components, canonical weight/PSU/stratum fields are complete, positive, and numerically identical to raw_weight/raw_psu/raw_stratum. Namespace by component before pooling."
-GSHS::JAM_2023_GSHS_v01,JAM_2023_GSHS_v01::jam_st_cath_2023,GSHS,Jamaica,2023,school-attending students; exact sampled ages/grades remain pending component source review,sample_weight,sampling_psu,sampling_stratum,"complex-survey design using weight, stratum, and PSU; Taylor linearization planned",prefix PSU and stratum with component_id before pooling,https://extranet.who.int/ncdsmicrodata/index.php/catalog/983; WHO GSHS methodology and data catalog,source_verified_fields,provisional,"For all 21,533 respondents in the seven primary-outcome components, canonical weight/PSU/stratum fields are complete, positive, and numerically identical to raw_weight/raw_psu/raw_stratum. Namespace by component before pooling."
+GSHS::JAM_2023_GSHS_v01,JAM_2023_GSHS_v01::jam_st_cath_2023,GSHS,Jamaica,2023,school-attending students; exact sampled ages/grades remain pending component source review,sample_weight,sampling_psu,sampling_stratum,"complex-survey design using weight, stratum, and PSU; Taylor linearization planned",prefix PSU and stratum with component_id before pooling,https://extranet.who.int/ncdsmicrodata/index.php/catalog/983; WHO GSHS methodology and data catalog,census_variance_treatment_unresolved,provisional,"For all 21,533 respondents in the seven primary-outcome components, canonical weight/PSU/stratum fields are complete, positive, and numerically identical to raw_weight/raw_psu/raw_stratum. Namespace by component before pooling. The WHO fact sheet for this component reports a census with a 100% school response rate. Design-based variance under a census is not the same as under the two-stage cluster samples, and no source establishes the Taylor linearization plan here; resolve before any design-based variance estimate."
 GSHS::MNG_2023_GSHS_v01,MNG_2023_GSHS_v01::mng2023,GSHS,Mongolia,2023,school-attending students; exact sampled ages/grades remain pending component source review,sample_weight,sampling_psu,sampling_stratum,"complex-survey design using weight, stratum, and PSU; Taylor linearization planned",prefix PSU and stratum with component_id before pooling,https://extranet.who.int/ncdsmicrodata/index.php/catalog/990; WHO GSHS methodology and data catalog,source_verified_fields,provisional,"For all 21,533 respondents in the seven primary-outcome components, canonical weight/PSU/stratum fields are complete, positive, and numerically identical to raw_weight/raw_psu/raw_stratum. Namespace by component before pooling."
 GSHS::SLB_2023_GSHS_v01,SLB_2023_GSHS_v01::slb_2023,GSHS,Solomon Islands,2023,school-going adolescents aged 13-17 years; Form 1-Form 6; all students in selected classes eligible,sample_weight,sampling_psu,sampling_stratum,"complex-survey design using weight, stratum, and PSU; Taylor linearization planned",prefix PSU and stratum with component_id before pooling,https://extranet.who.int/ncdsmicrodata/index.php/catalog/992; WHO GSHS methodology and data catalog,source_verified_fields,provisional,"For all 21,533 respondents in the seven primary-outcome components, canonical weight/PSU/stratum fields are complete, positive, and numerically identical to raw_weight/raw_psu/raw_stratum. Namespace by component before pooling."
-GSHS::WLF_2023_GSHS_v01,WLF_2023_GSHS_v01::wlf_2023,GSHS,Wallis and Futuna,2023,school-attending students; exact sampled ages/grades remain pending component source review,sample_weight,sampling_psu,sampling_stratum,"complex-survey design using weight, stratum, and PSU; Taylor linearization planned",prefix PSU and stratum with component_id before pooling,https://extranet.who.int/ncdsmicrodata/index.php/catalog/994; WHO GSHS methodology and data catalog,source_verified_fields,provisional,"For all 21,533 respondents in the seven primary-outcome components, canonical weight/PSU/stratum fields are complete, positive, and numerically identical to raw_weight/raw_psu/raw_stratum. Namespace by component before pooling."
+GSHS::WLF_2023_GSHS_v01,WLF_2023_GSHS_v01::wlf_2023,GSHS,Wallis and Futuna,2023,school-attending students; exact sampled ages/grades remain pending component source review,sample_weight,sampling_psu,sampling_stratum,"complex-survey design using weight, stratum, and PSU; Taylor linearization planned",prefix PSU and stratum with component_id before pooling,https://extranet.who.int/ncdsmicrodata/index.php/catalog/994; WHO GSHS methodology and data catalog,census_variance_treatment_unresolved,provisional,"For all 21,533 respondents in the seven primary-outcome components, canonical weight/PSU/stratum fields are complete, positive, and numerically identical to raw_weight/raw_psu/raw_stratum. Namespace by component before pooling. The WHO fact sheet for this component reports a census with a 100% school response rate. Design-based variance under a census is not the same as under the two-stage cluster samples, and no source establishes the Taylor linearization plan here; resolve before any design-based variance estimate."
 YRBS::1991,YRBS_NATIONAL::1991,YRBS,United States,1991,students in grades 9-12 attending public and private schools in the United States,weight,psu,stratum,complex-survey design-based variance accounting for multistage clustering; Taylor linearization supported,prefix PSU and stratum with survey year before pooling,Dataset/YRBS_National_1991_2023/documentation/UserGuide/YRBS_1991_National_User_Guide.pdf,source_verified,provisional,"Annual guide identifies WEIGHT, STRATUM, and PSU. Official-layout repairs restored complete 2017/2019 fields; 2021/2023 imports are complete. One 1997 record lacks all three design fields and requires explicit exclusion/handling."
 YRBS::1993,YRBS_NATIONAL::1993,YRBS,United States,1993,students in grades 9-12 attending public and private schools in the United States,weight,psu,stratum,complex-survey design-based variance accounting for multistage clustering; Taylor linearization supported,prefix PSU and stratum with survey year before pooling,Dataset/YRBS_National_1991_2023/documentation/UserGuide/YRBS_1993_National_User_Guide.pdf,source_verified,provisional,"Annual guide identifies WEIGHT, STRATUM, and PSU. Official-layout repairs restored complete 2017/2019 fields; 2021/2023 imports are complete. One 1997 record lacks all three design fields and requires explicit exclusion/handling."
 YRBS::1995,YRBS_NATIONAL::1995,YRBS,United States,1995,"students in grades 9-12 attending public and private schools in the fifty states and the District of Columbia, excluding a majority of Louisiana",weight,psu,stratum,complex-survey design-based variance accounting for multistage clustering; Taylor linearization supported,prefix PSU and stratum with survey year before pooling,Dataset/YRBS_National_1991_2023/documentation/UserGuide/YRBS_1995_National_User_Guide.pdf,source_verified,provisional,"Annual guide identifies WEIGHT, STRATUM, and PSU. Official-layout repairs restored complete 2017/2019 fields; 2021/2023 imports are complete. One 1997 record lacks all three design fields and requires explicit exclusion/handling."