Publication Audit Package
Generated by scripts/generate-traceability-report.py on 2026-06-28T10:31:47.
Status: draft-review-package.
This package assembles the method, evidence, traceability, AI-use disclosure, model-reliability disclosure, data-availability statement, validation gate, and public-readiness audit for scholarly review. It preserves draft boundaries rather than promoting the Lincoln pilot analysis as final.
Package Components
| component | status | path | purpose |
|---|---|---|---|
| Research design | available | RESEARCH_DESIGN.md | Defines scope, method sequence, integrity rules, and evidence boundaries. |
| Corpus register | available | cases/lincoln/metadata/corpus-register.csv | Documents included texts, provenance, rights status, and inclusion rationale. |
| Annotation codebook | available | MIPVU_ANNOTATION_GUIDE.md | Defines MIPVU coding rules and review expectations. |
| Historical semantics notes | available | cases/lincoln/references/historical-semantics-notes.md | Records period-meaning controls and semantic-risk notes. |
| MIPVU annotations | available | publication/audit/mipvu-annotations.csv | Review-table export of lexical-unit metaphor decisions. |
| Reliability report | available | cases/lincoln/quality/reliability-report.md | Shows the reliability sampling and adjudication workflow. |
| CMT mappings | available | publication/audit/cmt-mappings.csv | Review-table export linking conceptual mappings to MIPVU evidence. |
| Corpus analysis | available | cases/lincoln/analysis/corpus-analysis.md | Summarizes frequency, distribution, salience, and chronology. |
| Critical metaphor analysis | available | cases/lincoln/analysis/critical-metaphor-analysis.md | Interprets persuasive and ideological functions. |
| Rhetorical/genre analysis | available | cases/lincoln/analysis/rhetorical-genre-analysis.md | Controls claims by audience, occasion, genre, and agency structure. |
| Absence/agency analysis | available | cases/lincoln/analysis/absence-agency-analysis.md | Records displacement, silence, and agency limits. |
| Historical enactment/alignment | available | cases/lincoln/analysis/historical-enactment-alignment.md | Corroborates symbolic patterns against historical context. |
| Support ratings | available | cases/lincoln/analysis/support-ratings.csv | Records document-level and case-level support scores. |
| Koenigsbergian support synthesis | available | cases/lincoln/analysis/koenigsbergian-support-synthesis.md | Presents the draft evidentiary-support assessment. |
| Claim traceability | available | publication/claim-traceability.md | Links support claims to evidence records and source metadata. |
| AI-use statement | available | publication/ai-use-statement.md | Explains AI assistance and human scholarly responsibility. |
| Model-reliability disclosure | available | publication/model-reliability.md | Separates accepted annotations, prior review, model diagnostics, human reliability, and reproducibility claims. |
| Model-reliability completion gate | available | docs/reliability/model-reliability-completion-checklist.md | Defines the final artifact, authority, documentation, protected-path, and repository validation gate. |
| Human reliability methodology | available | human-reliability-methodology.qmd | Defines blind human double-coding, adjudication, correction boundaries, and publication claim limits. |
| Human adjudication results | available | human-adjudication-results.qmd | Publishes current human adjudication state, unresolved work, and correction-candidate consequences. |
| Human reliability status artifacts | available | cases/*/quality/human-reliability/status.json | Machine-readable per-case human reliability execution status used to gate publication claims. |
| Human reliability completion gate | available | docs/reliability/human-reliability-completion-checklist.md | Defines the final training, calibration, two-coder, metrics, adjudication, protected-path, publication, and repository validation gate. |
| Data availability | available | publication/data-availability.md | Explains shareable data, rights status, and reuse cautions. |
| Validation gate | available | publication/validation-gate.md | Documents the milestone-level rebuild, validation, and publication checks. |
| Public-site readiness | available | publication/public-site-readiness.md | Shows draft/placeholder signals on public pages. |
Traceability
- Trace rows:
36 - JSON:
publication/audit/claim-traceability.json - CSV:
publication/audit/claim-traceability.csv - Public table:
publication/claim-traceability.md
Human Reliability Claim Gate
Claim status: no-complete-human-reliability-cohorts.
Human reliability claims are scoped to complete cohort rows only. Absent, designed, partial, invalid, awaiting-adjudication, and unresolved states may be disclosed but cannot support publication-ready human reliability claims.
Current package has no complete human reliability cohort rows; therefore no case/language/layer/cohort is publication-ready for a human reliability claim.
Complete Human Reliability Cohorts
No rows.
Case Status Rows
| case_id | state | valid | cohort_count | valid_runs | complete_cohort_count | unresolved_adjudications | warning_count | error_count |
|---|---|---|---|---|---|---|---|---|
| am-rev | absent | True | 0 | 0 | 0 | 0 | 1 | 0 |
| fr-rev | absent | True | 0 | 0 | 0 | 0 | 1 | 0 |
| hitler | absent | True | 0 | 0 | 0 | 0 | 1 | 0 |
| lincoln | designed | True | 1 | 0 | 0 | 0 | 1 | 0 |
| napoleon | absent | True | 0 | 0 | 0 | 0 | 1 | 0 |
| wwi-britain | absent | True | 0 | 0 | 0 | 0 | 1 | 0 |
Validation Gate
npm run statusnpm run pipelinenpm run validatequarto render
Public Site Readiness
Status: pass.
Report: publication/audit/public-site-readiness.json
Known Limitations
- Trace rows are draft review aids, not final publication claims.
- Publication-grade historical citations remain required where historical notes say so.
- Scores are provisional and based on reviewed Lincoln pilot evidence.
- Codex-assisted full-corpus MIPVU review is complete for the frozen pre-v1 corpus, but independent human review and reliability adjudication remain pending.
- Historical alignment notes require publication-grade citations.
- Accepted annotations and prior human-review artifacts remain distinct from multi-model diagnostic outputs.
- Model agreement does not establish human inter-annotator reliability, scholarly reproducibility, or evidentiary correctness.
- Model-reliability packets and responses inherit source-level rights and storage restrictions.
- No case, source-language, task-layer, or cohort may be described as having completed human reliability unless it appears in the complete human reliability cohort table.
- Incomplete, partial, invalid, awaiting-adjudication, or unresolved human reliability states keep related reliability claims draft.
- Human agreement, model agreement, adjudication, and historical corroboration remain separate publication claims.