Multi-Model Reliability Results

Execution status and field-level diagnostics for blind multi-model annotation stress tests
Important

These are model-behavior diagnostics, not human inter-annotator reliability or scholarly evidence. Consensus is not adjudication, and no result proves reproducibility or changes an accepted annotation.

This page is generated from validated case-local model-reliability artifacts by scripts/model_reliability/generate_results_page.py.

Layer-only execution: lincoln executed cmt, interpretation only; identification remains designed but not executed.

Execution status by case and layer

Case Task layer State Valid runs Available fields Note
am-rev identification absent — not designed 0 0 Multi-model reliability has not been designed for this case.
am-rev cmt absent — not designed 0 0 Multi-model reliability has not been designed for this case.
am-rev interpretation absent — not designed 0 0 Multi-model reliability has not been designed for this case.
fr-rev identification absent — not designed 0 0 Multi-model reliability has not been designed for this case.
fr-rev cmt absent — not designed 0 0 Multi-model reliability has not been designed for this case.
fr-rev interpretation absent — not designed 0 0 Multi-model reliability has not been designed for this case.
hitler identification absent — not designed 0 0 Multi-model reliability has not been designed for this case.
hitler cmt absent — not designed 0 0 Multi-model reliability has not been designed for this case.
hitler interpretation absent — not designed 0 0 Multi-model reliability has not been designed for this case.
lincoln identification designed — not executed 0 0 No valid submissions for this layer; case completion reflects the executed layer(s).
lincoln cmt complete 2 8 /Users/andrewhammer/codegarden/koenigsberg-sacrifice-workbench/cases/lincoln/corpus/annotated/lincoln-gettysburg-address_annotated.json: packet source input hash predates annotation-forward corpus refresh; existing packet remains historical and requires reliability resampling before promotion.
lincoln interpretation complete 2 17 /Users/andrewhammer/codegarden/koenigsberg-sacrifice-workbench/cases/lincoln/corpus/annotated/lincoln-gettysburg-address_annotated.json: packet source input hash predates annotation-forward corpus refresh; existing packet remains historical and requires reliability resampling before promotion.
napoleon identification absent — not designed 0 0 Multi-model reliability has not been designed for this case.
napoleon cmt absent — not designed 0 0 Multi-model reliability has not been designed for this case.
napoleon interpretation absent — not designed 0 0 Multi-model reliability has not been designed for this case.
wwi-britain identification absent — not designed 0 0 Multi-model reliability has not been designed for this case.
wwi-britain cmt absent — not designed 0 0 Multi-model reliability has not been designed for this case.
wwi-britain interpretation absent — not designed 0 0 Multi-model reliability has not been designed for this case.

Layer state is computed from validated submissions for that layer. Complete means the artifact chain for the executed layer is valid; it does not mean an interpretation has been proven.

Model-to-model field stability

Case Language Layer Field Run pair N Metric Value Cohen’s kappa
lincoln en cmt cmt.cluster_id issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 7 observed_agreement 1 undefined: not applicable to this field type
lincoln en cmt cmt.cluster_id issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.cluster_id issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.cluster_id issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.cluster_id issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.cluster_id issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.conceptual_metaphor issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 7 observed_agreement 0 undefined: not applicable to this field type
lincoln en cmt cmt.conceptual_metaphor issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.conceptual_metaphor issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.conceptual_metaphor issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.conceptual_metaphor issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.conceptual_metaphor issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.entailments issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 7 jaccard_overlap 0 undefined: not applicable to this field type
lincoln en cmt cmt.entailments issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.entailments issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.entailments issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.entailments issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.entailments issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.source_domain_primary issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 7 observed_agreement 0.714 undefined: not applicable to this field type
lincoln en cmt cmt.source_domain_primary issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.source_domain_primary issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.source_domain_primary issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.source_domain_primary issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.source_domain_primary issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.source_domain_secondary issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 7 jaccard_overlap 0.345 undefined: not applicable to this field type
lincoln en cmt cmt.source_domain_secondary issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.source_domain_secondary issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.source_domain_secondary issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.source_domain_secondary issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.source_domain_secondary issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.target_domain issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 7 observed_agreement 0.714 undefined: not applicable to this field type
lincoln en cmt cmt.target_domain issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.target_domain issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.target_domain issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.target_domain issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt cmt.target_domain issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt confidence issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 7 mean_absolute_difference 0.071 undefined: not applicable to this field type
lincoln en cmt confidence issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 7 mean_absolute_difference 0.174 undefined: not applicable to this field type
lincoln en cmt confidence issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 7 mean_absolute_difference 0.07 undefined: not applicable to this field type
lincoln en cmt confidence issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 7 mean_absolute_difference 0.171 undefined: not applicable to this field type
lincoln en cmt confidence issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 7 mean_absolute_difference 0.087 undefined: not applicable to this field type
lincoln en cmt confidence issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 mean_absolute_difference undefined: no comparable observations undefined: not applicable to this field type
lincoln en cmt uncertainty.status issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 7 observed_agreement 0.857 0.731
lincoln en cmt uncertainty.status issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 7 observed_agreement 0.143 -0.105
lincoln en cmt uncertainty.status issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 7 observed_agreement 0.571 0.192
lincoln en cmt uncertainty.status issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 7 observed_agreement 0.286 -0.061
lincoln en cmt uncertainty.status issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 7 observed_agreement 0.714 0.481
lincoln en cmt uncertainty.status issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification confidence issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 mean_absolute_difference undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification confidence issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 mean_absolute_difference undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification confidence issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 mean_absolute_difference undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification confidence issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 mean_absolute_difference undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification confidence issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 mean_absolute_difference undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification confidence issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 mean_absolute_difference undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.basic_meaning issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.basic_meaning issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.basic_meaning issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.basic_meaning issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.basic_meaning issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.basic_meaning issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.boundary_decision issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification identification.boundary_decision issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification identification.boundary_decision issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification identification.boundary_decision issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification identification.boundary_decision issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification identification.boundary_decision issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification identification.boundary_span issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.boundary_span issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.boundary_span issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.boundary_span issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.boundary_span issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.boundary_span issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.comparison_basis issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.comparison_basis issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.comparison_basis issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.comparison_basis issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.comparison_basis issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.comparison_basis issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.contextual_meaning issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.contextual_meaning issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.contextual_meaning issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.contextual_meaning issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.contextual_meaning issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.contextual_meaning issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.contrast_explanation issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.contrast_explanation issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.contrast_explanation issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.contrast_explanation issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.contrast_explanation issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.contrast_explanation issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en identification identification.decision issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification identification.decision issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification identification.decision issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification identification.decision issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification identification.decision issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification identification.decision issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification uncertainty.status issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification uncertainty.status issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification uncertainty.status issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification uncertainty.status issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification uncertainty.status issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en identification uncertainty.status issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation confidence issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 mean_absolute_difference undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation confidence issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 mean_absolute_difference undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation confidence issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 mean_absolute_difference undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation confidence issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 mean_absolute_difference undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation confidence issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 mean_absolute_difference undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation confidence issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 mean_absolute_difference 0.107 undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.displacement_mechanism issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.displacement_mechanism issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.displacement_mechanism issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.displacement_mechanism issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.displacement_mechanism issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.displacement_mechanism issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 observed_agreement 0 undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.expected_presence issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.expected_presence issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.expected_presence issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.expected_presence issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.expected_presence issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.expected_presence issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 observed_agreement 0 undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.possible_absence issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.possible_absence issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.possible_absence issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.possible_absence issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.possible_absence issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.possible_absence issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 observed_agreement 0 undefined: not applicable to this field type
lincoln en interpretation interpretation.absence.status issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.absence.status issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.absence.status issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.absence.status issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.absence.status issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.absence.status issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 observed_agreement 1 undefined: expected agreement is 1.0 because both sides are constant
lincoln en interpretation interpretation.agency.agents issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.agents issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.agents issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.agents issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.agents issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.agents issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 jaccard_overlap 0.226 undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.beneficiaries issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.beneficiaries issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.beneficiaries issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.beneficiaries issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.beneficiaries issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.beneficiaries issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 jaccard_overlap 0.25 undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.excluded_agents issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.excluded_agents issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.excluded_agents issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.excluded_agents issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.excluded_agents issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.excluded_agents issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 jaccard_overlap 0 undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.patients issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.patients issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.patients issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.patients issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.patients issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.patients issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 jaccard_overlap 0 undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.sacrificial_subjects issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.sacrificial_subjects issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.sacrificial_subjects issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.sacrificial_subjects issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.sacrificial_subjects issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 jaccard_overlap undefined: no comparable observations undefined: not applicable to this field type
lincoln en interpretation interpretation.agency.sacrificial_subjects issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 jaccard_overlap 0.393 undefined: not applicable to this field type
lincoln en interpretation interpretation.functions.enemy_as_bringer_of_death issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.enemy_as_bringer_of_death issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.enemy_as_bringer_of_death issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.enemy_as_bringer_of_death issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.enemy_as_bringer_of_death issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.enemy_as_bringer_of_death issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 observed_agreement 0.714 0.462
lincoln en interpretation interpretation.functions.obligatory_frame issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.obligatory_frame issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.obligatory_frame issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.obligatory_frame issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.obligatory_frame issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.obligatory_frame issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 observed_agreement 0.857 0
lincoln en interpretation interpretation.functions.purification issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.purification issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.purification issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.purification issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.purification issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.purification issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 observed_agreement 0.714 0.588
lincoln en interpretation interpretation.functions.sacred_object issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.sacred_object issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.sacred_object issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.sacred_object issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.sacred_object issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.sacred_object issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 observed_agreement 0.571 0
lincoln en interpretation interpretation.functions.sacrificial_body issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.sacrificial_body issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.sacrificial_body issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.sacrificial_body issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.sacrificial_body issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.sacrificial_body issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 observed_agreement 0.857 0.741
lincoln en interpretation interpretation.functions.violence_logic issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.violence_logic issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.violence_logic issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.violence_logic issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.violence_logic issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation interpretation.functions.violence_logic issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 observed_agreement 0.714 0.5
lincoln en interpretation uncertainty.status issue147-anthropic-cmt-final2-20260627 ↔︎ issue147-openai-cmt-final2-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation uncertainty.status issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation uncertainty.status issue147-anthropic-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation uncertainty.status issue147-openai-cmt-final2-20260627 ↔︎ issue157-anthropic-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation uncertainty.status issue147-openai-cmt-final2-20260627 ↔︎ issue157-openai-interpretation-20260627 0 observed_agreement undefined: no comparable observations undefined: fewer than two comparable observations
lincoln en interpretation uncertainty.status issue157-anthropic-interpretation-20260627 ↔︎ issue157-openai-interpretation-20260627 7 observed_agreement 0.571 0.222

Model-to-model stability asks whether separately run systems behave similarly. Shared behavior may reflect a clear instruction, shared bias, prompt effects, or common training data.

Model-to-reference field divergence

Case Language Layer Field Comparison N Metric Value
lincoln en cmt cmt.cluster_id issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 7 observed_agreement 0.429
lincoln en cmt cmt.cluster_id issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 7 observed_agreement 0.429
lincoln en cmt cmt.cluster_id issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en cmt cmt.cluster_id issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en cmt cmt.conceptual_metaphor issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 7 observed_agreement 0
lincoln en cmt cmt.conceptual_metaphor issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 7 observed_agreement 0
lincoln en cmt cmt.conceptual_metaphor issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en cmt cmt.conceptual_metaphor issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en cmt cmt.entailments issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 7 jaccard_overlap 0
lincoln en cmt cmt.entailments issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 7 jaccard_overlap 0
lincoln en cmt cmt.entailments issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en cmt cmt.entailments issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en cmt cmt.source_domain_primary issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 7 observed_agreement 0.143
lincoln en cmt cmt.source_domain_primary issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 7 observed_agreement 0.429
lincoln en cmt cmt.source_domain_primary issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en cmt cmt.source_domain_primary issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en cmt cmt.source_domain_secondary issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 7 jaccard_overlap 0
lincoln en cmt cmt.source_domain_secondary issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 7 jaccard_overlap 0
lincoln en cmt cmt.source_domain_secondary issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en cmt cmt.source_domain_secondary issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en cmt cmt.target_domain issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 7 observed_agreement 0.143
lincoln en cmt cmt.target_domain issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 7 observed_agreement 0.286
lincoln en cmt cmt.target_domain issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en cmt cmt.target_domain issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en cmt confidence issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 7 mean_absolute_difference 0.048
lincoln en cmt confidence issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 7 mean_absolute_difference 0.088
lincoln en cmt confidence issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 mean_absolute_difference undefined: no comparable observations
lincoln en cmt confidence issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 mean_absolute_difference undefined: no comparable observations
lincoln en cmt uncertainty.status issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en cmt uncertainty.status issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en cmt uncertainty.status issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en cmt uncertainty.status issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification confidence issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 mean_absolute_difference undefined: no comparable observations
lincoln en identification confidence issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 mean_absolute_difference undefined: no comparable observations
lincoln en identification confidence issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 mean_absolute_difference undefined: no comparable observations
lincoln en identification confidence issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 mean_absolute_difference undefined: no comparable observations
lincoln en identification identification.basic_meaning issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.basic_meaning issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.basic_meaning issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.basic_meaning issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.boundary_decision issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.boundary_decision issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.boundary_decision issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.boundary_decision issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.boundary_span issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en identification identification.boundary_span issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en identification identification.boundary_span issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en identification identification.boundary_span issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en identification identification.comparison_basis issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.comparison_basis issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.comparison_basis issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.comparison_basis issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.contextual_meaning issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.contextual_meaning issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.contextual_meaning issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.contextual_meaning issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.contrast_explanation issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.contrast_explanation issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.contrast_explanation issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.contrast_explanation issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.decision issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.decision issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.decision issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification identification.decision issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification uncertainty.status issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification uncertainty.status issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification uncertainty.status issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en identification uncertainty.status issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation confidence issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 mean_absolute_difference undefined: no comparable observations
lincoln en interpretation confidence issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 mean_absolute_difference undefined: no comparable observations
lincoln en interpretation confidence issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 7 mean_absolute_difference 0.127
lincoln en interpretation confidence issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 7 mean_absolute_difference 0.034
lincoln en interpretation interpretation.absence.displacement_mechanism issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.displacement_mechanism issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.displacement_mechanism issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.displacement_mechanism issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.expected_presence issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.expected_presence issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.expected_presence issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.expected_presence issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.possible_absence issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.possible_absence issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.possible_absence issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.possible_absence issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.status issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.status issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.status issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.absence.status issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.agency.agents issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.agents issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.agents issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.agents issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.beneficiaries issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.beneficiaries issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.beneficiaries issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.beneficiaries issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.excluded_agents issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.excluded_agents issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.excluded_agents issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.excluded_agents issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.patients issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.patients issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.patients issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.patients issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.sacrificial_subjects issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.sacrificial_subjects issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.sacrificial_subjects issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.agency.sacrificial_subjects issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 jaccard_overlap undefined: no comparable observations
lincoln en interpretation interpretation.functions.enemy_as_bringer_of_death issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.enemy_as_bringer_of_death issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.enemy_as_bringer_of_death issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.enemy_as_bringer_of_death issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.obligatory_frame issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.obligatory_frame issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.obligatory_frame issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.obligatory_frame issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.purification issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.purification issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.purification issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.purification issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.sacred_object issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.sacred_object issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.sacred_object issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.sacred_object issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.sacrificial_body issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.sacrificial_body issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.sacrificial_body issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.sacrificial_body issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.violence_logic issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.violence_logic issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.violence_logic issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation interpretation.functions.violence_logic issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation uncertainty.status issue147-anthropic-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation uncertainty.status issue147-openai-cmt-final2-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation uncertainty.status issue157-anthropic-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations
lincoln en interpretation uncertainty.status issue157-openai-interpretation-20260627 vs lincoln:accepted-reference 0 observed_agreement undefined: no comparable observations

Reference alignment is reported separately from model-to-model stability. A divergence may reflect model error, reference error, or codebook ambiguity; it is a question for human review, not an automatic correction.

Consensus, instability, and review queue

Case Fields Stable Unstable Insufficient data Review items High priority
lincoln 34 2 23 9 160 125

The review queue has human-only decision authority. Model agreement is not a vote, and high-priority reference challenges remain unadjudicated suggestions.

Interpretation limits

  • Results remain stratified by case, source language, task layer, field, and run or run pair.
  • Undefined and unavailable metrics stay visible rather than becoming zero or perfect agreement.
  • Missing submissions and reports are execution states, not positive findings.
  • Model outputs cannot corroborate historical claims or validate theoretical interpretations.
  • Human source review, adjudication, and accepted-correction governance remain separate from this stress test.

See the methodology for the study design and the external review procedure for packet execution and ingestion.