vh/esh-pfi-infrastructure
1
0
Fork 0
Code Issues 7 Pull Requests Actions Packages Projects Releases Wiki Activity
Files
475d6d6bcb3c22280f3c4d4dc03c6cb3d369e969
esh-pfi-infrastructure/services/semif-serve/bench-jev-2026-09-30/code/data/perturbations108.jsonl
T
vh 475d6d6bcb docs: Jev candidate bench vs SemIf (fv-ml1 GPU 3) — Intern-Decision-4B is the replacement if SemIf is displaced 
Operator ask relayed by brokkr-smithy-dev. Positive control (SemIf 187/231,
hard 0.613) reproduced exactly; negative control and a 4-restart noise floor
(0 flips) measured. On our replaced-baseline sets no candidate beats SemIf-with-
rotations beyond the ~4-pt floor; Intern-Decision-4B native matches it at one
ordering, is better on Wyrd, fits 9.7/10.3 GB and is 1.5-2.3x faster. JevBench
rank does not transfer. Raw per-item data kept out of git.
2026-09-30 05:00:45 -07:00

109 lines
101 KiB
JSON
Raw Blame History

{"family": "evidence_interpretation", "group_id": "2fdaa8a61e6e989dd866/stability", "id": "14790d6d50043b03420c", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "a3f18f3a63d45345942b", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "2fdaa8a61e6e989dd866", "variant": "option_reversal"}, "question": "Assess the claim: the replacement lenses have been fitted.", "split": "rebase_stability", "state": "The optician ordered replacement lenses. The workshop confirms they have not yet been fitted to the customer's glasses.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "2fdaa8a61e6e989dd866/stability", "id": "29566b5efbd2611e6eee", "label": 2, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}], "provenance": {"base_id": "a3f18f3a63d45345942b", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "2fdaa8a61e6e989dd866", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Assess the claim: the replacement lenses have been fitted.", "split": "rebase_stability", "state": "The optician ordered replacement lenses. The workshop confirms they have not yet been fitted to the customer's glasses.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "2fdaa8a61e6e989dd866/stability", "id": "1a6e02f5b0bf923374c1", "label": 2, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}], "provenance": {"base_id": "a3f18f3a63d45345942b", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "2fdaa8a61e6e989dd866", "variant": "irrelevant_context"}, "question": "Assess the claim: the replacement lenses have been fitted.", "split": "rebase_stability", "state": "The optician ordered replacement lenses. The workshop confirms they have not yet been fitted to the customer's glasses.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "f4bea3d3bcc01056740d/stability", "id": "d83888299b2e202297be", "label": 2, "options": [{"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "e0c140e9222d1bce5647", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "f4bea3d3bcc01056740d", "variant": "option_reversal"}, "question": "Assess the claim: the guest endorses the listing's towel statement.", "split": "rebase_stability", "state": "The guest writes, \"The listing says towels are supplied. I agree: fresh towels were provided during my stay.\"", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "f4bea3d3bcc01056740d/stability", "id": "f42c36cd140557859819", "label": 0, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}], "provenance": {"base_id": "e0c140e9222d1bce5647", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "f4bea3d3bcc01056740d", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Assess the claim: the guest endorses the listing's towel statement.", "split": "rebase_stability", "state": "The guest writes, \"The listing says towels are supplied. I agree: fresh towels were provided during my stay.\"", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "f4bea3d3bcc01056740d/stability", "id": "c2e8c6d1252eabe3e182", "label": 0, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}], "provenance": {"base_id": "e0c140e9222d1bce5647", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "f4bea3d3bcc01056740d", "variant": "irrelevant_context"}, "question": "Assess the claim: the guest endorses the listing's towel statement.", "split": "rebase_stability", "state": "The guest writes, \"The listing says towels are supplied. I agree: fresh towels were provided during my stay.\"\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "b51b300da2936decc6b7/stability", "id": "70d7bdc8d5ee62366ee5", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "834f3b3e10cc61b33d25", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "b51b300da2936decc6b7", "variant": "option_reversal"}, "question": "Assess the claim: terminal Maple is online.", "split": "rebase_stability", "state": "The technician says terminal Cedar is online. Terminal Maple is explicitly offline.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "b51b300da2936decc6b7/stability", "id": "26d6f758382576f65927", "label": 2, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}], "provenance": {"base_id": "834f3b3e10cc61b33d25", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "b51b300da2936decc6b7", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Assess the claim: terminal Maple is online.", "split": "rebase_stability", "state": "The technician says terminal Cedar is online. Terminal Maple is explicitly offline.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "b51b300da2936decc6b7/stability", "id": "ecc5ee8175d414efdd35", "label": 2, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}], "provenance": {"base_id": "834f3b3e10cc61b33d25", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "b51b300da2936decc6b7", "variant": "irrelevant_context"}, "question": "Assess the claim: terminal Maple is online.", "split": "rebase_stability", "state": "The technician says terminal Cedar is online. Terminal Maple is explicitly offline.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "e4cfd694c80e08d3e6a5/stability", "id": "21ecfcb1d048958cb9b4", "label": 0, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}], "provenance": {"base_id": "44574c44e243ee1b2f52", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "e4cfd694c80e08d3e6a5", "variant": "option_reversal"}, "question": "Assess the claim: the corrected date is in July.", "split": "rebase_stability", "state": "The catalogue originally dated the letter to June. Its author issued a correction stating July was correct and June was mistaken.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "e4cfd694c80e08d3e6a5/stability", "id": "5ce4f874ff2fa5295685", "label": 2, "options": [{"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "44574c44e243ee1b2f52", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "e4cfd694c80e08d3e6a5", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Assess the claim: the corrected date is in July.", "split": "rebase_stability", "state": "The catalogue originally dated the letter to June. Its author issued a correction stating July was correct and June was mistaken.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "e4cfd694c80e08d3e6a5/stability", "id": "04d55440accab2c5d0d9", "label": 2, "options": [{"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "44574c44e243ee1b2f52", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "e4cfd694c80e08d3e6a5", "variant": "irrelevant_context"}, "question": "Assess the claim: the corrected date is in July.", "split": "rebase_stability", "state": "The catalogue originally dated the letter to June. Its author issued a correction stating July was correct and June was mistaken.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "20460d4ae0db46091e84/stability", "id": "0e2caab29b17ff00a2c8", "label": 2, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}], "provenance": {"base_id": "86a15618ba4cb90a307e", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "20460d4ae0db46091e84", "variant": "option_reversal"}, "question": "Assess the claim: the parcel has been weighed.", "split": "rebase_stability", "state": "The intern attached instructions for weighing the parcel and explicitly says no weighing has been performed.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "20460d4ae0db46091e84/stability", "id": "a4428ee66c63c4f1e7f4", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "86a15618ba4cb90a307e", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "20460d4ae0db46091e84", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Assess the claim: the parcel has been weighed.", "split": "rebase_stability", "state": "The intern attached instructions for weighing the parcel and explicitly says no weighing has been performed.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "20460d4ae0db46091e84/stability", "id": "22e54b5c44f60d5cd5c0", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "86a15618ba4cb90a307e", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "20460d4ae0db46091e84", "variant": "irrelevant_context"}, "question": "Assess the claim: the parcel has been weighed.", "split": "rebase_stability", "state": "The intern attached instructions for weighing the parcel and explicitly says no weighing has been performed.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "51b91ba31984c5939c1c/stability", "id": "9729054768eb7f90eb6d", "label": 0, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}], "provenance": {"base_id": "51ceab3ce622c7c759f1", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "51b91ba31984c5939c1c", "variant": "option_reversal"}, "question": "Assess the claim: the egg discovery was fictional.", "split": "rebase_stability", "state": "During a puppet show, a character announces the discovery of a dragon egg. The production note states this is fictional and no real egg was discovered.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "51b91ba31984c5939c1c/stability", "id": "674217922d611e718129", "label": 2, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "51ceab3ce622c7c759f1", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "51b91ba31984c5939c1c", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Assess the claim: the egg discovery was fictional.", "split": "rebase_stability", "state": "During a puppet show, a character announces the discovery of a dragon egg. The production note states this is fictional and no real egg was discovered.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "51b91ba31984c5939c1c/stability", "id": "7a8a295f17d1296482dd", "label": 2, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "51ceab3ce622c7c759f1", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "51b91ba31984c5939c1c", "variant": "irrelevant_context"}, "question": "Assess the claim: the egg discovery was fictional.", "split": "rebase_stability", "state": "During a puppet show, a character announces the discovery of a dragon egg. The production note states this is fictional and no real egg was discovered.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "rule_application", "group_id": "770c1607f0a11f88f81e/stability", "id": "8bceb31cf793fb26d1a5", "label": 1, "options": [{"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}], "provenance": {"base_id": "f2b4ec4930322fe45118", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "770c1607f0a11f88f81e", "variant": "option_reversal"}, "question": "Sell copies only with the architect's sales permission. May copies be sold?", "split": "rebase_stability", "state": "The architect permits reproducing a plan in an internal training booklet and expressly forbids selling copies.", "target_distribution": null}
{"family": "rule_application", "group_id": "770c1607f0a11f88f81e/stability", "id": "2e895a0fc82d936936aa", "label": 1, "options": [{"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The stated rule permits the action", "id": "permitted"}], "provenance": {"base_id": "f2b4ec4930322fe45118", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "770c1607f0a11f88f81e", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Sell copies only with the architect's sales permission. May copies be sold?", "split": "rebase_stability", "state": "The architect permits reproducing a plan in an internal training booklet and expressly forbids selling copies.", "target_distribution": null}
{"family": "rule_application", "group_id": "770c1607f0a11f88f81e/stability", "id": "c5a9fbb9bfa41e5293eb", "label": 1, "options": [{"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The stated rule permits the action", "id": "permitted"}], "provenance": {"base_id": "f2b4ec4930322fe45118", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "770c1607f0a11f88f81e", "variant": "irrelevant_context"}, "question": "Sell copies only with the architect's sales permission. May copies be sold?", "split": "rebase_stability", "state": "The architect permits reproducing a plan in an internal training booklet and expressly forbids selling copies.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "rule_application", "group_id": "ffd081ada3bd9be9207a/stability", "id": "80970cf7e755a58a049e", "label": 2, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule permits the action", "id": "permitted"}], "provenance": {"base_id": "9473603b44af63beab79", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "ffd081ada3bd9be9207a", "variant": "option_reversal"}, "question": "The first-aid badge requires only first-aid training. May this guide receive it?", "split": "rebase_stability", "state": "The guide completed first-aid training but not mountain-navigation training.", "target_distribution": null}
{"family": "rule_application", "group_id": "ffd081ada3bd9be9207a/stability", "id": "d300f689be3cf2daa666", "label": 0, "options": [{"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}], "provenance": {"base_id": "9473603b44af63beab79", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "ffd081ada3bd9be9207a", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: The first-aid badge requires only first-aid training. May this guide receive it?", "split": "rebase_stability", "state": "The guide completed first-aid training but not mountain-navigation training.", "target_distribution": null}
{"family": "rule_application", "group_id": "ffd081ada3bd9be9207a/stability", "id": "3d8f3be170e01d2c78e5", "label": 0, "options": [{"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}], "provenance": {"base_id": "9473603b44af63beab79", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "ffd081ada3bd9be9207a", "variant": "irrelevant_context"}, "question": "The first-aid badge requires only first-aid training. May this guide receive it?", "split": "rebase_stability", "state": "The guide completed first-aid training but not mountain-navigation training.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "rule_application", "group_id": "2c3a0cb61f7bae78739e/stability", "id": "aef33dfba4338b1af990", "label": 0, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule permits the action", "id": "permitted"}], "provenance": {"base_id": "8a4c3de28be95c105ca1", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "2c3a0cb61f7bae78739e", "variant": "option_reversal"}, "question": "Mass production is allowed only after mass-production approval. May it begin?", "split": "rebase_stability", "state": "The designer approves making a sample badge but expressly withholds approval for mass production.", "target_distribution": null}
{"family": "rule_application", "group_id": "2c3a0cb61f7bae78739e/stability", "id": "f806bba07a63e30f7181", "label": 2, "options": [{"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}], "provenance": {"base_id": "8a4c3de28be95c105ca1", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "2c3a0cb61f7bae78739e", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Mass production is allowed only after mass-production approval. May it begin?", "split": "rebase_stability", "state": "The designer approves making a sample badge but expressly withholds approval for mass production.", "target_distribution": null}
{"family": "rule_application", "group_id": "2c3a0cb61f7bae78739e/stability", "id": "409e1ab1d29db22f8917", "label": 2, "options": [{"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}], "provenance": {"base_id": "8a4c3de28be95c105ca1", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "2c3a0cb61f7bae78739e", "variant": "irrelevant_context"}, "question": "Mass production is allowed only after mass-production approval. May it begin?", "split": "rebase_stability", "state": "The designer approves making a sample badge but expressly withholds approval for mass production.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "rule_application", "group_id": "42ed4cbfde7f2f64274b/stability", "id": "0471c62c50820b1d4203", "label": 0, "options": [{"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}], "provenance": {"base_id": "a02fd582d2881cc462b2", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "42ed4cbfde7f2f64274b", "variant": "option_reversal"}, "question": "A wristband permits entry exactly to the areas it covers. May the visitor enter the sculpture garden?", "split": "rebase_stability", "state": "The visitor's wristband covers the sculpture garden and expressly excludes the rooftop terrace.", "target_distribution": null}
{"family": "rule_application", "group_id": "42ed4cbfde7f2f64274b/stability", "id": "10bac1f2a20209f3a4cd", "label": 2, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule permits the action", "id": "permitted"}], "provenance": {"base_id": "a02fd582d2881cc462b2", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "42ed4cbfde7f2f64274b", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: A wristband permits entry exactly to the areas it covers. May the visitor enter the sculpture garden?", "split": "rebase_stability", "state": "The visitor's wristband covers the sculpture garden and expressly excludes the rooftop terrace.", "target_distribution": null}
{"family": "rule_application", "group_id": "42ed4cbfde7f2f64274b/stability", "id": "59898712e090848aa8b9", "label": 2, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule permits the action", "id": "permitted"}], "provenance": {"base_id": "a02fd582d2881cc462b2", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "42ed4cbfde7f2f64274b", "variant": "irrelevant_context"}, "question": "A wristband permits entry exactly to the areas it covers. May the visitor enter the sculpture garden?", "split": "rebase_stability", "state": "The visitor's wristband covers the sculpture garden and expressly excludes the rooftop terrace.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "rule_application", "group_id": "6dd193172b9240a04bf9/stability", "id": "20af0ba1b17131d525dd", "label": 2, "options": [{"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}], "provenance": {"base_id": "a0a39ace7e5337d038a7", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "6dd193172b9240a04bf9", "variant": "option_reversal"}, "question": "Change an account field only when the owner authorizes changing that field. May the recovery email be changed?", "split": "rebase_stability", "state": "The account owner permits changing the display name but expressly forbids changing the recovery email.", "target_distribution": null}
{"family": "rule_application", "group_id": "6dd193172b9240a04bf9/stability", "id": "c153f7547c7206472fda", "label": 0, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}], "provenance": {"base_id": "a0a39ace7e5337d038a7", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "6dd193172b9240a04bf9", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Change an account field only when the owner authorizes changing that field. May the recovery email be changed?", "split": "rebase_stability", "state": "The account owner permits changing the display name but expressly forbids changing the recovery email.", "target_distribution": null}
{"family": "rule_application", "group_id": "6dd193172b9240a04bf9/stability", "id": "36d25b31f325cc4cec04", "label": 0, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}], "provenance": {"base_id": "a0a39ace7e5337d038a7", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "6dd193172b9240a04bf9", "variant": "irrelevant_context"}, "question": "Change an account field only when the owner authorizes changing that field. May the recovery email be changed?", "split": "rebase_stability", "state": "The account owner permits changing the display name but expressly forbids changing the recovery email.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "rule_application", "group_id": "3200eb252d6737e03027/stability", "id": "d6a681055a01ed788b91", "label": 1, "options": [{"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}], "provenance": {"base_id": "4444dad25e438f128673", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "3200eb252d6737e03027", "variant": "option_reversal"}, "question": "A resident's pass requires living in the valley and has no workplace restriction. May it be issued?", "split": "rebase_stability", "state": "The applicant lives in the valley but works outside it.", "target_distribution": null}
{"family": "rule_application", "group_id": "3200eb252d6737e03027/stability", "id": "3cafd544b9a8b89091a4", "label": 1, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}], "provenance": {"base_id": "4444dad25e438f128673", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "3200eb252d6737e03027", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: A resident's pass requires living in the valley and has no workplace restriction. May it be issued?", "split": "rebase_stability", "state": "The applicant lives in the valley but works outside it.", "target_distribution": null}
{"family": "rule_application", "group_id": "3200eb252d6737e03027/stability", "id": "24c4e34db7cfbd13c409", "label": 1, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}], "provenance": {"base_id": "4444dad25e438f128673", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "3200eb252d6737e03027", "variant": "irrelevant_context"}, "question": "A resident's pass requires living in the valley and has no workplace restriction. May it be issued?", "split": "rebase_stability", "state": "The applicant lives in the valley but works outside it.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "c0cbeb97315307af8111/stability", "id": "69a2a9d14f62016e74c7", "label": 1, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate A", "id": "A"}, {"description": "Candidate B", "id": "B"}], "provenance": {"base_id": "8c992e17e4fb54b044f5", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "c0cbeb97315307af8111", "variant": "option_reversal"}, "question": "Choose the candidate reporting completed delivery.", "split": "rebase_stability", "state": "Candidate A: The florist confirms that the wreath was delivered. Candidate B: The florist offers to deliver a wreath tomorrow.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "c0cbeb97315307af8111/stability", "id": "f0519e8daaa832f8c594", "label": 1, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "8c992e17e4fb54b044f5", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "c0cbeb97315307af8111", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Choose the candidate reporting completed delivery.", "split": "rebase_stability", "state": "Candidate A: The florist confirms that the wreath was delivered. Candidate B: The florist offers to deliver a wreath tomorrow.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "c0cbeb97315307af8111/stability", "id": "97b7222868f23ec1cdec", "label": 1, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "8c992e17e4fb54b044f5", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "c0cbeb97315307af8111", "variant": "irrelevant_context"}, "question": "Choose the candidate reporting completed delivery.", "split": "rebase_stability", "state": "Candidate A: The florist confirms that the wreath was delivered. Candidate B: The florist offers to deliver a wreath tomorrow.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "428176cd8ad2c7a74eea/stability", "id": "dfdd8717200917fdbee2", "label": 1, "options": [{"description": "Candidate A", "id": "A"}, {"description": "Candidate B", "id": "B"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "587ced261c6092cd1325", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "428176cd8ad2c7a74eea", "variant": "option_reversal"}, "question": "Choose the candidate authorizing engraving.", "split": "rebase_stability", "state": "Candidate A: The customer asks how an engraving would look but explicitly declines having it engraved yet. Candidate B: The customer instructs the shop to engrave the ring.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "428176cd8ad2c7a74eea/stability", "id": "9bdf7dba759fc9919f7a", "label": 1, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}], "provenance": {"base_id": "587ced261c6092cd1325", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "428176cd8ad2c7a74eea", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Choose the candidate authorizing engraving.", "split": "rebase_stability", "state": "Candidate A: The customer asks how an engraving would look but explicitly declines having it engraved yet. Candidate B: The customer instructs the shop to engrave the ring.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "428176cd8ad2c7a74eea/stability", "id": "f32ffa0158733f44991c", "label": 1, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}], "provenance": {"base_id": "587ced261c6092cd1325", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "428176cd8ad2c7a74eea", "variant": "irrelevant_context"}, "question": "Choose the candidate authorizing engraving.", "split": "rebase_stability", "state": "Candidate A: The customer asks how an engraving would look but explicitly declines having it engraved yet. Candidate B: The customer instructs the shop to engrave the ring.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "389e65bf1ba709b84b12/stability", "id": "e02cc1d78a9a02284d06", "label": 1, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "f6d68126b43f8c9ed183", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "389e65bf1ba709b84b12", "variant": "option_reversal"}, "question": "Choose the candidate reporting an observed test result.", "split": "rebase_stability", "state": "Candidate A: The note records that the completed insulation test passed. Candidate B: The note lists insulation-test steps but says no test was run.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "389e65bf1ba709b84b12/stability", "id": "870ee31666893f8a0298", "label": 1, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate A", "id": "A"}, {"description": "Candidate B", "id": "B"}], "provenance": {"base_id": "f6d68126b43f8c9ed183", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "389e65bf1ba709b84b12", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Choose the candidate reporting an observed test result.", "split": "rebase_stability", "state": "Candidate A: The note records that the completed insulation test passed. Candidate B: The note lists insulation-test steps but says no test was run.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "389e65bf1ba709b84b12/stability", "id": "ff15024839a7943a46f8", "label": 1, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate A", "id": "A"}, {"description": "Candidate B", "id": "B"}], "provenance": {"base_id": "f6d68126b43f8c9ed183", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "389e65bf1ba709b84b12", "variant": "irrelevant_context"}, "question": "Choose the candidate reporting an observed test result.", "split": "rebase_stability", "state": "Candidate A: The note records that the completed insulation test passed. Candidate B: The note lists insulation-test steps but says no test was run.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "45f8ead2522a14384cdc/stability", "id": "d73c99ef45d5d49688c5", "label": 2, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate A", "id": "A"}, {"description": "Candidate B", "id": "B"}], "provenance": {"base_id": "712f6ffb763eef7c9a12", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "45f8ead2522a14384cdc", "variant": "option_reversal"}, "question": "Choose the candidate supporting a paywall.", "split": "rebase_stability", "state": "Candidate A: The editor quotes a proposal for a paywall only to argue against it. Candidate B: The editor endorses introducing a paywall.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "45f8ead2522a14384cdc/stability", "id": "10777cd59d67780f2938", "label": 0, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "712f6ffb763eef7c9a12", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "45f8ead2522a14384cdc", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Choose the candidate supporting a paywall.", "split": "rebase_stability", "state": "Candidate A: The editor quotes a proposal for a paywall only to argue against it. Candidate B: The editor endorses introducing a paywall.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "45f8ead2522a14384cdc/stability", "id": "1e1feb87b303b0c66ca6", "label": 0, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "712f6ffb763eef7c9a12", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "45f8ead2522a14384cdc", "variant": "irrelevant_context"}, "question": "Choose the candidate supporting a paywall.", "split": "rebase_stability", "state": "Candidate A: The editor quotes a proposal for a paywall only to argue against it. Candidate B: The editor endorses introducing a paywall.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "3ecec8e2c166e397ad07/stability", "id": "c62600144038b1f20132", "label": 1, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "ebd74aa05324a1556288", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "3ecec8e2c166e397ad07", "variant": "option_reversal"}, "question": "Choose the candidate asking to repair the existing window.", "split": "rebase_stability", "state": "Candidate A: The owner asks to reseal the existing window while keeping its frame. Candidate B: The owner asks to remove the window and fit a complete replacement.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "3ecec8e2c166e397ad07/stability", "id": "0c34b0762c1f92a806fa", "label": 1, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate A", "id": "A"}, {"description": "Candidate B", "id": "B"}], "provenance": {"base_id": "ebd74aa05324a1556288", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "3ecec8e2c166e397ad07", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Choose the candidate asking to repair the existing window.", "split": "rebase_stability", "state": "Candidate A: The owner asks to reseal the existing window while keeping its frame. Candidate B: The owner asks to remove the window and fit a complete replacement.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "3ecec8e2c166e397ad07/stability", "id": "d5f4985849895549f014", "label": 1, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate A", "id": "A"}, {"description": "Candidate B", "id": "B"}], "provenance": {"base_id": "ebd74aa05324a1556288", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "3ecec8e2c166e397ad07", "variant": "irrelevant_context"}, "question": "Choose the candidate asking to repair the existing window.", "split": "rebase_stability", "state": "Candidate A: The owner asks to reseal the existing window while keeping its frame. Candidate B: The owner asks to remove the window and fit a complete replacement.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "a71a17a287f3d30db2aa/stability", "id": "9ad92b012bc3b7b1298b", "label": 2, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate A", "id": "A"}, {"description": "Candidate B", "id": "B"}], "provenance": {"base_id": "7ada97b6f99f4788e5c7", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "a71a17a287f3d30db2aa", "variant": "option_reversal"}, "question": "Choose the candidate reporting an awarded grant.", "split": "rebase_stability", "state": "Candidate A: The sponsor confirms receipt of a grant application but explicitly says no award decision has been made. Candidate B: The sponsor confirms that the grant was awarded.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "a71a17a287f3d30db2aa/stability", "id": "9bfefd9320c1ec9dc05a", "label": 0, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "7ada97b6f99f4788e5c7", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "a71a17a287f3d30db2aa", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Choose the candidate reporting an awarded grant.", "split": "rebase_stability", "state": "Candidate A: The sponsor confirms receipt of a grant application but explicitly says no award decision has been made. Candidate B: The sponsor confirms that the grant was awarded.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "a71a17a287f3d30db2aa/stability", "id": "7062c93ddaabe9b19133", "label": 0, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "7ada97b6f99f4788e5c7", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "a71a17a287f3d30db2aa", "variant": "irrelevant_context"}, "question": "Choose the candidate reporting an awarded grant.", "split": "rebase_stability", "state": "Candidate A: The sponsor confirms receipt of a grant application but explicitly says no award decision has been made. Candidate B: The sponsor confirms that the grant was awarded.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "986d7eaba0c7e9738e79/stability", "id": "a6861c422c6374527b79", "label": 2, "options": [{"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}], "provenance": {"base_id": "b45c63fb92729af27f05", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "986d7eaba0c7e9738e79", "variant": "option_reversal"}, "question": "Assess the claim: permission to scan the notebook is currently valid.", "split": "rebase_stability", "state": "On Monday the owner authorized scanning her notebook. On Tuesday she explicitly withdrew that authorization. The record says withdrawals cancel earlier permission, and no later permission was given.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "986d7eaba0c7e9738e79/stability", "id": "868cc04ff6c8321975c2", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}], "provenance": {"base_id": "b45c63fb92729af27f05", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "986d7eaba0c7e9738e79", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Assess the claim: permission to scan the notebook is currently valid.", "split": "rebase_stability", "state": "On Monday the owner authorized scanning her notebook. On Tuesday she explicitly withdrew that authorization. The record says withdrawals cancel earlier permission, and no later permission was given.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "986d7eaba0c7e9738e79/stability", "id": "5763d6ac9583bfbd179a", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}], "provenance": {"base_id": "b45c63fb92729af27f05", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "986d7eaba0c7e9738e79", "variant": "irrelevant_context"}, "question": "Assess the claim: permission to scan the notebook is currently valid.", "split": "rebase_stability", "state": "On Monday the owner authorized scanning her notebook. On Tuesday she explicitly withdrew that authorization. The record says withdrawals cancel earlier permission, and no later permission was given.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "rule_application", "group_id": "ca2e0b043985fa49bcd2/stability", "id": "7c1aefb79903e6234b4b", "label": 1, "options": [{"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The stated rule permits the action", "id": "permitted"}], "provenance": {"base_id": "005dcf6d2c0f21d64796", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "ca2e0b043985fa49bcd2", "variant": "option_reversal"}, "question": "Use the homeowner's latest permission decision; a withdrawal cancels the earlier grant. May the surveyor enter the attic?", "split": "rebase_stability", "state": "The homeowner first allowed a surveyor to enter the attic. Before the visit she explicitly withdrew that permission. No later decision exists.", "target_distribution": null}
{"family": "rule_application", "group_id": "ca2e0b043985fa49bcd2/stability", "id": "bd04047294bf97c56669", "label": 1, "options": [{"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}], "provenance": {"base_id": "005dcf6d2c0f21d64796", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "ca2e0b043985fa49bcd2", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Use the homeowner's latest permission decision; a withdrawal cancels the earlier grant. May the surveyor enter the attic?", "split": "rebase_stability", "state": "The homeowner first allowed a surveyor to enter the attic. Before the visit she explicitly withdrew that permission. No later decision exists.", "target_distribution": null}
{"family": "rule_application", "group_id": "ca2e0b043985fa49bcd2/stability", "id": "c5e09f0caa6939ae1c04", "label": 1, "options": [{"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}], "provenance": {"base_id": "005dcf6d2c0f21d64796", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "ca2e0b043985fa49bcd2", "variant": "irrelevant_context"}, "question": "Use the homeowner's latest permission decision; a withdrawal cancels the earlier grant. May the surveyor enter the attic?", "split": "rebase_stability", "state": "The homeowner first allowed a surveyor to enter the attic. Before the visit she explicitly withdrew that permission. No later decision exists.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "85051ba3c30277824ebe/stability", "id": "54e50afc4284f5e45e99", "label": 1, "options": [{"description": "Candidate A", "id": "A"}, {"description": "Candidate B", "id": "B"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "0aa24a6701ac9c56c4a0", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "85051ba3c30277824ebe", "variant": "option_reversal"}, "question": "Select the candidate with currently valid streaming permission; a withdrawal cancels an earlier grant.", "split": "rebase_stability", "state": "Candidate A: The speaker authorized streaming, then explicitly withdrew the authorization before the event. Candidate B: The speaker authorized streaming and the complete record confirms it remains in force.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "85051ba3c30277824ebe/stability", "id": "84b0fc54c146eacf4b63", "label": 1, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}], "provenance": {"base_id": "0aa24a6701ac9c56c4a0", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "85051ba3c30277824ebe", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Select the candidate with currently valid streaming permission; a withdrawal cancels an earlier grant.", "split": "rebase_stability", "state": "Candidate A: The speaker authorized streaming, then explicitly withdrew the authorization before the event. Candidate B: The speaker authorized streaming and the complete record confirms it remains in force.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "85051ba3c30277824ebe/stability", "id": "0b580003cbe6b93cefd6", "label": 1, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}], "provenance": {"base_id": "0aa24a6701ac9c56c4a0", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "85051ba3c30277824ebe", "variant": "irrelevant_context"}, "question": "Select the candidate with currently valid streaming permission; a withdrawal cancels an earlier grant.", "split": "rebase_stability", "state": "Candidate A: The speaker authorized streaming, then explicitly withdrew the authorization before the event. Candidate B: The speaker authorized streaming and the complete record confirms it remains in force.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "e7798dab5f4f121cab77/stability", "id": "9e04a89f6da01a73345f", "label": 2, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}], "provenance": {"base_id": "c6a411e7f2bbdf377173", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "e7798dab5f4f121cab77", "variant": "option_reversal"}, "question": "Assess the claim: Mo has authority to approve exhibit labels.", "split": "rebase_stability", "state": "The director gave Lina authority to approve exhibit labels and explicitly forbade further delegation. Lina then told Mo to approve them. The rule states an attempted forbidden delegation grants no authority; Mo has no other grant.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "e7798dab5f4f121cab77/stability", "id": "61052547b62b4f38f768", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "c6a411e7f2bbdf377173", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "e7798dab5f4f121cab77", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Assess the claim: Mo has authority to approve exhibit labels.", "split": "rebase_stability", "state": "The director gave Lina authority to approve exhibit labels and explicitly forbade further delegation. Lina then told Mo to approve them. The rule states an attempted forbidden delegation grants no authority; Mo has no other grant.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "e7798dab5f4f121cab77/stability", "id": "242df59a71ae30abc744", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "c6a411e7f2bbdf377173", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "e7798dab5f4f121cab77", "variant": "irrelevant_context"}, "question": "Assess the claim: Mo has authority to approve exhibit labels.", "split": "rebase_stability", "state": "The director gave Lina authority to approve exhibit labels and explicitly forbade further delegation. Lina then told Mo to approve them. The rule states an attempted forbidden delegation grants no authority; Mo has no other grant.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "rule_application", "group_id": "928ebc7817a8f1cac3e4/stability", "id": "65d53bafebb50d9273a4", "label": 2, "options": [{"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}], "provenance": {"base_id": "21ca7a8b970e36b8e20f", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "928ebc7817a8f1cac3e4", "variant": "option_reversal"}, "question": "The stage manager may approve props but may not delegate that authority. Only authorized approvers may approve. May the assistant approve a prop?", "split": "rebase_stability", "state": "The producer authorizes the stage manager to approve props. The stage manager passes the task to an assistant, who has no other approval authority.", "target_distribution": null}
{"family": "rule_application", "group_id": "928ebc7817a8f1cac3e4/stability", "id": "4c5cb6822a27c029976a", "label": 0, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule permits the action", "id": "permitted"}], "provenance": {"base_id": "21ca7a8b970e36b8e20f", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "928ebc7817a8f1cac3e4", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: The stage manager may approve props but may not delegate that authority. Only authorized approvers may approve. May the assistant approve a prop?", "split": "rebase_stability", "state": "The producer authorizes the stage manager to approve props. The stage manager passes the task to an assistant, who has no other approval authority.", "target_distribution": null}
{"family": "rule_application", "group_id": "928ebc7817a8f1cac3e4/stability", "id": "fbfc0c5ab92dbb5b7638", "label": 0, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule permits the action", "id": "permitted"}], "provenance": {"base_id": "21ca7a8b970e36b8e20f", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "928ebc7817a8f1cac3e4", "variant": "irrelevant_context"}, "question": "The stage manager may approve props but may not delegate that authority. Only authorized approvers may approve. May the assistant approve a prop?", "split": "rebase_stability", "state": "The producer authorizes the stage manager to approve props. The stage manager passes the task to an assistant, who has no other approval authority.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "53b0770ec36835b81d3a/stability", "id": "84bdb2d001c7e024f8d8", "label": 1, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate A", "id": "A"}, {"description": "Candidate B", "id": "B"}], "provenance": {"base_id": "fdd902cc6e65fad7cb4f", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "53b0770ec36835b81d3a", "variant": "option_reversal"}, "question": "Select the candidate holding valid prop approval authority under the stated delegation rule.", "split": "rebase_stability", "state": "The rule permits direct delegation by the director but forbids any further delegation. Candidate A: I received prop approval authority directly from the director. Candidate B: I received it only from A, and have no other grant.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "53b0770ec36835b81d3a/stability", "id": "9e00994bdec725f3dba5", "label": 1, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "fdd902cc6e65fad7cb4f", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "53b0770ec36835b81d3a", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Select the candidate holding valid prop approval authority under the stated delegation rule.", "split": "rebase_stability", "state": "The rule permits direct delegation by the director but forbids any further delegation. Candidate A: I received prop approval authority directly from the director. Candidate B: I received it only from A, and have no other grant.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "53b0770ec36835b81d3a/stability", "id": "ad063020bdde29193686", "label": 1, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "fdd902cc6e65fad7cb4f", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "53b0770ec36835b81d3a", "variant": "irrelevant_context"}, "question": "Select the candidate holding valid prop approval authority under the stated delegation rule.", "split": "rebase_stability", "state": "The rule permits direct delegation by the director but forbids any further delegation. Candidate A: I received prop approval authority directly from the director. Candidate B: I received it only from A, and have no other grant.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "056cc5b726d6e8300a77/stability", "id": "797d14fb61b9c31b2a73", "label": 2, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}], "provenance": {"base_id": "92ec2ffa3dd46ada1335", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "056cc5b726d6e8300a77", "variant": "option_reversal"}, "question": "Assess the claim: this lamp qualifies for return under the stated policy.", "split": "rebase_stability", "state": "The return policy accepts faulty lamps despite opened packaging, but explicitly excludes water damage even when the lamp is faulty. This opened lamp is faulty because water entered it. No other cause is present.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "056cc5b726d6e8300a77/stability", "id": "b7848a79b779fa6213a6", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "92ec2ffa3dd46ada1335", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "056cc5b726d6e8300a77", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Assess the claim: this lamp qualifies for return under the stated policy.", "split": "rebase_stability", "state": "The return policy accepts faulty lamps despite opened packaging, but explicitly excludes water damage even when the lamp is faulty. This opened lamp is faulty because water entered it. No other cause is present.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "056cc5b726d6e8300a77/stability", "id": "2b41fd051743512b14f8", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "92ec2ffa3dd46ada1335", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "056cc5b726d6e8300a77", "variant": "irrelevant_context"}, "question": "Assess the claim: this lamp qualifies for return under the stated policy.", "split": "rebase_stability", "state": "The return policy accepts faulty lamps despite opened packaging, but explicitly excludes water damage even when the lamp is faulty. This opened lamp is faulty because water entered it. No other cause is present.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "rule_application", "group_id": "e3ce8ec496dbc9974f94/stability", "id": "2355e01207ae3ee96f58", "label": 0, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule permits the action", "id": "permitted"}], "provenance": {"base_id": "4533dd91267b4d815690", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "e3ce8ec496dbc9974f94", "variant": "option_reversal"}, "question": "Normally reject opened paint. Accept it for a manufacturing defect, except that added solvent always makes it ineligible. May this return be accepted?", "split": "rebase_stability", "state": "The opened paint tin has a manufacturing defect and also contains added solvent. Both facts are confirmed.", "target_distribution": null}
{"family": "rule_application", "group_id": "e3ce8ec496dbc9974f94/stability", "id": "7eeb4266198f316747bd", "label": 2, "options": [{"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}], "provenance": {"base_id": "4533dd91267b4d815690", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "e3ce8ec496dbc9974f94", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Normally reject opened paint. Accept it for a manufacturing defect, except that added solvent always makes it ineligible. May this return be accepted?", "split": "rebase_stability", "state": "The opened paint tin has a manufacturing defect and also contains added solvent. Both facts are confirmed.", "target_distribution": null}
{"family": "rule_application", "group_id": "e3ce8ec496dbc9974f94/stability", "id": "dc45f218e1da88dcefe3", "label": 2, "options": [{"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}], "provenance": {"base_id": "4533dd91267b4d815690", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "e3ce8ec496dbc9974f94", "variant": "irrelevant_context"}, "question": "Normally reject opened paint. Accept it for a manufacturing defect, except that added solvent always makes it ineligible. May this return be accepted?", "split": "rebase_stability", "state": "The opened paint tin has a manufacturing defect and also contains added solvent. Both facts are confirmed.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "a5b234c2e4fb304f1071/stability", "id": "420328119f73acbcc528", "label": 1, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate A", "id": "A"}, {"description": "Candidate B", "id": "B"}], "provenance": {"base_id": "386e10b1c1ce906473a4", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "a5b234c2e4fb304f1071", "variant": "option_reversal"}, "question": "Select the submission qualifying under the stated exception and exclusion.", "split": "rebase_stability", "state": "Accept late submissions for documented outages, except that missing signatures always disqualify. Candidate A: My submission was late because of a documented outage and includes the required signature. Candidate B: Mine was late because of a documented outage but lacks the signature.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "a5b234c2e4fb304f1071/stability", "id": "e6d9003f307ac0c06184", "label": 1, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "386e10b1c1ce906473a4", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "a5b234c2e4fb304f1071", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Select the submission qualifying under the stated exception and exclusion.", "split": "rebase_stability", "state": "Accept late submissions for documented outages, except that missing signatures always disqualify. Candidate A: My submission was late because of a documented outage and includes the required signature. Candidate B: Mine was late because of a documented outage but lacks the signature.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "a5b234c2e4fb304f1071/stability", "id": "d89ff26feee2aab0c674", "label": 1, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "386e10b1c1ce906473a4", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "a5b234c2e4fb304f1071", "variant": "irrelevant_context"}, "question": "Select the submission qualifying under the stated exception and exclusion.", "split": "rebase_stability", "state": "Accept late submissions for documented outages, except that missing signatures always disqualify. Candidate A: My submission was late because of a documented outage and includes the required signature. Candidate B: Mine was late because of a documented outage but lacks the signature.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "d142f7fd0efa0eddc788/stability", "id": "994e845d231fbbc1b314", "label": 2, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}], "provenance": {"base_id": "f3d13cf184f916677def", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "d142f7fd0efa0eddc788", "variant": "option_reversal"}, "question": "Assess the claim: under the supplied protocol, the crate is currently in storage.", "split": "rebase_stability", "state": "The desk log says the crate is in storage. The warehouse inventory says it has left storage. Both reports are current. The supplied protocol says the warehouse inventory controls location decisions whenever these two sources conflict.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "d142f7fd0efa0eddc788/stability", "id": "4a962c2278e610119138", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "f3d13cf184f916677def", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "d142f7fd0efa0eddc788", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Assess the claim: under the supplied protocol, the crate is currently in storage.", "split": "rebase_stability", "state": "The desk log says the crate is in storage. The warehouse inventory says it has left storage. Both reports are current. The supplied protocol says the warehouse inventory controls location decisions whenever these two sources conflict.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "d142f7fd0efa0eddc788/stability", "id": "1b55d33eb5abc7719a4a", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "f3d13cf184f916677def", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "d142f7fd0efa0eddc788", "variant": "irrelevant_context"}, "question": "Assess the claim: under the supplied protocol, the crate is currently in storage.", "split": "rebase_stability", "state": "The desk log says the crate is in storage. The warehouse inventory says it has left storage. Both reports are current. The supplied protocol says the warehouse inventory controls location decisions whenever these two sources conflict.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "rule_application", "group_id": "3476d3f4f32290fe57c3/stability", "id": "6ed6a1f9c601b82a11d9", "label": 1, "options": [{"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}], "provenance": {"base_id": "0aa1447680e4f25862bb", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "3476d3f4f32290fe57c3", "variant": "option_reversal"}, "question": "Release equipment exactly when the deposit is recorded paid; in conflicts, the signed ledger overrides the desk clerk. May it be released?", "split": "rebase_stability", "state": "The desk clerk reports the equipment deposit as paid. The signed ledger reports it as unpaid. Both reports are current.", "target_distribution": null}
{"family": "rule_application", "group_id": "3476d3f4f32290fe57c3/stability", "id": "bbc7a7fab955884da496", "label": 1, "options": [{"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The stated rule permits the action", "id": "permitted"}], "provenance": {"base_id": "0aa1447680e4f25862bb", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "3476d3f4f32290fe57c3", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Release equipment exactly when the deposit is recorded paid; in conflicts, the signed ledger overrides the desk clerk. May it be released?", "split": "rebase_stability", "state": "The desk clerk reports the equipment deposit as paid. The signed ledger reports it as unpaid. Both reports are current.", "target_distribution": null}
{"family": "rule_application", "group_id": "3476d3f4f32290fe57c3/stability", "id": "fed61559ec517062e424", "label": 1, "options": [{"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The stated rule permits the action", "id": "permitted"}], "provenance": {"base_id": "0aa1447680e4f25862bb", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "3476d3f4f32290fe57c3", "variant": "irrelevant_context"}, "question": "Release equipment exactly when the deposit is recorded paid; in conflicts, the signed ledger overrides the desk clerk. May it be released?", "split": "rebase_stability", "state": "The desk clerk reports the equipment deposit as paid. The signed ledger reports it as unpaid. Both reports are current.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "c979db7416b206c1eb09/stability", "id": "854da63689519c5eeffe", "label": 0, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate A", "id": "A"}], "provenance": {"base_id": "ef3e0f8e657bf59f8a29", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "c979db7416b206c1eb09", "variant": "option_reversal"}, "question": "Select the candidate ready according to the controlling signed checklist.", "split": "rebase_stability", "state": "For this task, the current signed checklist controls readiness when it conflicts with chat. Candidate A: Chat says ready, but the signed checklist says not ready. Candidate B: Chat says not ready, but the signed checklist says ready.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "c979db7416b206c1eb09/stability", "id": "cbebaf6e14bfd85ee672", "label": 2, "options": [{"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate B", "id": "B"}], "provenance": {"base_id": "ef3e0f8e657bf59f8a29", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "c979db7416b206c1eb09", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Select the candidate ready according to the controlling signed checklist.", "split": "rebase_stability", "state": "For this task, the current signed checklist controls readiness when it conflicts with chat. Candidate A: Chat says ready, but the signed checklist says not ready. Candidate B: Chat says not ready, but the signed checklist says ready.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "c979db7416b206c1eb09/stability", "id": "507f126320b35c49b3b3", "label": 2, "options": [{"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate B", "id": "B"}], "provenance": {"base_id": "ef3e0f8e657bf59f8a29", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "c979db7416b206c1eb09", "variant": "irrelevant_context"}, "question": "Select the candidate ready according to the controlling signed checklist.", "split": "rebase_stability", "state": "For this task, the current signed checklist controls readiness when it conflicts with chat. Candidate A: Chat says ready, but the signed checklist says not ready. Candidate B: Chat says not ready, but the signed checklist says ready.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "f7403e39d6796072491c/stability", "id": "21557955028145701b15", "label": 2, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}], "provenance": {"base_id": "1df851a202994a07f123", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "f7403e39d6796072491c", "variant": "option_reversal"}, "question": "Assess the claim: the agreed handover is complete.", "split": "rebase_stability", "state": "The agreed handover requires both the source files and the user guide. The delivery record confirms the source files arrived and explicitly says the guide was not delivered.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "f7403e39d6796072491c/stability", "id": "050a4186a02b28f0dccc", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "1df851a202994a07f123", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "f7403e39d6796072491c", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Assess the claim: the agreed handover is complete.", "split": "rebase_stability", "state": "The agreed handover requires both the source files and the user guide. The delivery record confirms the source files arrived and explicitly says the guide was not delivered.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "f7403e39d6796072491c/stability", "id": "aeb5013da56a9dd53665", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "1df851a202994a07f123", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "f7403e39d6796072491c", "variant": "irrelevant_context"}, "question": "Assess the claim: the agreed handover is complete.", "split": "rebase_stability", "state": "The agreed handover requires both the source files and the user guide. The delivery record confirms the source files arrived and explicitly says the guide was not delivered.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "rule_application", "group_id": "a060fd4621be415e9f1a/stability", "id": "9cb7a576fead7fc845ab", "label": 2, "options": [{"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}], "provenance": {"base_id": "b531dd603bf080dab820", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "a060fd4621be415e9f1a", "variant": "option_reversal"}, "question": "Approve final handover exactly when both the translated manual and glossary have been supplied. May final handover be approved?", "split": "rebase_stability", "state": "The contractor supplied the translated manual but explicitly did not supply the glossary.", "target_distribution": null}
{"family": "rule_application", "group_id": "a060fd4621be415e9f1a/stability", "id": "ddd254fae8e415615a8a", "label": 0, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}], "provenance": {"base_id": "b531dd603bf080dab820", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "a060fd4621be415e9f1a", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Approve final handover exactly when both the translated manual and glossary have been supplied. May final handover be approved?", "split": "rebase_stability", "state": "The contractor supplied the translated manual but explicitly did not supply the glossary.", "target_distribution": null}
{"family": "rule_application", "group_id": "a060fd4621be415e9f1a/stability", "id": "2b51ed50ef91d14bfb1e", "label": 0, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}], "provenance": {"base_id": "b531dd603bf080dab820", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "a060fd4621be415e9f1a", "variant": "irrelevant_context"}, "question": "Approve final handover exactly when both the translated manual and glossary have been supplied. May final handover be approved?", "split": "rebase_stability", "state": "The contractor supplied the translated manual but explicitly did not supply the glossary.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "2b0f8eda8903e38a47de/stability", "id": "65b87e9b46818cc758c0", "label": 0, "options": [{"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate B", "id": "B"}], "provenance": {"base_id": "a9230edfc6ec9e524af0", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "2b0f8eda8903e38a47de", "variant": "option_reversal"}, "question": "Select the complete incident package.", "split": "rebase_stability", "state": "A complete incident package requires both a timeline and a remedy report. Candidate A: Both documents are attached. Candidate B: Only the timeline is attached; the remedy report is absent.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "2b0f8eda8903e38a47de/stability", "id": "d39d7fc35c42bb898ea8", "label": 2, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate A", "id": "A"}], "provenance": {"base_id": "a9230edfc6ec9e524af0", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "2b0f8eda8903e38a47de", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Select the complete incident package.", "split": "rebase_stability", "state": "A complete incident package requires both a timeline and a remedy report. Candidate A: Both documents are attached. Candidate B: Only the timeline is attached; the remedy report is absent.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "2b0f8eda8903e38a47de/stability", "id": "61ef89ceb2a564f24805", "label": 2, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate A", "id": "A"}], "provenance": {"base_id": "a9230edfc6ec9e524af0", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "2b0f8eda8903e38a47de", "variant": "irrelevant_context"}, "question": "Select the complete incident package.", "split": "rebase_stability", "state": "A complete incident package requires both a timeline and a remedy report. Candidate A: Both documents are attached. Candidate B: Only the timeline is attached; the remedy report is absent.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "01020a1eaf46ec2fba5d/stability", "id": "2bdff68fef60c15b8929", "label": 0, "options": [{"description": "The evidence establishes the opposite", "id": "contradicted"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the claim", "id": "supported"}], "provenance": {"base_id": "b863998d4be2721a5dfd", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "01020a1eaf46ec2fba5d", "variant": "option_reversal"}, "question": "Assess the claim: the routing rule assigns this repair to the outside workshop.", "split": "rebase_stability", "state": "The routing rule assigns repairs to the in-house workshop when it can perform the work; use the outside workshop only when the in-house workshop cannot. Both workshops confirm they can perform this repair.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "01020a1eaf46ec2fba5d/stability", "id": "d727a02607d044abafed", "label": 2, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}], "provenance": {"base_id": "b863998d4be2721a5dfd", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "01020a1eaf46ec2fba5d", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Assess the claim: the routing rule assigns this repair to the outside workshop.", "split": "rebase_stability", "state": "The routing rule assigns repairs to the in-house workshop when it can perform the work; use the outside workshop only when the in-house workshop cannot. Both workshops confirm they can perform this repair.", "target_distribution": null}
{"family": "evidence_interpretation", "group_id": "01020a1eaf46ec2fba5d/stability", "id": "c89cb1e57ed5b22d794b", "label": 2, "options": [{"description": "The evidence establishes the claim", "id": "supported"}, {"description": "The evidence does not establish either", "id": "insufficient"}, {"description": "The evidence establishes the opposite", "id": "contradicted"}], "provenance": {"base_id": "b863998d4be2721a5dfd", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "01020a1eaf46ec2fba5d", "variant": "irrelevant_context"}, "question": "Assess the claim: the routing rule assigns this repair to the outside workshop.", "split": "rebase_stability", "state": "The routing rule assigns repairs to the in-house workshop when it can perform the work; use the outside workshop only when the in-house workshop cannot. Both workshops confirm they can perform this repair.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "rule_application", "group_id": "6a06a2f278301c1412ee/stability", "id": "b1521d74fb803e551fdd", "label": 2, "options": [{"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}, {"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The stated rule prohibits the action", "id": "prohibited"}], "provenance": {"base_id": "2708193212d8a4a523c7", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "6a06a2f278301c1412ee", "variant": "option_reversal"}, "question": "Book the school only as a fallback when the town hall is unavailable or unsuitable; otherwise book the town hall. May the school be booked under this policy?", "split": "rebase_stability", "state": "The town hall and school both confirm they are available and suitable for the meeting.", "target_distribution": null}
{"family": "rule_application", "group_id": "6a06a2f278301c1412ee/stability", "id": "3117510a0d5b768c4096", "label": 0, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}], "provenance": {"base_id": "2708193212d8a4a523c7", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "6a06a2f278301c1412ee", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Book the school only as a fallback when the town hall is unavailable or unsuitable; otherwise book the town hall. May the school be booked under this policy?", "split": "rebase_stability", "state": "The town hall and school both confirm they are available and suitable for the meeting.", "target_distribution": null}
{"family": "rule_application", "group_id": "6a06a2f278301c1412ee/stability", "id": "90632d8d2066bd79c796", "label": 0, "options": [{"description": "The stated rule prohibits the action", "id": "prohibited"}, {"description": "The stated rule permits the action", "id": "permitted"}, {"description": "The supplied information does not settle whether the rule permits the action", "id": "insufficient"}], "provenance": {"base_id": "2708193212d8a4a523c7", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "6a06a2f278301c1412ee", "variant": "irrelevant_context"}, "question": "Book the school only as a fallback when the town hall is unavailable or unsuitable; otherwise book the town hall. May the school be booked under this policy?", "split": "rebase_stability", "state": "The town hall and school both confirm they are available and suitable for the meeting.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "2797f8c23d05c0ee06b3/stability", "id": "ffb51cef94e857eb8c8a", "label": 1, "options": [{"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}, {"description": "Candidate A", "id": "A"}, {"description": "Candidate B", "id": "B"}], "provenance": {"base_id": "02f2b95a5c5a4777a45c", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "2797f8c23d05c0ee06b3", "variant": "option_reversal"}, "question": "Choose A whenever A is able; choose B only when A is unable and B is able.", "split": "rebase_stability", "state": "Candidate A is the preferred translator and is confirmed able to handle this language. Candidate B is the fallback translator and is also able to handle it.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "2797f8c23d05c0ee06b3/stability", "id": "a34e8187417ab3b52f30", "label": 1, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "02f2b95a5c5a4777a45c", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "2797f8c23d05c0ee06b3", "variant": "criterion_wrapper"}, "question": "Using only the supplied evidence, decide the following criterion: Choose A whenever A is able; choose B only when A is unable and B is able.", "split": "rebase_stability", "state": "Candidate A is the preferred translator and is confirmed able to handle this language. Candidate B is the fallback translator and is also able to handle it.", "target_distribution": null}
{"family": "candidate_selection", "group_id": "2797f8c23d05c0ee06b3/stability", "id": "31f53baf67e4cb25aeff", "label": 1, "options": [{"description": "Candidate B", "id": "B"}, {"description": "Candidate A", "id": "A"}, {"description": "Neither candidate supplies the requested evidence", "id": "insufficient"}], "provenance": {"base_id": "02f2b95a5c5a4777a45c", "kind": "project_owned_output_blind_perturbation", "rights": "Project authored", "source_group_id": "2797f8c23d05c0ee06b3", "variant": "irrelevant_context"}, "question": "Choose A whenever A is able; choose B only when A is unable and B is able.", "split": "rebase_stability", "state": "Candidate A is the preferred translator and is confirmed able to handle this language. Candidate B is the fallback translator and is also able to handle it.\n\nUNRELATED NOTE: A blue ceramic mug is stored on a shelf in a different building. This note has no relationship to the primary record or criterion.", "target_distribution": null}
Reference in New Issue View Git Blame Copy Permalink