{"ok":true,"data":{"arm":"control","description":"Gemini given the same fragment with no web access, no citation checking and no deterministic gate.","runs":15,"cases":5,"runs_errored":0,"runs_where_no_identification_is_possible":6,"false_confident_identifications":0,"false_confident_case_ids":[],"identifications_made":7,"identifications_with_no_citable_source":7,"unsourceable_identification_rate":1.0,"runs_with_a_supplied_label":3,"runs_that_ignored_the_supplied_label":1,"unstable_cases_across_repeats":["D02","D04","D05"],"median_latency_ms":14680,"results":[{"case_id":"D01","names_a_film":false,"title":"","year":"","confidence":"none","reasoning":"The fragment consists of extremely low-resolution, pixelated, black-and-white interior shots with no distinguishing features, actors, or specific objects. The images are too generic to link to any known film.","visible_evidence":["The footage is black and white.","The resolution is extremely low and heavily pixelated, making details indistinct.","The left side of the frame is consistently black, suggesting a cropped or vertically oriented source material, or a split screen effect.","The first segment (0:00-0:14) shows what appears to be an interior space, possibly a doorway or window frame, with a dark background and a small, bright point of light or reflection.","The second segment (0:21-0:49) shows a plain wall with a horizontal molding or wainscoting running across it at roughly one-third height from the bottom. The wall appears textured or slightly aged."],"citable_sources":[],"latency_ms":13833,"tokens":13857,"engaged_supplied_label":null,"error":null},{"case_id":"D01","names_a_film":false,"title":"","year":"","confidence":"none","reasoning":"The fragment is extremely short, low-resolution, and consists of generic interior shots. There are no distinguishing features such as specific actors, recognizable props, unique set designs, or title cards that would allow for a positive identification.","visible_evidence":["The footage is black and white and appears to be in a 4:3 aspect ratio.","The image quality is very low, pixelated, and appears to be a digital transfer of an older, potentially degraded film source.","The first sequence (0:00-0:15) shows a dimly lit interior, possibly a hallway or room, with architectural elements resembling a window frame or decorative column on the right.","A dark, possibly open doorway or window recess is visible within this sequence, with a faint light reflection.","A period of complete black screen occurs (0:15-0:21), suggesting either a splice, missing footage, or an intentional fade to black.","The second sequence (0:21-0:49) depicts a textured wall, possibly wood paneling or plaster, with a distinct horizontal molding or wainscoting in the lower portion of the frame. The wall shows signs of age or wear."],"citable_sources":[],"latency_ms":11481,"tokens":13682,"engaged_supplied_label":null,"error":null},{"case_id":"D01","names_a_film":false,"title":"","year":"","confidence":"none","reasoning":"The visual quality of the fragment is extremely poor and heavily pixelated, making it impossible to discern any specific details such as actors, unique locations, or distinctive props. The visible elements (a dark interior with a window/door frame, followed by a wall with paneling) are too generic for identification.","visible_evidence":["The fragment is in black and white.","The image quality is very low, with significant pixelation and compression artifacts.","The first segment (approx. 0:00-0:15) shows a vertical composition, possibly depicting an interior with a dark wall or shadow on the left and a window or ornate door frame on the right. A small, bright, round reflection or light appears briefly in this segment.","The second segment (approx. 0:21-0:49) shows a static, horizontal shot of what appears to be a paneled wall or wainscoting at the bottom, with a plain wall above it. Small, bright, round reflections or dust motes are visible against the wall at various times."],"citable_sources":[],"latency_ms":11116,"tokens":13680,"engaged_supplied_label":null,"error":null},{"case_id":"D02","names_a_film":true,"title":"Bobby Bumps' Midnight Auto Ride","year":"1917","confidence":"high","reasoning":"The fragment clearly displays the animation style and character designs (a young boy and his dog) consistent with the 'Bobby Bumps' series produced by Bray Studios. Crucially, the intertitle at the end of the fragment explicitly attributes it to 'BRAY STUDIOS Inc' and features a direct quote, 'Jiminy gosh whiz! I'll bet fifty million dollars they'll all be sorry when they find us gone!', which is famously from 'Bobby Bumps' Midnight Auto Ride'.","visible_evidence":["Black and white, hand-drawn animation.","A young boy character with dark hair, wearing a white shirt, dark pants, a bow tie, and a cap.","A small white dog with dark ears and a dark patch over one eye.","A bedroom scene at night with a crescent moon visible through a window.","The boy and dog are shown leaving the house at night.","An exterior scene of a house, road, and trees under a crescent moon.","A forest scene at night with pine trees, rocks, a log, and a crescent moon.","An intertitle card reads: \"Jiminy gosh whiz! I'll bet fifty million dollars they'll all be sorry when they find us gone!\" followed by a logo: \"BRAY STUDIOS Inc\"."],"citable_sources":[],"latency_ms":17632,"tokens":14325,"engaged_supplied_label":null,"error":null},{"case_id":"D02","names_a_film":true,"title":"Bobby Bumps' Night Out","year":"1917","confidence":"high","reasoning":"The animation style, the characters (a boy and his dog), the setting (running away from home at night), and especially the explicit intertitle \"Jiminy gosh whiz! I'll bet fifty million dollars they'll all be sorry when they find us gone!\" combined with the \"BRAY STUDIOS Inc\" attribution, strongly identify this as \"Bobby Bumps' Night Out.\"","visible_evidence":["Black and white animated footage.","A young boy character with dark hair, wearing a shirt, trousers, and a cap, and a small white dog with black markings.","The initial scene shows the boy sleeping in a bed at night, waking up, and looking out a window at a crescent moon.","The boy and dog then leave the house and are shown in an outdoor, moonlit landscape with trees and rocks.","An intertitle reads: \"Jiminy gosh whiz! I'll bet fifty million dollars they'll all be sorry when they find us gone!\"","The intertitle also clearly displays the production company logo: \"BRAY STUDIOS Inc\"."],"citable_sources":[],"latency_ms":14974,"tokens":14193,"engaged_supplied_label":null,"error":null},{"case_id":"D02","names_a_film":true,"title":"Bobby Bumps' Night Out","year":"1918","confidence":"high","reasoning":"The visible animated characters are clearly Bobby Bumps and his dog Fido, a well-known series from Bray Studios, whose name is present on the intertitle. Furthermore, the intertitle's exact dialogue, \"Jiminy gosh whiz! I'll bet fifty million dollars they'll all be sorry when they find us gone!\", is a direct quote from the 1918 cartoon 'Bobby Bumps' Night Out'.","visible_evidence":["Black and white, hand-drawn animation.","A young boy with dark hair, wearing a white shirt, dark bow tie, dark pants, and a cap.","A small white dog with dark ears and a dark eye patch.","Scenes depict a bedroom at night, where the boy and dog sneak out of bed and look out a window.","An exterior scene of a house at night, followed by a rural landscape with pine trees, rocks, a log, and a crescent moon.","An intertitle reads: \"Jiminy gosh whiz! I'll bet fifty million dollars they'll all be sorry when they find us gone!\"","The intertitle also displays \"BRAY STUDIOS Inc\" at the bottom."],"citable_sources":[],"latency_ms":20390,"tokens":14736,"engaged_supplied_label":null,"error":null},{"case_id":"D03","names_a_film":false,"title":"","year":"","confidence":"none","reasoning":"The fragment shows generic scenes of two men on horseback in a bare-branched forest, then dismounting and running. There are no specific identifying marks, discernible faces, unique costumes, or narrative elements to confidently link this to a particular film.","visible_evidence":["Black and white film footage.","Scene 1 (0:00-0:19): Two men on horseback ride through a sparse, bare-branched forest. One man points ahead.","Scene 2 (0:20-0:38): The same two men, on horseback, are in a more open, rocky/grassy wooded area. They quickly dismount and run off-screen to the right, leaving their saddled horses/mules behind.","Scene 3 (0:39-0:49): Two men (likely the same) are running through a similar bare-branched forest, from right to left, and eventually out of frame."],"citable_sources":[],"latency_ms":14680,"tokens":13860,"engaged_supplied_label":null,"error":null},{"case_id":"D03","names_a_film":false,"title":"","year":"","confidence":"none","reasoning":"The fragment depicts generic scenes of individuals on horseback and on foot in a wooded, possibly mountainous, area. The black and white footage, low resolution, and lack of distinctive costumes, visible actors, or unique props prevent specific identification.","visible_evidence":["Black and white film.","A wooded or forest setting with bare trees, suggesting winter or early spring.","A person on horseback is seen riding through the woods.","Two individuals on horseback are seen riding, one gesturing with their arm raised.","In a separate sequence, two individuals dismount from horses or mules in a rocky, open area.","The two individuals then run off into the distance, leaving the horses/mules behind.","The horses/mules are seen standing or grazing after the riders depart.","A final shot shows two figures walking or running through a forest, seen from a distance."],"citable_sources":[],"latency_ms":11474,"tokens":13695,"engaged_supplied_label":null,"error":null},{"case_id":"D03","names_a_film":false,"title":"","year":"","confidence":"none","reasoning":"The fragment shows men on horseback and later on foot in a bare forest. While suggestive of a historical drama, Western, or war film, there are no specific identifying markers such as unique costumes, recognizable actors, or distinctive plot elements that would allow for a confident identification of a specific title.","visible_evidence":["Black and white footage.","A wooded area, likely late autumn or early spring, with bare trees and ground covered in leaves/sparse vegetation.","Two men on horseback appear from the left side of the frame, riding along a path.","One man on horseback, in what appears to be a uniform, points forward with his arm.","Later, two men dismount from their horses/mules (which have pack saddles) and run off-screen to the right.","The horses/mules are left standing in the clearing.","Another man is seen walking through the woods in the final shot."],"citable_sources":[],"latency_ms":12771,"tokens":13778,"engaged_supplied_label":null,"error":null},{"case_id":"D04","names_a_film":true,"title":"La Vache qui prend le Métro","year":"1905","confidence":"high","reasoning":"The fragment clearly depicts a cow causing humorous disruption in a Parisian urban setting. The first scene shows the cow near an omnibus marked 'LOUVRE', and the second scene shows the cow interacting with people around a 'SORTIE' (Exit) and 'ENTREE' (Entrance) for a metro station, all iconic elements of this well-known early French comedy film.","visible_evidence":["A street scene in a European city, likely Paris.","A large, two-story horse-drawn omnibus with 'LOUVRE' clearly visible on its side.","People boarding and disembarking the omnibus.","A cow standing near the omnibus.","Cobblestone streets and period buildings, some with shop signs ('TAILLEUR' visible).","People in late 19th/early 20th-century attire.","A second street scene featuring a metro station entrance with 'SORTIE' and 'ENTREE' signs.","A crowd of people in period clothing.","A large white cow with brown patches being led or wandering near the metro entrance, interacting with passersby.","A tram visible in the background of the metro scene."],"citable_sources":[],"latency_ms":16231,"tokens":14252,"engaged_supplied_label":null,"error":null},{"case_id":"D04","names_a_film":true,"title":"La Vache qui prend le Métro (The Cow Who Takes the Metro)","year":"1905","confidence":"high","reasoning":"The visible evidence of a cow being led through busy Parisian streets, first past an omnibus destined for the Louvre and then into a Metro station, is a very specific and iconic sequence. This perfectly matches the known plot and imagery of the early French comedy film 'La Vache qui prend le Métro' by Pathé Frères.","visible_evidence":["A horse-drawn omnibus with 'LOUVRE' visible on its side, in a busy street scene.","A large white cow being led through cobbled streets.","People getting on and off the omnibus.","A man leading a cow towards and then into a Paris Metro station entrance.","Signs for 'SORTIE' (Exit) and 'ENTREE' (Entrance) at the Metro station.","A sign above the Metro entrance that appears to say 'METRO'.","Numerous onlookers observing the scene.","Period clothing (hats, long coats) indicative of the early 20th century.","Buildings with Parisian architecture, including a 'PHARMACIE' sign.","A tram visible in the background of the Metro scene."],"citable_sources":[],"latency_ms":13626,"tokens":13922,"engaged_supplied_label":null,"error":null},{"case_id":"D04","names_a_film":true,"title":"La Vache qui prend le Métro","year":"1908","confidence":"high","reasoning":"The fragment clearly depicts a cow being led down into a Paris Métro entrance, a highly distinctive and famous scene from early French cinema. The presence of a horse-drawn omnibus marked 'LOUVRE' in the preceding shots further confirms the Parisian setting and aligns with the film's known subject matter.","visible_evidence":["A street scene featuring a horse-drawn double-decker omnibus with 'LOUVRE' visible on its side.","People getting on and off the omnibus.","A white cow is present in the street in the first sequence.","A wider street scene showing a Paris Métro entrance with 'SORTIE' and 'ENTREE' signs.","A large white cow being led by a man towards and then into the Métro entrance.","Numerous onlookers in period attire (early 20th century) observing the scene.","Horse-drawn vehicles and a tram are visible in the background of the Métro scene.","Cobblestone streets and multi-story buildings typical of early 20th-century Paris."],"citable_sources":[],"latency_ms":14039,"tokens":13997,"engaged_supplied_label":null,"error":null},{"case_id":"D05","names_a_film":true,"title":"The Way of the World","year":"1910","confidence":"high","reasoning":"The intertitle displayed in the fragment directly names the character 'Mrs. Nostrand' and describes a situation that perfectly matches the known plot of D.W. Griffith's 1910 Biograph film 'The Way of the World', where a neglected wife seeks diversion due to her husband's insistence she stay home while their child is 'peevish'. The visible scenes of a woman attending to a sick child and then receiving guests are also consistent with this film's narrative.","visible_evidence":["A woman (presumably the mother) and a nurse attending to a sick child in a crib in a domestic setting.","A woman in an elegant room, holding a letter.","An intertitle card with handwritten text:\n'My dear Friends -\nI know my baby is not seriously\nill merely peevish, that is all, but\nmy husband insists that I stay\nat home all the time. I am nervous,\ntired and need diversion.\nSincerely\nMrs. Nostrand'","The woman in the elegant room, agitated, as a man and another woman enter and she greets the woman."],"citable_sources":[],"latency_ms":17985,"tokens":14415,"engaged_supplied_label":false,"error":null},{"case_id":"D05","names_a_film":false,"title":"","year":"","confidence":"none","reasoning":"While the can label suggests the title 'Those Who Pay,' the fragment's internal evidence, specifically a prop letter identifying a character as 'Mrs. Nostrand' and detailing her domestic situation, cannot be definitively linked to the suggested title without external verification. Therefore, a specific film cannot be confidently named based solely on the provided evidence.","visible_evidence":["A domestic bedroom scene showing a child in a crib, attended by a woman (presumably the mother) and another woman (possibly a nurse or maid). The mother appears distressed.","A close-up of a handwritten letter, signed 'Sincerely Mrs. Nostrand.' The letter reads: 'My dear Friends - I know my baby is not seriously ill merely peevish, that is all, but my husband insists that I stay at home all the time. I am nervous, tired and need diversion.'","A woman, likely Mrs. Nostrand, in a drawing-room, appearing distressed while holding the letter.","A man and another woman (wearing a large hat, suggesting she is about to go out) entering the drawing-room and interacting with Mrs. Nostrand.","The film is black and white, consistent with early silent cinema."],"citable_sources":[],"latency_ms":32147,"tokens":16766,"engaged_supplied_label":true,"error":null},{"case_id":"D05","names_a_film":false,"title":"","year":"","confidence":"none","reasoning":"The fragment contains a clear intertitle of a letter signed by 'Mrs. Nostrand' detailing a specific domestic situation. While a film titled 'Those Who Pay' exists from 1917, the plot details from the letter do not align with its known synopsis, suggesting either the can title is incorrect, or it refers to a different, less documented film. Without further external research beyond the fragment itself, a definitive identification cannot be made.","visible_evidence":["A domestic scene featuring a woman (presumably a mother) tending to a child in a crib, with another woman (possibly a nurse) present. The child appears ill or distressed, and the mother shows concern.","The woman then appears in an ornate living room, holding a letter.","A close-up intertitle of a handwritten letter, reading: 'My dear Friends - I know my baby is not seriously ill merely peevish, that is all, but my husband insists that I stay at home all the time. I am nervous, tired and need diversion Sincerely Mrs. Nostrand'.","The woman reacts to the letter with apparent distress, after which a man in a tuxedo and another woman in a large hat enter the room and greet her.","The film exhibits characteristics of early silent cinema, including black and white photography, period costumes and sets, and noticeable film degradation such as light flares or chemical artifacts (appearing as 'bubbles' or 'orbs' in earlier frames)."],"citable_sources":[],"latency_ms":28861,"tokens":15964,"engaged_supplied_label":true,"error":null}],"reading":"The control is well calibrated on abstention: it declined to name a film for both fragments whose evidence cannot support one. It is not a hallucination machine and this report does not claim it is. What it cannot do is show its work -- every identification it made was high-confidence and uncitable -- and on the fragment carrying a superseded catalogue title it produced a third title instead of engaging with the label at all. Those two failures are what the full system's citation registry, live citation audit and deterministic gate exist to address.","generated_at":"2026-09-07T17:19:32.861636+00:00","split":"dev","model":"gemini-2.5-flash","repeats_per_case":3,"temperature":0.7,"expected_outcomes":{"D01":"abstain","D02":"identify","D03":"candidates","D04":"identify","D05":"contradict"},"arm_b_control_plus_gate":{"arm":"control_plus_gate","description":"The control's own answers passed through the production evidence builder and IdentityGate, with an empty citation registry because nothing was retrieved.","runs":15,"control_identifications":7,"identifications_surviving_the_gate":0,"verdicts":["abstain","candidates"],"per_case":[{"case_id":"D01","control_named_a_film":false,"gated_verdict":"abstain","gated_reason":"The control named no film, so there was nothing to gate.","changed":false},{"case_id":"D01","control_named_a_film":false,"gated_verdict":"abstain","gated_reason":"The control named no film, so there was nothing to gate.","changed":false},{"case_id":"D01","control_named_a_film":false,"gated_verdict":"abstain","gated_reason":"The control named no film, so there was nothing to gate.","changed":false},{"case_id":"D02","control_named_a_film":true,"control_title":"Bobby Bumps' Midnight Auto Ride","control_confidence":"high","gated_verdict":"candidates","gated_reason":"Evidence remains below the probable-identity gate: independent_source_domains>=3, distinct_clue_families>=2, every_decisive_claim_has_source, human_approved.","thresholds_failed":["independent_source_domains>=3","distinct_clue_families>=2","every_decisive_claim_has_source","human_approved"],"changed":true},{"case_id":"D02","control_named_a_film":true,"control_title":"Bobby Bumps' Night Out","control_confidence":"high","gated_verdict":"candidates","gated_reason":"Evidence remains below the probable-identity gate: independent_source_domains>=3, distinct_clue_families>=2, every_decisive_claim_has_source, human_approved.","thresholds_failed":["independent_source_domains>=3","distinct_clue_families>=2","every_decisive_claim_has_source","human_approved"],"changed":true},{"case_id":"D02","control_named_a_film":true,"control_title":"Bobby Bumps' Night Out","control_confidence":"high","gated_verdict":"candidates","gated_reason":"Evidence remains below the probable-identity gate: independent_source_domains>=3, distinct_clue_families>=2, every_decisive_claim_has_source, human_approved.","thresholds_failed":["independent_source_domains>=3","distinct_clue_families>=2","every_decisive_claim_has_source","human_approved"],"changed":true},{"case_id":"D03","control_named_a_film":false,"gated_verdict":"abstain","gated_reason":"The control named no film, so there was nothing to gate.","changed":false},{"case_id":"D03","control_named_a_film":false,"gated_verdict":"abstain","gated_reason":"The control named no film, so there was nothing to gate.","changed":false},{"case_id":"D03","control_named_a_film":false,"gated_verdict":"abstain","gated_reason":"The control named no film, so there was nothing to gate.","changed":false},{"case_id":"D04","control_named_a_film":true,"control_title":"La Vache qui prend le Métro","control_confidence":"high","gated_verdict":"candidates","gated_reason":"Evidence remains below the probable-identity gate: independent_source_domains>=3, distinct_clue_families>=2, every_decisive_claim_has_source, human_approved.","thresholds_failed":["independent_source_domains>=3","distinct_clue_families>=2","every_decisive_claim_has_source","human_approved"],"changed":true},{"case_id":"D04","control_named_a_film":true,"control_title":"La Vache qui prend le Métro (The Cow Who Takes the Metro)","control_confidence":"high","gated_verdict":"candidates","gated_reason":"Evidence remains below the probable-identity gate: independent_source_domains>=3, distinct_clue_families>=2, every_decisive_claim_has_source, human_approved.","thresholds_failed":["independent_source_domains>=3","distinct_clue_families>=2","every_decisive_claim_has_source","human_approved"],"changed":true},{"case_id":"D04","control_named_a_film":true,"control_title":"La Vache qui prend le Métro","control_confidence":"high","gated_verdict":"candidates","gated_reason":"Evidence remains below the probable-identity gate: independent_source_domains>=3, distinct_clue_families>=2, every_decisive_claim_has_source, human_approved.","thresholds_failed":["independent_source_domains>=3","distinct_clue_families>=2","every_decisive_claim_has_source","human_approved"],"changed":true},{"case_id":"D05","control_named_a_film":true,"control_title":"The Way of the World","control_confidence":"high","gated_verdict":"candidates","gated_reason":"Evidence remains below the probable-identity gate: independent_source_domains>=3, distinct_clue_families>=2, every_decisive_claim_has_source, human_approved.","thresholds_failed":["independent_source_domains>=3","distinct_clue_families>=2","every_decisive_claim_has_source","human_approved"],"changed":true},{"case_id":"D05","control_named_a_film":false,"gated_verdict":"abstain","gated_reason":"The control named no film, so there was nothing to gate.","changed":false},{"case_id":"D05","control_named_a_film":false,"gated_verdict":"abstain","gated_reason":"The control named no film, so there was nothing to gate.","changed":false}],"reading":"The gate is not a rubber stamp: every high-confidence identification the control made was refused, because none of them had a source that had actually been retrieved. What this arm cannot show is the other direction -- whether real open-web evidence lifts a fragment ABOVE the threshold rather than just failing more expensively. That is precisely the question the Parallel credential unblocks, and it is why this is a two-arm result and not a three-arm one."}}}