ARCHIVAL IDENTIFICATION TRIAGE

Before an unidentified reel is discarded, investigate what it might be.

Last Seen Alive finds clues inside a nameless film fragment, searches historical records, tries to prove itself wrong, and shows an archivist exactly what the evidence can, and cannot, establish.

A five-role Google ADK workflow extracts typed multimodal clues, researches through six Parallel surfaces, re-opens every cited page to confirm the quotation, attempts falsification, then passes structured evidence to a pure deterministic gate with mandatory human approval.

Decision owner
Archivist
Primary metric
0 identities asserted
Web evidence
Parallel at runtime
Outcome
Probable · candidates · abstain

NEW HERE? THREE PAGES, IN THIS ORDER

The whole thing in about four minutes.

  1. 1 Watch a fragment Ten real reels from the Library of Congress. Five it should identify, five it should not. Play one, download it, read what the answer key says. Watch the ten fragments
  2. 2 Read what it found A finished investigation, without waiting five minutes for one. Every claim, the source behind it, and the citations that were thrown out. Open a real dossier
  3. 3 See where it was wrong We ran the same five fragments twenty-eight times and published every run, including the nine where it named the wrong film. Read the evaluation

Then, if you want the rest: run one yourself · call the API · what archivists asked for · how it is built.

THE FAILURE, IN TEN SECONDS

The frame has clues. The can has no name.

  1. A · rare phraseSearch it verbatim, not as a plot summary.
  2. B · visual periodUseful only when another source corroborates it.
  3. C · stock markConstrains a date; it does not identify a title.

WHO THIS IS FOR

An archivist triaging unidentified material.

The tool does the broad, repetitive investigation and hands over a dossier. The archivist, not the model, decides whether the evidence is strong enough to act on.

The gate requires three independent domains, two distinct clue families, temporal and entity compatibility, no unresolved contradiction, cited decisive claims, and explicit human approval.

THE SCALE, FROM THE PEOPLE WHO COUNTED IT

Most of it is already gone. What survives is often nameless.

The Library of Congress commissioned a census. Of roughly 11,000 American silent feature films, 14 percent, about 1,575 titles, survive in their original format. Another 26 percent of survivors were found abroad.

“The loss of American silent-era feature films constitutes an alarming and irreversible loss to our nation’s cultural record.”

James H. Billington, Librarian of Congress, on the publication of David Pierce’s The Survival of American Silent Feature Films: 1912–1929 (CLIR / Library of Congress, 2013). Source

Survival is not the whole problem. A reel that exists but cannot be named is not catalogued, not searchable and not prioritised for funding. The Library runs an annual workshop for exactly this, and it publishes its own hit rate.

“Mostly Lost”, Library of Congress Packard Campus: films identified during the event. Further identifications follow afterwards: 46 more in 2017, 24 more in 2018.
YearTitles screenedIdentified at the event
201614232 · 23%
201718052 · 29%
201818756 · 30%

This is context, not a scoreboard. Their corpus is 187 films chosen because they are hard; ours is five with a sealed answer key. The two are not comparable, five cases support no rate at all, and this project makes no claim to outperform expert archivists. It is cited so a reader knows that the people who do this for a living identify well under half of what they screen, and that anyone promising near-certainty on this task is selling something. See the full register.

TRY IT NOW

Run a public fragment, or bring your own.

No signup. The page mints itself a real API key the moment you press run, and calls the same public endpoints you would. There is no privileged internal path.

Library of Congress, Motion Picture, Broadcasting, and Recorded Sound Division. United States public domain.

Investigation

An investigation runs five agents and several live Parallel calls, so it takes 61 to 444 seconds, median 304 over 27 measured runs. Nothing is queued or cached, so every run is real.

Hackathon judge?Mint a 60-day key instantly. No email, no signup.

HOW IT WORKS

Five roles research. Code verifies. A human decides.

  1. 01

    Visual Examiner

    Writes down the words and physical clues visible in the fragment.

    Gemini multimodal emits a typed clue set; verbatim intertitles remain verbatim.

  2. 02

    Phrase Hunter

    Searches old publications using the rarest exact words.

    Parallel Search API receives two to five literal, diverse probes and returns long cited excerpts.

  3. 03

    Holdings Researcher

    Checks alternate titles, then counts which archives actually list the film.

    Parallel Task API performs multi-hop research against a JSON output schema; Parallel FindAll enumerates the named catalogues that hold it.

  4. 04

    Skeptic

    Tries to prove each candidate wrong.

    Gemini directs fresh Parallel searches for date, entity and attribution contradictions.

  5. 05

    Citation audit · deterministic

    Every page a claim quotes is re-opened and checked.

    Parallel Extract fetches each cited page; a quotation that is not in the live document is refused by the gate.

  6. 06

    Evidence gate · deterministic

    Code checks every rule. An archivist must still approve.

    A pure Python function exposes every boolean threshold as gate.passed and gate.failed.

THE STACK

Eleven sponsor surfaces, each doing a job the product needs.

Five Google Cloud services and all six of Parallel's product surfaces. Every one names the function that calls it, and reports whether it is reachable right now.

GOOGLE CLOUD · 5

Reads the frame, runs the workflow, holds the secrets

Agent Development Kit sequences the five roles and keeps each output separately inspectable. Gemini on Vertex AI reads the fragment and argues against itself. Controlled generation forces a typed claim structure, because prose cannot be gated. Cloud Run hosts it; Secret Manager holds the credentials.

PARALLEL · 6

Every open-web fact, and every check on it

Search hunts rare literal strings. Task researches holdings against a schema. FindAll names the catalogues that let us describe coverage honestly. Extract re-opens cited pages to confirm quotations. Task Group gives each candidate an independent attacker. Monitor keeps looking after we abstain.

See exactly how each one is used, and its live status →

WHAT IT WILL NOT DO

Uncertainty is an output.

It never says “last surviving copy.” Searching every catalogue you can name tells you where a print is; it can never tell you no other print exists. The only permitted sentence is: “No additional holding was found across these named catalogues as of this search date”, followed by the names. Sentences that break that rule are caught in code and shown to you as violations rather than published as findings.

A fragment without legible, discriminating clues may remain unidentified, and the system will abstain. That is a result, not a failure, and you can leave a standing watch on it.

EVALUATION

We measured the alternative before we measured ourselves.

Three arms on the same five Library of Congress fragments. A: Gemini alone, no web, no gate. B: those same answers put through the real gate. C: the full system with all six Parallel surfaces live. The baseline was measured first, before the credential existed, so its numbers could not be tuned after the fact.

Development split, five fragments, scored against the sealed answer key. Raw: arms A and B · arm C · method.
MeasureA · Gemini aloneB · + the gateC · full system
Correct identities surfaced0 of 30 of 32 of 3 (this pass)
False-confident identifications000
Identifications with no citable source7 of 7n/a0
Answers unstable across repeats3 of 3 casesn/a4 of 5 cases moved over 28 runs
Median latency15 s15 s383 s (this pass; 299 s over 18)

Two results carry it. D02: the control returned three different Bray cartoons across three runs, every one at high confidence, none sourced, all wrong. The full system returned Dud Leaves Home (1919), the answer key exactly, on 9 decisive claims across 9 domains, citing the very Library of Congress record the benchmark was built from. D05 arrives mislabelled “Those who pay”; the control replaced it with two different wrong films, the full system surfaced Through the Breakers (1909), the documented correction, with a contradiction claim.

Then we ran it 28 times, and the column above did not survive

Arm C is a single pass. Six passes over the same five fragments, 28 runs in total, say something quite different, and we would rather you heard it from us.

See every run, case by case, including the ones that went badly. Raw data: /v1/eval/stability · /v1/eval/fix-comparison.
Across 28 runsCount
Cases that gave the same verdict every time1 of 5
Correct identities3
False-confident identifications9 (16 on the strictest reading)
Candidates that were not a film at all7 (now 0, fixed)
Runs that reached probable0

Two findings hurt. D02 returned four different leading candidates in four runs: the correct film once, the studio once, and two other films. And D04 returned the same wrong film, Un coin de Paris (1900), in three of four runs at five of seven thresholds: not noise, a reproducible misidentification. “Zero false-confident identifications” is a property of one pass, not of this system, and every surface that quoted it now says so.

We fixed both defects and measured again, and only one of them went away. Candidates that named no film went from 7 to 0. False-confident identifications did not improve. Constraining the candidate type turned disguised failures into visible wrong answers rather than removing them. The error rate was always this high; the non-films were hiding it. Both eras are published at /v1/eval/fix-comparison.

We could have shipped the good pass and said nothing. Publishing this is the only position consistent with everything else on this page. And one thing did hold across all 19: no run ever reached probable, because that threshold needs a human the API cannot supply. Every wrong answer above arrived as candidates with its failing thresholds attached. The defensible claim is not that this system is not wrong. It is that it does not assert what it cannot support, and shows its working.

The miss, and why we are keeping it

D04 abstained where the answer key says Buying a cow. The research worked: 13 domains, “LOUVRE” and “TABAC” correctly transcribed. Then ten citations were rejected: eight because the compiler paraphrased instead of quoting Parallel verbatim, two because Extract could not find the quote on the live page. No decisive claim survived, so it abstained. The strictness that stops this system asserting an identity on its own is the same strictness that cost this one. We are not loosening it; a system that accepts paraphrased citations has given up the only thing it offers.

Held-out split · still sealed

False-confident IDsNot runHeld-out · n=5 · target 0
Correct abstentionsNot runHeld-out · n=5
Citation precisionNot runDecisive claims checked by hand

Opened exactly once, after the implementation is tagged eval-freeze-*, with the misses published beside the successes. Hashes are published now so the set cannot be quietly changed. Download the manifest.

PRIOR ART

Why not a screenshot matcher or archive catalogue?

Our documented search found screenshot identifiers, archive cataloguing products, and crowdsourced identification projects, but did not find a production system combining multimodal clue extraction, live open-web historical investigation, adversarial verification, global holdings research, and claim-level provenance. This is a documented search result, not a claim that private systems cannot exist.

HONEST RISKS

The benchmark is easier than a genuinely unknown reel.

The evaluation fragments have known answers; real orphan material may not. Search coverage is uneven outside digitised English-language sources. Exact phrases can be reused. Human approval is mandatory because the gate measures evidence completeness, not historical truth.