B BrowseComp Review Desk
Sign-in required
How to use this

Candidate evaluation

Turn a response export
into a clear decision.

Validate every submission, run the complete review policy, and download an audit-ready CSV—without changing your original file.

Review policy Pass@3 ≤ 1

Location, qualification, response quality, and source checks included.

Step 01

Sign in to continue

Turing accounts only

First time here? Read the one-minute guide

01Immutable input

The original export is never overwritten.

02Conservative review

Uncertain evidence is always sent to a human.

03Auditable output

Every decision includes a reason and an approver.

Getting started

Using the review desk

Takes about a minute to learn

  1. 01

    Sign in

    Click Continue with Google and use your Turing account. There is no password to remember. An admin has to add you first — a Google account that is not on the list is turned away even when the login itself succeeds.

    Your roles appear next to your email at the top of the page. Reviewer runs reviews, viewer opens and downloads finished ones, admin also manages the user list.

  2. 02

    Review an export

    Drop the Google Forms CSV onto the panel above, up to 20 MB, then click Validate & review. Location, qualification, response quality, and source checks all run in one pass.

    A few hundred rows take a couple of minutes, mostly spent waiting on the cited URLs. You can close the tab — the review keeps running and this page picks it up again when you come back.

  3. 03

    Take the output

    Three files come out of a completed review:

    Reviewed CSV
    Your export with Delivery Feedback rewritten and Approver and Reason appended. This is the file you hand back.
    Manual-review CSV
    Only the rows still needing a human decision. This is your worklist.
    Audit JSONL
    One record per row: what was checked, what was found, and why the decision landed where it did.
What the four decisions mean

Only rows whose Delivery Feedback reads Pending Delivery Review are evaluated. Everything else is copied through untouched, so re-running a file never re-decides a row a human already owns.

Delivery FeedbackMeaning
Rejected Restricted location, a qualification other than Master's or PhD, or more than one Yes response evaluation.
Needs Review Missing or invalid data, or evidence that could not be reached. The reason names each problem.
Conditionally Accepted Every automated check passed, but a human still judges prompt ambiguity and whether the sources support the answer.
Accepted As above, with structured semantic evidence. This version does not produce it, so a clean row lands on Conditionally Accepted.

Both Needs Review and Conditionally Accepted rows appear in the manual-review CSV. That file is where the remaining human work lives.

Columns the export must contain

Uploading a CSV: columns are found by their header text, so the order in the file does not matter and columns the export does not define are ignored. Each Required header must appear exactly once — missing or duplicated is fatal, and the error names every offender. Optional ones may be absent; they are carried into the output untouched and never affect a decision.

Pasting a single row: there are no headers to go on, so the values are read by position — all 28 cells, in the order below, empty ones included. Paste the row exactly as exported. A shuffled row is caught when the email cell stops looking like an address, but the check cannot see every kind of reordering, so a row that was rearranged by hand can still be judged on the wrong values.

Loading the column list…

A header may carry extra text after the expected wording — Google Forms often appends to a question — but it has to begin with it. Cutting a header shorter than the wording the review matches on is what usually breaks an otherwise valid export.

Checking a single row

Switch to Single row to paste one CSV or Excel row and see the decision straight away, with the reasoning and the result of every source check. Nothing is saved and nothing is downloadable — it is for spot-checking a judgement, not for delivery.

If the export is rejected before review

When the header does not match the expected columns, the review stops before doing anything and lists exactly which columns are missing, ambiguous, or unexpected. Fix the export and try again — nothing was written.

Managing users (admins)

Click Users in the header. Add someone by email, tick the roles they need, and they can sign in straight away. Role changes and removals take effect on that person's next click rather than whenever their session expires. The last admin cannot be removed or demoted.