Questions and answers.
What Core contains, what it costs, how it is graded, and what the license allows.
What is Tickmark Bench?
Tickmark Bench is a set of graded questions built from the XBRL financial data that companies file with the SEC on EDGAR. Tasks ship in the Prime Intellect verifiers format.
What is in Core?
Core is the real_v1 verified batch: 149 tasks from 67 companies, with filing dates from 2026-04-07 to 2026-09-29. It ships as one zip: tasks.jsonl, grade.py, README, datasheet, license and checksums.
How much does Core cost?
Core is $299 one-time through Stripe Checkout. The download link is emailed when payment completes. It lasts 7 days and works for 5 downloads.
Is there a free sample?
Yes. The free sample has 20 tasks, five of each type, in an earlier sample format. They are not part of Core.
How are answers graded?
Core is scored entirely by grade.py. Numeric answers are scored within the stated tolerance, and claim checks on the verdict alone. The official score is score = passed/149.
What kinds of tasks are there?
Four families: single_number, multi_period, claim_check, and comparison. A count of tasks in each family is not published.
Where does the data come from?
Tasks are built from the SEC Financial Statement Data Sets, the bulk XBRL files the Commission publishes. Filings are from Q2 2026 or later.
Are solve rates published?
Solve rates: not yet published. We publish only measured numbers, with model, attempts and date.
Can I train on Core?
The license lets your organization use the zip for training, evaluation, and internal research. It does not let you resell the zip or post it as a public dataset.
What is the refund policy?
Within 14 days of purchase, you can have a full refund if the delivered data does not match the published datasheet: the task count, the fields, or traceability to the cited SEC filings.
Is Tickmark Bench affiliated with the SEC?
No. Tickmark Bench is not affiliated with the Commission, and it is not a product of the Commission.
More detail is on the datasheet, the grading page, and the Terms. Write to data@tickmarkbench.com.