ConductScience.org, home

Library / Benchmarks

Benchmarks

Page version 0.1.0

How fast each library database answers, whether its records name their sources, and how closely Trials matches the records it copies.

Checked on 15 Nov 2026

The databases

Every night we time three requests to each database, five times each: a search with no words, the first record it lists and, where records have sections, that record's first section. Every week we open the first 20 records of that search and check that every row names its source. A database is listed here once it passes every check of its speed, its release and its records.

Speed, release and sources of each database, checked on 15 Nov 2026
DatabaseReleaseMedian answerSlowest answerErrorsNewest release servedRows naming their source
Genes11 Nov 202639 ms91 ms0 of 15Yes997 of 997
Trials12 Nov 202648 ms198 ms0 of 15Yes411 of 411
Trial comparisons23 Mar 202646 ms79 ms0 of 10Yes497 of 497
Instruments15 Nov 202626 ms57 ms0 of 15Yes961 of 961
Drugs and targets18 Sep 202631 ms61 ms0 of 15Yes2,071 of 2,071
Diseases18 Sep 202628 ms53 ms0 of 15Yes2,264 of 2,264
Companies14 Nov 202628 ms39 ms0 of 15Yes1,960 of 1,960
Cell lines14 Nov 202630 ms101 ms0 of 15Yes1,460 of 1,460
Journal index6 Nov 202629 ms84 ms0 of 15Yes1,898 of 1,898
  • Newest release served: the database serves the newest release built for it. The Release column gives its date.
  • Rows naming their source: the rows of every section of the first 20 records, each naming its source with a record ID or a link.
  • Pass marks: no errors, 95% of answers within 2,000 ms, the newest release served, and every row naming its source.

Trials

The checks ask whether a person can find the trial they mean, then read what it registered and posted as ClinicalTrials.gov states it.

Release of 12 Nov 2026, checked on 15 Nov 2026

Records compared with their sources

Trials records compared with their sources
ComparedWithCheckedSameUpdated at the source after our copyDifferentPass mark
The facts at the top of a trial's recordClinicalTrials.gov200 trials19730190 of 200
Posted results of the first three outcomesClinicalTrials.gov406 values4024095%
Adverse event totalsClinicalTrials.gov1,170 rows1,15413395%
Participants who started and completed each groupClinicalTrials.gov150 trials1490195%
Papers linked to a trial, with their typeClinicalTrials.gov200 links20000190 of 200
NIH grants linked to a trialNIH RePORTER100 links970395%
  • The facts at the top of a trial's record are its title, status, phases, enrollment, lead sponsor, conditions, interventions and the day its results were first posted.
  • Updated at the source after our copy: our value differs from the source's current one, and the source updated that record after the day of our copy.
  • Pass mark: how many must be the same, or updated at the source after our copy.
  • Posted results: 4 more values could not be judged, because ClinicalTrials.gov gave nothing to compare them with.
Trials counted on the day of each copy
Counted on the day of each copyOur copyClinicalTrials.govPass mark
Registered trials611,552611,551Within 0.5%
Trials with posted results77,07877,108Within 0.5%
  • Each count is made on the day of its own copy: one of the registry, and one of the posted results.
  • Since our copy of the posted results, 3,921 more trials have posted their first results at ClinicalTrials.gov. Trials does not show those results yet.

Finding a trial

Searches of Trials for one trial
Search bySearchesListed firstIn the first fivePass markClinicalTrials.gov's own search, listed first
NCT number200200200All listed first200 of 200
Title200198199190 in the first five167 of 176
  • NCT number: the trial's ID at ClinicalTrials.gov.
  • Title: the trial's brief title, as ClinicalTrials.gov gives it.
  • 24 of the 200 title searches sent to ClinicalTrials.gov's own search failed, so its column counts the 176 it answered.
  • Search speed: 60 timed searches for conditions, drugs and outcome measures, the same each night. Half answered within 641 ms and 95% within 1,329 ms, with no errors. Pass mark: no errors, and 95% within 1,500 ms.

Questions it answers

Questions asked of Trials
QuestionTrials askedAnsweredNot foundWrong answerCould not be judged
What did this trial's primary outcome show?6058002
Which papers report this trial's results?6060000

A question is answered when a search finds the trial and its record gives the answer ClinicalTrials.gov gives. It could not be judged when ClinicalTrials.gov gave nothing to compare with. These questions have no pass mark yet.

How the checks work

A separate program runs these checks through conductscience.org's public API, the same one anyone can use. It uses none of the code that builds the databases.

It draws the records it compares in an order set by a hash of each record's ID and the release's name, so no one chooses them. It compares each value with the source's record on the day of the check.

Speed and searches are checked every night. Records are compared with their sources every week, and again whenever a database serves a new release.

A check appears on this page once it passes its mark. Some checks, such as the questions asked of Trials, have no pass mark yet. We show them only after we have reviewed their numbers. A check that fails goes to the team that builds its database, and appears here once it is fixed.

Sequences, which finds the patents that disclose a sequence, keeps its own benchmarks.

Sequences benchmarks

Page history

  • 0.1.0, 16 Nov 2026

    The first page: speed, release and sources for nine databases, and how Trials compares with the records it copies.