Higher-order Theorems Satallax
 3.0
Satallax
 2.8
LEO‑II
 1.7.0
Leo+III
 1.0
Leo‑III
 1.0
Isabelle
 2015
Solved/500 346/500 315/500 238/500 89/500 74/500 356/500
Av. CPU Time 22.10 19.45 20.93 48.37 42.79 81.08
Solutions 327/500 313/500 231/500 88/500 74/500 0/500
Typed First-order Theorems +*-/ Vampire
 4.1
VampireZ3
 1.0
CVC4
 TFF‑1.5.1
Beagle
 0.9.47
Princess
 160606
Solved/500 419/500 380/500 343/500 300/500 342/500
Av. CPU Time 13.39 9.15 5.72 18.76 17.59
Solutions 419/500 380/500 343/500 300/500 271/500
Typed First-order Non-theorems +*-/ CVC4
 TFN‑1.5
Beagle
 SAT‑0.9.47
CVC4
 TFN‑1.5.1
Princess
 160606
Solved/50 15/50 10/50 9/50 8/50
Av. CPU Time 32.27 3.11 0.02 1.44
First-order Theorems Vampire
 4.0
Vampire
 4.1
E
 2.0
CVC4
 FOF‑1.5.1
iProver
 2.5
leanCoP
 2.2
Prover9
 1109a
Geo‑III
 2016C
Solved/500 457/500 447/500 392/500 329/500 278/500 168/500 101/500 54/500
Av. CPU Time 15.39 14.14 30.87 35.04 30.82 77.94 29.99 41.73
Solutions 453/500 447/500 392/500 328/500 274/500 168/500 98/500 54/500
First-order Non-theorems Vampire
 SAT‑4.1
Vampire
 SAT‑4.0
iProver
 SAT‑2.5
Nitpick
 2015
CVC4
 FNT‑1.5.1
Geo‑III
 2016C
E
 FNT‑2.0
Refute
 2015
Solved/300 250/300 240/300 200/300 139/300 96/300 76/300 70/300 58/300
Av. CPU Time 40.11 36.45 30.28 37.86 22.43 13.69 16.31 69.09
Solutions 248/300 238/300 200/300 139/300 96/300 76/300 70/300 0/300
Effectively Propositional CNF iProver
 2.5
Vampire
 4.0
E
 2.0
Geo‑III
 2016C
Vampire
 4.1
Solved/300 228/299 222/299 101/299 9/299 0/299
Av. CPU Time 28.38 35.35 21.85 62.08 -
Large Theory Batch Problems Vampire
 LTB‑4.0
Vampire
 LLTB‑4.1
Vampire
 LTB‑4.1
E
 LTB‑2.0
iProver
 LTB‑2.5
Solved/600 403/600 398/600 396/600 305/600 298/600
Av. WC Time 11.62 9.54 8.05 12.56 35.07
Solutions 403/600 398/600 396/600 305/600 298/600