Higher-order Theorems Zipperpin
2.0
Satallax
3.4
Satallax
3.5
Vampire
4.5
Leo‑III
1.5
CVC4
1.8
LEO‑II
1.7.0
Solved/500 424/500 323/500 319/500 299/500 287/500 194/500 112/500
Solutions 424 84% 323 64% 319 63% 299 59% 287 57% 194 38% 111 22%
Typed First-order Theorems +*-/ Vampire
4.5
Vampire
4.4
CVC4
1.8
Solved/250 191/250 190/250 187/250
Solutions 191 76% 190 76% 187 74%
First-order Theorems Vampire
4.5
Vampire
4.4
Enigma
0.5.1
E
2.5
CSE_E
1.2
iProver
3.3
GKC
0.5.1
CVC4
1.8
Zipperpin
2.0
Etableau
0.2
Prover9
1109a
CSE
1.3
leanCoP
2.2
Twee
2.2.1
PyRes
1.3
lazyCoP
0.1
Solved/500 429/500 416/500 401/500 351/500 316/500 312/500 289/500 275/500 237/500 162/500 146/500 124/500 111/500 68/500 26/500 94/500
Solutions 429 85% 416 83% 401 80% 351 70% 316 63% 312 62% 289 57% 275 55% 237 47% 162 32% 146 29% 124 24% 111 22% 68 13% 26  5% 0  0%
First-order Non-theorems Vampire
SAT‑4.5
Vampire
SAT‑4.4
iProver
SAT‑3.3
CVC4
SAT‑1.8
E
FNT‑2.5
PyRes
1.3
Solved/250 238/250 226/250 182/250 98/250 63/250 13/250
Solutions 238 95% 226 90% 182 72% 98 39% 63 25% 13  5%
Unit Equality CNF E
2.5
Twee
2.2.1
E
2.4
Vampire
4.5
Etableau
0.2
GKC
0.5.1
iProver
3.3
lazyCoP
0.1
Solved/250 202/250 197/250 185/250 162/250 148/250 128/250 124/250 20/250
Solutions 202 80% 197 78% 185 74% 162 64% 148 59% 128 51% 124 49% 0  0%
Large Theory Batch Problems MaLARea
0.9
E
LTB‑2.5
iProver
LTB‑3.3
Zipperpin
LTB‑2.0
Leo‑III
LTB‑1.5
ATPBoost
1.0
GKC
LTB‑0.5.1
Leo‑III
LTB‑1.4
Solved/10000 7054/10000 3393/10000 3164/10000 1699/10000 1413/10000 1237/10000 493/10000 134/10000
Solutions 7054 70% 3393 33% 3163 31% 1699 16% 1413 14% 1237 12% 493  4% 134  1%