Higher-order Theorems Satallax
3.4
Satallax
3.3
Leo‑III
1.4
Zipperpin
1.5
Vampire
THF‑4.4
CVC4
1.7
LEO‑II
1.7.0
Solved/500 418/500 399/500 359/500 356/500 304/500 268/500 179/500
Solutions 418 83% 399 79% 359 71% 356 71% 304 60% 268 53% 176 35%
Typed First-order Theorems +*-/ Vampire
4.3
Vampire
4.4
CVC4
1.7
Solved/200 169/200 168/200 159/200
Solutions 169 84% 168 84% 159 79%
First-order Theorems Vampire
4.3
Vampire
4.4
E
2.4
CSE_E
1.1
Enigma
0.4
CVC4
1.7
iProver
3.0
GKC
0.4
Zipperpin
1.5
leanCoP
2.2
CSE
1.2
nanoCoP
1.1
Prover9
1109a
Twee
2.2
PyRes
1.0
Etableau
0.1
Solved/500 437/500 434/500 375/500 358/500 323/500 259/500 256/500 248/500 126/500 120/500 116/500 110/500 100/500 52/500 7/500 287/500
Solutions 437 87% 434 86% 375 75% 358 71% 323 64% 259 51% 256 51% 248 49% 126 25% 120 24% 116 23% 110 22% 100 20% 52 10% 7  1% 0  0%
FEQ with Wall clock limit Vampire
FEW‑4.4
Enigma
FEW‑0.4
iProver
FEW‑3.0
Etableau
0.1
Solved/400 371/400 313/400 191/400 215/400
Solutions 370 92% 313 78% 191 47% 0  0%
First-order Non-theorems Vampire
SAT‑4.3
Vampire
SAT‑4.4
CVC4
SAT‑1.7
iProver
SAT‑3.0
E
FNT‑2.4
PyRes
1.0
Solved/200 189/200 189/200 99/200 111/200 42/200 14/200
Solutions 189 94% 189 94% 99 49% 98 49% 42 21% 14  7%
Effectively Propositional CNF Vampire
4.4
iProver
2.8
iProver
3.0
E
FNT‑2.4
PyRes
1.0
GKC
0.4
Solved/75 29/75 26/75 22/75 8/75 2/75 1/75
Unit Equality CNF Waldmeister
710
E
2.4
Twee
2.2
Vampire
4.4
MaedMax
1.3
GKC
0.4
iProver
3.0
Solved/200 164/200 161/200 151/200 142/200 102/200 88/200 78/200
Solutions 164 82% 161 80% 150 75% 142 71% 102 51% 88 44% 78 39%
Large Theory Batch Problems Leo‑III
LTB‑1.4
E
LTB‑2.4
MaLARea
0.8
Vampire
LTB‑4.4
MaLARea
0.6
iProver
LTB‑3.0
GKC
LTB‑0.4
Solved/10000 5440/10000 4644/10000 4640/10000 4499/10000 4380/10000 3793/10000 2755/10000
Solutions 5440 54% 4644 46% 4640 46% 4499 44% 4380 43% 3789 37% 2755 27%