Higher-order Theorems | Satallax 3.4 | Satallax 3.3 | Leo‑III 1.4 | Zipperpin 1.5 | Vampire THF‑4.4 | CVC4 1.7 | LEO‑II 1.7.0 |
---|---|---|---|---|---|---|---|
Solved/500 | 418/500 | 399/500 | 359/500 | 356/500 | 304/500 | 268/500 | 179/500 |
Solutions | 418 83% | 399 79% | 359 71% | 356 71% | 304 60% | 268 53% | 176 35% |
Typed First-order Theorems +*-/ | Vampire 4.3 | Vampire 4.4 | CVC4 1.7 |
---|---|---|---|
Solved/200 | 169/200 | 168/200 | 159/200 |
Solutions | 169 84% | 168 84% | 159 79% |
First-order Theorems | Vampire 4.3 | Vampire 4.4 | E 2.4 | CSE_E 1.1 | Enigma 0.4 | CVC4 1.7 | iProver 3.0 | GKC 0.4 | Zipperpin 1.5 | leanCoP 2.2 | CSE 1.2 | nanoCoP 1.1 | Prover9 1109a | Twee 2.2 | PyRes 1.0 | Etableau 0.1 |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Solved/500 | 437/500 | 434/500 | 375/500 | 358/500 | 323/500 | 259/500 | 256/500 | 248/500 | 126/500 | 120/500 | 116/500 | 110/500 | 100/500 | 52/500 | 7/500 | 287/500 |
Solutions | 437 87% | 434 86% | 375 75% | 358 71% | 323 64% | 259 51% | 256 51% | 248 49% | 126 25% | 120 24% | 116 23% | 110 22% | 100 20% | 52 10% | 7 1% | 0 0% |
FEQ with Wall clock limit | Vampire FEW‑4.4 | Enigma FEW‑0.4 | iProver FEW‑3.0 | Etableau 0.1 |
---|---|---|---|---|
Solved/400 | 371/400 | 313/400 | 191/400 | 215/400 |
Solutions | 370 92% | 313 78% | 191 47% | 0 0% |
First-order Non-theorems | Vampire SAT‑4.3 | Vampire SAT‑4.4 | CVC4 SAT‑1.7 | iProver SAT‑3.0 | E FNT‑2.4 | PyRes 1.0 |
---|---|---|---|---|---|---|
Solved/200 | 189/200 | 189/200 | 99/200 | 111/200 | 42/200 | 14/200 |
Solutions | 189 94% | 189 94% | 99 49% | 98 49% | 42 21% | 14 7% |
Effectively Propositional CNF | Vampire 4.4 | iProver 2.8 | iProver 3.0 | E FNT‑2.4 | PyRes 1.0 | GKC 0.4 |
---|---|---|---|---|---|---|
Solved/75 | 29/75 | 26/75 | 22/75 | 8/75 | 2/75 | 1/75 |
Unit Equality CNF | Waldmeister 710 | E 2.4 | Twee 2.2 | Vampire 4.4 | MaedMax 1.3 | GKC 0.4 | iProver 3.0 |
---|---|---|---|---|---|---|---|
Solved/200 | 164/200 | 161/200 | 151/200 | 142/200 | 102/200 | 88/200 | 78/200 |
Solutions | 164 82% | 161 80% | 150 75% | 142 71% | 102 51% | 88 44% | 78 39% |
Large Theory Batch Problems | Leo‑III LTB‑1.4 | E LTB‑2.4 | MaLARea 0.8 | Vampire LTB‑4.4 | MaLARea 0.6 | iProver LTB‑3.0 | GKC LTB‑0.4 |
---|---|---|---|---|---|---|---|
Solved/10000 | 5440/10000 | 4644/10000 | 4640/10000 | 4499/10000 | 4380/10000 | 3793/10000 | 2755/10000 |
Solutions | 5440 54% | 4644 46% | 4640 46% | 4499 44% | 4380 43% | 3789 37% | 2755 27% |