Higher-order Theorems | Satallax 3.2 | Satallax 3.3 | Leo‑III 1.3 | LEO‑II 1.7.0 |
---|---|---|---|---|
Solved/500 | 406/500 | 401/500 | 355/500 | 213/500 |
Solutions | 406 81% | 401 80% | 355 71% | 209 41% |
Typed First-order Theorems +*-/ | Vampire 4.3 | Vampire 4.1 | CVC4 1.6pre | Princess 170717 |
---|---|---|---|---|
Solved/200 | 163/200 | 162/200 | 157/200 | 105/200 |
Solutions | 163 81% | 162 81% | 157 78% | 92 46% |
First-order Theorems | Vampire 4.3 | Vampire 4.2 | CSE_E 1.0 | E 2.2pre | CVC4 1.6pre | Leo‑III 1.3 | iProver 2.8 | leanCoP 2.2 | nanoCoP 1.1 | CSE 1.1 | CSE 1.0 | Prover9 1109a | Twee 2.2 | Geo‑III 2018C |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Solved/500 | 461/500 | 454/500 | 363/500 | 350/500 | 298/500 | 256/500 | 248/500 | 143/500 | 133/500 | 126/500 | 123/500 | 122/500 | 74/500 | 50/500 |
Solutions | 461 92% | 454 90% | 362 72% | 350 70% | 298 59% | 256 51% | 247 49% | 143 28% | 133 26% | 126 25% | 123 24% | 122 24% | 73 14% | 50 10% |
First-order Non-theorems | Vampire SAT‑4.3 | Vampire SAT‑4.1 | iProver SAT‑2.8 | CVC4 SAT‑1.6pre | E FNT‑2.2pre | Geo‑III 2018C |
---|---|---|---|---|---|---|
Solved/200 | 191/200 | 188/200 | 137/200 | 116/200 | 38/200 | 38/200 |
Solutions | 191 95% | 186 93% | 137 68% | 116 58% | 38 19% | 38 19% |
Effectively Propositional CNF | iProver 2.8 | Vampire 4.3 | iProver 2.6 | E 2.2pre | Leo‑III 1.3 | Geo‑III 2018C |
---|---|---|---|---|---|---|
Solved/150 | 133/150 | 128/150 | 126/150 | 27/150 | 17/150 | 10/150 |
Large Theory Batch Problems | MaLARea 0.6 | Vampire LTB‑4.0 | Vampire LTB‑4.3 | iProver LTB‑2.8 | E LTB‑2.2pre | Grackle 0.1 |
---|---|---|---|---|---|---|
Solved/5000 | 876/5000 | 594/3553 | 757/5000 | 613/4999 | 458/4999 | 379/4893 |
Solutions | 876 17% | 594 16% | 757 15% | 613 12% | 458 9% | 379 7% |