Higher-order Theorems | Zipperpin 2.1 | Zipperpin 2.0 | Vampire 4.6 | Leo‑III 1.6 | Ehoh 2.7 | cvc5 1.0 | LEO‑II 1.7.0 |
---|---|---|---|---|---|---|---|
Solved/500 | 467/500 | 450/500 | 386/500 | 357/500 | 300/500 | 239/500 | 95/500 |
Solutions | 467 93% | 450 90% | 386 77% | 357 71% | 300 60% | 239 47% | 94 18% |
First-order Theorems | Vampire 4.6 | Vampire 4.5 | iProver 3.5 | CSE_E 1.3 | E 2.6 | GKC 0.7 | Zipperpin 2.1 | Etableau 0.67 | cvc5 1.0 | SATCoP 0.1 | Drodi 3.1.5 | Prover9 1109a | CSE 1.4 | CSE‑F 1.0 | Twee 2.4 | JavaRes 1.3.0 | RPx 1.0 |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Solved/500 | 448/500 | 439/500 | 373/500 | 373/500 | 368/500 | 342/500 | 310/500 | 291/500 | 281/500 | 217/500 | 204/500 | 138/500 | 128/500 | 112/500 | 98/500 | 16/500 | 16/500 |
Solutions | 448 89% | 439 87% | 373 74% | 373 74% | 368 73% | 342 68% | 310 62% | 291 58% | 280 56% | 217 43% | 204 40% | 138 27% | 128 25% | 112 22% | 98 19% | 16 3% | 0 0% |
First-order Non-theorems | Vampire SAT‑4.5 | Vampire SAT‑4.6 | iProver SAT‑3.5 | cvc5 SAT‑1.0 | E FNT‑2.6 | Etableau 0.67 | RPx 1.0 |
---|---|---|---|---|---|---|---|
Solved/250 | 230/250 | 229/250 | 145/250 | 79/250 | 65/250 | 58/250 | 0/250 |
Solutions | 230 92% | 229 91% | 145 58% | 79 31% | 65 26% | 58 23% | 0 0% |
Unit Equality CNF | Twee 2.4 | E 2.5 | E 2.6 | Vampire 4.6 | Etableau 0.67 | iProver 3.5 | GKC 0.7 | Drodi 3.1.5 |
---|---|---|---|---|---|---|---|---|
Solved/250 | 227/250 | 197/250 | 195/250 | 157/250 | 152/250 | 138/250 | 122/250 | 118/250 |
Solutions | 227 90% | 197 78% | 195 78% | 157 62% | 152 60% | 138 55% | 122 48% | 118 47% |
SLedgeHammer Theorems | Zipperpin SLH‑2.1 | Ehoh SLH‑2.7 | Vampire SLH‑4.6 | Leo‑III 1.6 | cvc5 SLH‑1.0 |
---|---|---|---|---|---|
Solved/720 | 675/720 | 655/720 | 626/720 | 499/720 | 310/720 |
Solutions | 675 93% | 655 90% | 626 86% | 499 69% | 310 43% |
Large Theory Batch | Vampire LTB‑4.6 | iProver LTB‑3.5 | Zipperpin LTB‑2.1 | E LTB‑2.5 | E LTB‑2.6 | GKC LTB‑0.7 | Leo‑III LTB‑1.6 |
---|---|---|---|---|---|---|---|
Solved/10000 | 7891/10000 | 7013/9993 | 6952/10000 | 6921/10000 | 6833/10000 | 6545/10000 | 2481/10000 |
Solutions | 7891 78% | 7013 70% | 6952 69% | 6921 69% | 6833 68% | 6545 65% | 2481 24% |