Higher-order Theorems | Zipperpin 2.0 | Satallax 3.4 | Satallax 3.5 | Vampire 4.5 | Leo‑III 1.5 | CVC4 1.8 | LEO‑II 1.7.0 |
---|---|---|---|---|---|---|---|
Solved/500 | 424/500 | 323/500 | 319/500 | 299/500 | 287/500 | 194/500 | 112/500 |
Solutions | 424 84% | 323 64% | 319 63% | 299 59% | 287 57% | 194 38% | 111 22% |
Typed First-order Theorems +*-/ | Vampire 4.5 | Vampire 4.4 | CVC4 1.8 |
---|---|---|---|
Solved/250 | 191/250 | 190/250 | 187/250 |
Solutions | 191 76% | 190 76% | 187 74% |
First-order Theorems | Vampire 4.5 | Vampire 4.4 | Enigma 0.5.1 | E 2.5 | CSE_E 1.2 | iProver 3.3 | GKC 0.5.1 | CVC4 1.8 | Zipperpin 2.0 | Etableau 0.2 | Prover9 1109a | CSE 1.3 | leanCoP 2.2 | Twee 2.2.1 | PyRes 1.3 | lazyCoP 0.1 |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Solved/500 | 429/500 | 416/500 | 401/500 | 351/500 | 316/500 | 312/500 | 289/500 | 275/500 | 237/500 | 162/500 | 146/500 | 124/500 | 111/500 | 68/500 | 26/500 | 94/500 |
Solutions | 429 85% | 416 83% | 401 80% | 351 70% | 316 63% | 312 62% | 289 57% | 275 55% | 237 47% | 162 32% | 146 29% | 124 24% | 111 22% | 68 13% | 26 5% | 0 0% |
First-order Non-theorems | Vampire SAT‑4.5 | Vampire SAT‑4.4 | iProver SAT‑3.3 | CVC4 SAT‑1.8 | E FNT‑2.5 | PyRes 1.3 |
---|---|---|---|---|---|---|
Solved/250 | 238/250 | 226/250 | 182/250 | 98/250 | 63/250 | 13/250 |
Solutions | 238 95% | 226 90% | 182 72% | 98 39% | 63 25% | 13 5% |
Unit Equality CNF | E 2.5 | Twee 2.2.1 | E 2.4 | Vampire 4.5 | Etableau 0.2 | GKC 0.5.1 | iProver 3.3 | lazyCoP 0.1 |
---|---|---|---|---|---|---|---|---|
Solved/250 | 202/250 | 197/250 | 185/250 | 162/250 | 148/250 | 128/250 | 124/250 | 20/250 |
Solutions | 202 80% | 197 78% | 185 74% | 162 64% | 148 59% | 128 51% | 124 49% | 0 0% |
Large Theory Batch Problems | MaLARea 0.9 | E LTB‑2.5 | iProver LTB‑3.3 | Zipperpin LTB‑2.0 | Leo‑III LTB‑1.5 | ATPBoost 1.0 | GKC LTB‑0.5.1 | Leo‑III LTB‑1.4 |
---|---|---|---|---|---|---|---|---|
Solved/10000 | 7054/10000 | 3393/10000 | 3164/10000 | 1699/10000 | 1413/10000 | 1237/10000 | 493/10000 | 134/10000 |
Solutions | 7054 70% | 3393 33% | 3163 31% | 1699 16% | 1413 14% | 1237 12% | 493 4% | 134 1% |