| Higher-order Theorems | Vampire 5.0 | E 3.3.0 | Leo‑III 1.7.19 | Vampire 4.9 | Zipperpin 2.1.9999 | cvc5 1.3.0 |
|---|---|---|---|---|---|---|
| Solved/500 | 449/500 | 395/500 | 242/500 | 455/500 | 415/500 | 296/500 |
| Solutions/500 | 439/500 | 374/500 | 241/500 | 0/500 | 0/500 | 0/500 |
| Typed First-order Theorems +*-/ | Vampire 5.0 | iProver 3.9.3 | Vampire 4.9 | cvc5 1.3.0 |
|---|---|---|---|---|
| Solved/150 | 131/150 | 74/150 | 123/150 | 108/150 |
| Solutions/150 | 127/150 | 68/150 | 0/150 | 0/150 |
| Typed First-order Non-theorems | Vampire 5.0 | iProver 3.9.3 | iProver 3.9 | cvc5 1.3.0 |
|---|---|---|---|---|
| Solved/150 | 110/150 | 86/150 | 84/150 | 56/150 |
| Solutions/150 | 110/150 | 86/150 | 84/150 | 56/150 |
| First-order Theorems | Vampire 5.0 | E 3.3.0 | iProver 3.9.3 | CSE_E 1.7 | Drodi 4.1.0 | ConnectPP 0.6.1 | hopCoP 0.1 | LisaTT 0.9.1 | Vampire 4.9 | CSI_Enigma 1.0.6 | cvc5 1.3.0 | Zipperpin 2.1.9999 | Prover9 1109a | SPASS‑SCL 0.1 | LastButNotLeast 0 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Solved/500 | 455/500 | 364/500 | 367/500 | 295/500 | 325/500 | 102/500 | 88/500 | 3/500 | 466/500 | 402/500 | 290/500 | 267/500 | 119/500 | 11/500 | 0/500 |
| Solutions/500 | 455/500 | 364/500 | 278/500 | 244/500 | 210/500 | 102/500 | 75/500 | 3/500 | 0/500 | 0/500 | 0/500 | 0/500 | 0/500 | 0/500 | 0/500 |
| Effectively Propositional CNF | Vampire 5.0 | iProver 3.9.3 | CSI_Enigma 1.0.6 | E 3.3.0 | Drodi‑EPR 4.1.0 | SPASS‑SCL 0.1 |
|---|---|---|---|---|---|---|
| Solved/200 | 186/200 | 168/200 | 98/200 | 88/200 | 80/200 | 64/200 |
| Unit Equality CNF | Vampire 5.0 | Twee 2.6.0 | E 3.3.0 | CSE_E 1.7 | Drodi 4.1.0 | Toma 0.7 | iProver 3.9.3 | Vampire 4.9 | CSI_Enigma 1.0.6 |
|---|---|---|---|---|---|---|---|---|---|
| Solved/300 | 263/300 | 258/300 | 222/300 | 167/300 | 121/300 | 114/300 | 205/300 | 258/300 | 238/300 |
| Solutions/300 | 263/300 | 258/300 | 222/300 | 151/300 | 121/300 | 114/300 | 62/300 | 0/300 | 0/300 |
| SLedgeHammer Theorems | Vampire 4.9 | Vampire 5.0 | E 3.3.0 | cvc5 1.3.0 | Leo‑III 1.7.19 |
|---|---|---|---|---|---|
| Solved/1000 | 441/1000 | 434/1000 | 429/1000 | 294/1000 | 38/1000 |
| Solutions/1000 | 441/1000 | 434/1000 | 429/1000 | 0/1000 | 0/1000 |
| I Challenge yoU | Vampire 5.0 | E 3.3.0 | iProver 3.9.3 | Drodi 4.1.0 | CSE_E 1.7 | ConnectPP 0.6.1 | Vampire 4.9 | CSI_Enigma 1.0.6 |
|---|---|---|---|---|---|---|---|---|
| Solved/101 | 69/101 | 42/101 | 34/101 | 21/101 | 18/101 | 1/101 | 70/101 | 46/101 |
| Solutions/101 | 69/101 | 42/101 | 28/101 | 16/101 | 16/101 | 1/101 | 0/101 | 0/101 |