Higher-order Theorems | Satallax 3.2 | Leo‑III 1.1 | Satallax 3.0 | LEO‑II 1.7.0 | Zipperpin 1.1 | Isabelle 2016 |
---|---|---|---|---|---|---|
Solved/500 | 430/500 | 382/500 | 382/500 | 305/500 | 179/500 | 387/500 |
Solutions | 430/500 | 382/500 | 375/500 | 301/500 | 179/500 | 0/500 |
Typed First-order Theorems +*-/ | Vampire 4.1 | Vampire 4.2 | CVC4 ARI‑1.5.2 | Princess 170717 | Zipperpin 1.1 |
---|---|---|---|---|---|
Solved/250 | 194/250 | 191/250 | 188/250 | 130/250 | 39/250 |
Solutions | 194/250 | 191/250 | 188/250 | 115/250 | 39/250 |
First-order Theorems | Vampire 4.2 | Vampire 4.0 | E 2.1 | CVC4 NAR‑1.5.2 | iProver 2.6 | Leo‑III 1.1 | lean‑nanoCoP 1.0 | Zipperpin 1.1 | Prover9 1109a | iProverMo 2.5‑0.1 | Scavenger EP‑0.2 |
---|---|---|---|---|---|---|---|---|---|---|---|
Solved/500 | 452/500 | 444/500 | 381/500 | 327/500 | 283/500 | 211/500 | 186/500 | 154/500 | 140/500 | 99/500 | 71/500 |
Solutions | 452/500 | 440/500 | 381/500 | 327/500 | 279/500 | 211/500 | 186/500 | 154/500 | 138/500 | 99/500 | 71/500 |
First-order Non-theorems | Vampire SAT‑4.1 | Vampire SAT‑4.2 | iProver SAT‑2.6 | CVC4 SNA‑1.5.2 | E FNT‑2.1 | Scavenger EP‑0.2 |
---|---|---|---|---|---|---|
Solved/250 | 219/250 | 217/250 | 175/250 | 136/250 | 85/250 | 12/250 |
Solutions | 217/250 | 204/250 | 175/250 | 136/250 | 85/250 | 12/250 |
Effectively Propositional CNF | iProver 2.6 | iProver 2.5 | Vampire 4.2 | E 2.1 | Scavenger EP‑0.1 | Scavenger EP‑0.2 |
---|---|---|---|---|---|---|
Solved/200 | 174/200 | 171/200 | 168/200 | 53/200 | 5/200 | 4/200 |
SLedgeHammer Theorems | Vampire SLH‑4.2 | CVC4 SLH‑1.5.2 | ET 2.0 | E SLH‑2.1 | Leo‑III SLH‑1.1 | iProver SLH‑2.6 | Zipperpin SLH‑1.1 | iProverMo 2.5‑0.1 |
---|---|---|---|---|---|---|---|---|
Solved/2000 | 1433/2000 | 1364/2000 | 1328/2000 | 1185/2000 | 652/2000 | 519/2000 | 472/2000 | 320/2000 |
Large Theory Batch Problems | Vampire LTB‑4.0 | Vampire LTB‑4.2 | MaLARea 0.6 | iProver LTB‑2.6 | E LTB‑2.1 |
---|---|---|---|---|---|
Solved/1500 | 1156/1500 | 1144/1486 | 1131/1500 | 777/1499 | 683/1499 |
Solutions | 1156/1500 | 1144/1486 | 1131/1500 | 777/1499 | 683/1499 |