| Higher-order Theorems | Isabelle‑HOT 2012 | Isabelle 2012 | Satallax 2.4 | Satallax 2.1 | LEO‑II 1.4.0 | TPS 3.120601S1b |
|---|---|---|---|---|---|---|
| Solved/200 | 166/200 | 135/200 | 132/200 | 123/200 | 81/200 | 66/200 |
| Av. CPU Time | 88.44 | 70.13 | 16.20 | 19.57 | 11.38 | 25.23 |
| Typed First-order Theorems +*-/ | Princess 120604 | SPASS+T 2.2.14 | SPASS+T 2.2.16 |
|---|---|---|---|
| Solved/150 | 141/150 | 140/150 | 139/150 |
| Av. CPU Time | 10.22 | 6.45 | 4.65 |
| First-order Theorems | Vampire 2.6 | E‑MaLeS 1.1 | EP 1.6pre | Vampire 0.6 | EP 1.4pre | iProver 0.99 | Prover9 1109a | iProver‑Eq 0.8 | LEO‑II 1.4.0 | E‑KRHyper 1.3 | E‑Darwin 1.5 | Princess 120604 | SuperZenon 0.0.1 | Zenon 0.7.1 | STP 1.0 | Muscadet 4.2 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Solved/450 | 429/450 | 377/450 | 359/450 | 355/450 | 333/450 | 274/450 | 186/450 | 174/450 | 171/450 | 159/450 | 156/450 | 140/450 | 137/450 | 70/450 | 40/450 | 34/450 |
| Av. CPU Time | 13.17 | 17.85 | 13.46 | 11.81 | 18.98 | 17.76 | 17.70 | 21.11 | 19.11 | 31.86 | 16.11 | 55.47 | 4.15 | 13.29 | 10.70 | 15.43 |
| Solutions | 429/450 | 372/450 | 359/450 | 355/450 | 333/450 | 270/450 | 186/450 | 0/450 | 171/450 | 0/450 | 0/450 | 0/450 | 137/450 | 66/450 | 40/450 | 32/450 |
| First-order Non-theorems | Paradox 3.0 | Vampire‑SAT 2.6 | FIMO 0.3 | iProver‑SAT 0.99 | Nitrox 2012 | CVC4 0.0 | EP‑SAT 1.6pre | E‑KRHyper 1.3 | E‑Darwin 1.5 | iProver‑Eq 0.8 |
|---|---|---|---|---|---|---|---|---|---|---|
| Solved/300 | 221/300 | 195/300 | 194/300 | 185/300 | 176/300 | 112/300 | 107/300 | 68/300 | 65/300 | 57/300 |
| Av. CPU Time | 6.45 | 13.81 | 15.70 | 49.96 | 23.53 | 25.55 | 3.87 | 5.29 | 14.00 | 17.30 |
| Solutions | 221/300 | 195/300 | 194/300 | 184/300 | 176/300 | 0/300 | 107/300 | 0/300 | 65/300 | 0/300 |
| Effectively Propositional CNF | iProver 0.9 | iProver 0.99 | Vampire‑EPR 2.6 | iProver‑Eq 0.8 | E‑Darwin 1.5 | EP 1.6pre | CVC4 0.0 | E‑KRHyper 1.3 |
|---|---|---|---|---|---|---|---|---|
| Solved/150 | 140/150 | 138/150 | 111/150 | 77/150 | 67/150 | 52/150 | 50/150 | 49/150 |
| Av. CPU Time | 23.99 | 25.96 | 34.21 | 23.63 | 13.19 | 4.57 | 12.12 | 2.61 |
| Large Theory Batch Problems | Vampire‑LTB 2.6 | Vampire‑LTB 1.8 | EP‑LTB 1.6pre | E‑MaLeS‑LTB 1.1 | iProver‑LTB 0.99 | iProver‑Eq‑LTB 0.8 | E‑KRHyper‑LTB 1.3 | leanCoP‑ARDE 2.2 |
|---|---|---|---|---|---|---|---|---|
| Solved/175 | 102/175 | 90/175 | 87/175 | 83/175 | 59/175 | 32/175 | 23/175 | 21/175 |
| Av. WC Time | 5.02 | 5.05 | 9.44 | 10.80 | 10.96 | 10.25 | 3.01 | 9.90 |