Higher-order Theorems | Satallax‑MaLeS 1.2 | Satallax 2.7 | Isabelle 2013 | Isabelle 2012 | LEO‑II 1.6.0 | TPS 3.120601S1b | cocATP 0.1.8 |
---|---|---|---|---|---|---|---|
Solved/150 | 119/150 | 116/150 | 108/150 | 98/150 | 76/150 | 47/150 | 14/150 |
Av. CPU Time | 10.42 | 11.39 | 54.65 | 60.54 | 5.05 | 25.23 | 52.05 |
Typed First-order Theorems +*-/ | SPASS+T 2.2.19 | Princess 120604 | Beagle 0.4 |
---|---|---|---|
Solved/100 | 95/100 | 91/100 | 90/100 |
Av. CPU Time | 5.29 | 6.63 | 4.17 |
First-order Theorems | Vampire 2.6 | Vampire 3.0 | E 1.8 | E‑MaLeS 1.2 | iProver 1.0 | E‑KRHyper 1.4 | Prover9 1109a | Muscadet 4.3 | Zipperposition 0.2 | CVC4 1.2 | iProver‑Eq 0.85 | iProverModulo 0.7‑0.2 |
---|---|---|---|---|---|---|---|---|---|---|---|---|
Solved/300 | 281/300 | 274/300 | 249/300 | 237/300 | 167/300 | 122/300 | 119/300 | 60/300 | 60/300 | 147/300 | 112/300 | 106/300 |
Av. CPU Time | 12.24 | 10.91 | 29.02 | 14.52 | 12.23 | 8.60 | 11.87 | 4.11 | 15.87 | 14.78 | 7.12 | 18.26 |
Solutions | 281/300 | 274/300 | 249/300 | 237/300 | 167/300 | 121/300 | 119/300 | 60/300 | 60/300 | 0/300 | 0/300 | 0/300 |
First-order Non-theorems | iProver 1.0‑SAT | Paradox 3.0 | CVC4 1.2‑SAT | E 1.8 | Nitrox 2013 | Vampire 3.0‑SAT | E‑KRHyper 1.4 | iProver‑Eq 0.85 |
---|---|---|---|---|---|---|---|---|
Solved/150 | 122/150 | 99/150 | 96/150 | 79/150 | 79/150 | 78/150 | 67/150 | 37/150 |
Av. CPU Time | 52.47 | 2.28 | 25.94 | 20.94 | 29.70 | 15.89 | 7.57 | 30.77 |
Solutions | 122/150 | 99/150 | 96/150 | 79/150 | 79/150 | 78/150 | 67/150 | 0/150 |
Effectively Propositional CNF | iProver 0.9 | iProver 1.0 | iProver‑Eq 0.85 | Vampire 3.0‑EPR | PEPR 0.0ps | E 1.8 | E‑KRHyper 1.4 | 5alarm 0.1 |
---|---|---|---|---|---|---|---|---|
Solved/100 | 81/100 | 77/100 | 51/100 | 47/100 | 43/100 | 23/100 | 8/100 | 0/100 |
Av. CPU Time | 26.76 | 33.86 | 40.58 | 14.72 | 26.91 | 49.93 | 23.75 | - |
Large Theory Batch Problems | MaLARea 0.5 | E 1.8‑LTB | Vampire 3.0‑LTB | iProver 1.0‑LTB | TEMPLAR::leanCoP 0.8 | E‑KRHyper 1.4‑LTB |
---|---|---|---|---|---|---|
Solved/750 | 239/750 | 135/750 | 126/750 | 89/750 | 28/750 | 3/750 |
Av. WC Time | 15.14 | 7.48 | 10.85 | 18.83 | 12.02 | 7.42 |
Solutions | 239/750 | 135/750 | 126/750 | 89/750 | 28/750 | 0/750 |