| Higher-order Theorems | Satallax‑MaLeS 1.2 | Satallax 2.7 | Isabelle 2013 | Isabelle 2012 | LEO‑II 1.6.0 | TPS 3.120601S1b | cocATP 0.1.8 | 
|---|---|---|---|---|---|---|---|
| Solved/150 | 119/150 | 116/150 | 108/150 | 98/150 | 76/150 | 47/150 | 14/150 | 
| Av. CPU Time | 10.42 | 11.39 | 54.65 | 60.54 | 5.05 | 25.23 | 52.05 | 
| Typed First-order Theorems +*-/ | SPASS+T 2.2.19 | Princess 120604 | Beagle 0.4 | 
|---|---|---|---|
| Solved/100 | 95/100 | 91/100 | 90/100 | 
| Av. CPU Time | 5.29 | 6.63 | 4.17 | 
| First-order Theorems | Vampire 2.6 | Vampire 3.0 | E 1.8 | E‑MaLeS 1.2 | iProver 1.0 | E‑KRHyper 1.4 | Prover9 1109a | Zipperposition 0.2 | Muscadet 4.3 | CVC4 1.2 | iProver‑Eq 0.85 | iProverModulo 0.7‑0.2 | 
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Solved/300 | 281/300 | 274/300 | 249/300 | 237/300 | 167/300 | 122/300 | 119/300 | 91/300 | 60/300 | 147/300 | 112/300 | 106/300 | 
| Av. CPU Time | 12.24 | 10.91 | 29.02 | 14.52 | 12.23 | 8.60 | 11.87 | 15.95 | 4.11 | 14.78 | 7.12 | 18.26 | 
| Solutions | 281/300 | 274/300 | 249/300 | 237/300 | 167/300 | 121/300 | 119/300 | 91/300 | 60/300 | 0/300 | 0/300 | 0/300 | 
| First-order Non-theorems | iProver 1.0‑SAT | Paradox 3.0 | CVC4 1.2‑SAT | E 1.8 | Nitrox 2013 | Vampire 3.0‑SAT | E‑KRHyper 1.4 | iProver‑Eq 0.85 | 
|---|---|---|---|---|---|---|---|---|
| Solved/150 | 122/150 | 99/150 | 96/150 | 79/150 | 79/150 | 78/150 | 67/150 | 37/150 | 
| Av. CPU Time | 52.47 | 2.28 | 25.94 | 20.94 | 29.70 | 15.89 | 7.57 | 30.77 | 
| Solutions | 122/150 | 99/150 | 96/150 | 79/150 | 79/150 | 78/150 | 67/150 | 0/150 | 
| Effectively Propositional CNF | iProver 0.9 | iProver 1.0 | iProver‑Eq 0.85 | Vampire 3.0‑EPR | PEPR 0.0ps | E 1.8 | E‑KRHyper 1.4 | 5alarm 0.1 | 
|---|---|---|---|---|---|---|---|---|
| Solved/100 | 81/100 | 77/100 | 51/100 | 47/100 | 43/100 | 23/100 | 8/100 | 0/100 | 
| Av. CPU Time | 26.76 | 33.86 | 40.58 | 14.72 | 26.91 | 49.93 | 23.75 | - | 
| Large Theory Batch Problems | MaLARea 0.5 | E 1.8‑LTB | Vampire 3.0‑LTB | iProver 1.0‑LTB | TEMPLAR::leanCoP 0.8 | E‑KRHyper 1.4‑LTB | 
|---|---|---|---|---|---|---|
| Solved/750 | 239/750 | 135/750 | 126/750 | 89/750 | 28/750 | 3/750 | 
| Av. WC Time | 15.14 | 7.48 | 10.85 | 18.83 | 12.02 | 7.42 | 
| Solutions | 239/750 | 135/750 | 126/750 | 89/750 | 28/750 | 0/750 |