| Higher-order Theorems | Vampire 5.0 | E 3.3.0 | Leo‑III 1.7.19 | Vampire 4.9 | Zipperpin 2.1.9999 | cvc5 1.3.0 |
|---|---|---|---|---|---|---|
| Solved/500 | 449/500 | 395/500 | 242/500 | 455/500 | 415/500 | 296/500 |
| Av. WC Time | 6.44 | 13.09 | 10.34 | 5.99 | 13.21 | 30.16 |
| Av. CPU Time | 39.40 | 50.71 | 30.82 | 35.65 | 95.83 | 30.20 |
| Solutions/500 | 439/500 | 374/500 | 241/500 | 0/500 | 0/500 | 0/500 |
| μWCEfficiency | 633 | 597 | 136 | 638 | 383 | 327 |
| μEfficiency | 471 | 542 | 69 | 474 | 289 | 340 |
| SotAC | 0.30 | 0.22 | 0.05 | - | 0.24 | 0.11 |
| Core Usage/> 1.0 | 4.57/271 | 3.90/176 | 2.67/242 | 4.49/275 | 6.20/295 | 1.53/1 |
| Core U. ≤ 1.0 | 178 | 219 | 0 | 180 | 120 | 295 |
| New Solved | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 |
| Unique Solved | 0/17 | 7/17 | 0/17 | 2/17 | 5/17 | 3/17 |
| Typed First-order Theorems +*-/ | Vampire 5.0 | iProver 3.9.3 | Vampire 4.9 | cvc5 1.3.0 |
|---|---|---|---|---|
| Solved/150 | 131/150 | 74/150 | 123/150 | 108/150 |
| Av. WC Time | 4.40 | 12.00 | 4.62 | 16.40 |
| Av. CPU Time | 27.76 | 83.28 | 27.67 | 16.19 |
| Solutions/150 | 127/150 | 68/150 | 0/150 | 0/150 |
| μWCEfficiency | 695 | 162 | 592 | 349 |
| μEfficiency | 501 | 86 | 394 | 369 |
| SotAC | 0.33 | 0.03 | - | 0.18 |
| Core Usage/> 1.0 | 4.66/72 | 4.11/68 | 4.80/80 | 0.00/0 |
| Core U. ≤ 1.0 | 59 | 6 | 43 | 108 |
| New Solved | 6/7 | 4/7 | 7/7 | 5/7 |
| Unique Solved | 3/7 | 0/7 | 1/7 | 3/7 |
| Typed First-order Non-theorems | Vampire 5.0 | iProver 3.9.3 | iProver 3.9 | cvc5 1.3.0 |
|---|---|---|---|---|
| Solved/150 | 110/150 | 86/150 | 84/150 | 56/150 |
| Av. WC Time | 1.31 | 22.96 | 21.49 | 28.49 |
| Av. CPU Time | 6.98 | 172.00 | 158.71 | 28.30 |
| Solutions/150 | 110/150 | 86/150 | 84/150 | 56/150 |
| μWCEfficiency | 588 | 159 | 193 | 193 |
| μEfficiency | 364 | 158 | 238 | 197 |
| SotAC | 0.25 | 0.10 | 0.09 | 0.05 |
| Core Usage/> 1.0 | 4.76/71 | 5.78/60 | 6.33/52 | 0.00/0 |
| Core U. ≤ 1.0 | 39 | 26 | 32 | 56 |
| New Solved | 1/2 | 1/2 | 1/2 | 1/2 |
| Unique Solved | 14/14 | 0/14 | 0/14 | 0/14 |
| First-order Theorems | Vampire 5.0 | E 3.3.0 | iProver 3.9.3 | CSE_E 1.7 | Drodi 4.1.0 | ConnectPP 0.6.1 | hopCoP 0.1 | LisaTT 0.9.1 | Vampire 4.9 | CSI_Enigma 1.0.6 | cvc5 1.3.0 | Zipperpin 2.1.9999 | Prover9 1109a | SPASS‑SCL 0.1 | LastButNotLeast 0 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Solved/500 | 455/500 | 364/500 | 367/500 | 295/500 | 325/500 | 102/500 | 88/500 | 3/500 | 466/500 | 402/500 | 290/500 | 267/500 | 119/500 | 11/500 | 0/500 |
| Av. WC Time | 6.57 | 19.24 | 28.58 | 26.90 | 21.21 | 67.31 | 21.28 | 10.56 | 5.73 | 19.43 | 29.34 | 12.90 | 32.29 | 50.69 | - |
| Av. CPU Time | 41.27 | 122.25 | 208.80 | 57.82 | 163.23 | 67.11 | 160.88 | 16.73 | 34.81 | 133.75 | 29.17 | 82.86 | 31.99 | 251.20 | - |
| Solutions/500 | 455/500 | 364/500 | 278/500 | 244/500 | 210/500 | 102/500 | 75/500 | 3/500 | 0/500 | 0/500 | 0/500 | 0/500 | 0/500 | 0/500 | 0/500 |
| μWCEfficiency | 673 | 443 | 187 | 147 | 371 | 39 | 98 | 2 | 681 | 166 | 266 | 249 | 72 | 7 | - |
| μEfficiency | 498 | 327 | 76 | 141 | 273 | 39 | 63 | 1 | 525 | 55 | 275 | 185 | 95 | 6 | - |
| SotAC | 0.48 | 0.33 | 0.34 | 0.24 | 0.28 | 0.06 | 0.06 | 0.00 | - | 0.39 | 0.26 | 0.21 | 0.09 | 0.01 | - |
| Core Usage/> 1.0 | 4.43/272 | 4.88/257 | 4.63/366 | 1.63/213 | 6.42/211 | 0.00/0 | 5.73/65 | 1.87/3 | 4.59/261 | 4.39/402 | 1.02/1 | 5.35/190 | 1.00/1 | 4.20/10 | - |
| Core U. ≤ 1.0 | 183 | 107 | 1 | 82 | 114 | 102 | 23 | 0 | 205 | 0 | 289 | 77 | 118 | 1 | 0 |
| New Solved | 33/43 | 16/43 | 20/43 | 13/43 | 21/43 | 1/43 | 1/43 | 0/43 | 30/43 | 30/43 | 16/43 | 6/43 | 8/43 | 0/43 | 0/43 |
| Unique Solved | 3/17 | 0/17 | 0/17 | 0/17 | 0/17 | 0/17 | 0/17 | 0/17 | 8/17 | 1/17 | 5/17 | 0/17 | 0/17 | 0/17 | 0/17 |
| Effectively Propositional CNF | Vampire 5.0 | iProver 3.9.3 | CSI_Enigma 1.0.6 | E 3.3.0 | Drodi‑EPR 4.1.0 | SPASS‑SCL 0.1 |
|---|---|---|---|---|---|---|
| Solved/200 | 186/200 | 168/200 | 98/200 | 88/200 | 80/200 | 64/200 |
| Av. WC Time | 9.29 | 18.65 | 10.17 | 19.10 | 8.53 | 4.45 |
| Av. CPU Time | 57.04 | 112.08 | 50.82 | 27.55 | 64.07 | 20.29 |
| Solutions/200 | 186/200 | 168/200 | 32/200 | 82/200 | 25/200 | 0/200 |
| μWCEfficiency | 494 | 202 | 110 | 294 | 300 | 272 |
| μEfficiency | 393 | 140 | 40 | 262 | 269 | 254 |
| SotAC | 0.50 | 0.41 | 0.09 | 0.06 | 0.04 | 0.02 |
| Core Usage/> 1.0 | 5.58/117 | 4.54/142 | 3.67/98 | 3.52/35 | 6.78/27 | 3.22/21 |
| Core U. ≤ 1.0 | 69 | 26 | 0 | 53 | 53 | 43 |
| New Solved | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 |
| Unique Solved | 13/13 | 0/13 | 0/13 | 0/13 | 0/13 | 0/13 |
| Unit Equality CNF | Vampire 5.0 | Twee 2.6.0 | E 3.3.0 | CSE_E 1.7 | Drodi 4.1.0 | Toma 0.7 | iProver 3.9.3 | Vampire 4.9 | CSI_Enigma 1.0.6 |
|---|---|---|---|---|---|---|---|---|---|
| Solved/300 | 263/300 | 258/300 | 222/300 | 167/300 | 121/300 | 114/300 | 205/300 | 258/300 | 238/300 |
| Av. WC Time | 14.22 | 18.63 | 22.33 | 33.54 | 28.92 | 68.09 | 40.38 | 10.34 | 20.74 |
| Av. CPU Time | 95.25 | 144.23 | 153.90 | 79.66 | 226.82 | 67.95 | 308.71 | 67.74 | 145.23 |
| Solutions/300 | 263/300 | 258/300 | 222/300 | 151/300 | 121/300 | 114/300 | 62/300 | 0/300 | 0/300 |
| μWCEfficiency | 421 | 410 | 369 | 94 | 109 | 39 | 99 | 443 | 146 |
| μEfficiency | 211 | 196 | 227 | 80 | 50 | 40 | 36 | 220 | 43 |
| SotAC | 0.31 | 0.30 | 0.20 | 0.09 | 0.05 | 0.04 | 0.17 | - | 0.23 |
| Core Usage/> 1.0 | 5.50/234 | 6.61/221 | 5.63/183 | 1.77/145 | 7.19/112 | 1.00/19 | 6.22/203 | 5.34/226 | 5.14/238 |
| Core U. ≤ 1.0 | 29 | 37 | 39 | 22 | 9 | 95 | 2 | 32 | 0 |
| New Solved | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 |
| Unique Solved | 3/13 | 7/13 | 0/13 | 0/13 | 0/13 | 0/13 | 0/13 | 3/13 | 0/13 |
| SLedgeHammer Theorems | Vampire 4.9 | Vampire 5.0 | E 3.3.0 | cvc5 1.3.0 | Leo‑III 1.7.19 |
|---|---|---|---|---|---|
| Solved/1000 | 441/1000 | 434/1000 | 429/1000 | 294/1000 | 38/1000 |
| Av. WC Time | 1.95 | 1.94 | 2.67 | 2.98 | 3.28 |
| Av. CPU Time | 1.71 | 1.75 | 2.43 | 2.80 | 9.05 |
| Solutions/1000 | 441/1000 | 434/1000 | 429/1000 | 0/1000 | 0/1000 |
| μWCEfficiency | 332 | 339 | 263 | 125 | 4 |
| μEfficiency | 311 | 317 | 238 | 117 | 11 |
| SotAC | - | 0.16 | 0.16 | 0.09 | 0.01 |
| Core Usage/> 1.0 | 1.01/8 | 1.01/17 | 0.00/0 | 0.00/0 | 2.76/38 |
| Core U. ≤ 1.0 | 433 | 417 | 429 | 294 | 0 |
| New Solved | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 |
| Unique Solved | 7/61 | 4/61 | 36/61 | 13/61 | 1/61 |
| I Challenge yoU | Vampire 5.0 | E 3.3.0 | iProver 3.9.3 | Drodi 4.1.0 | CSE_E 1.7 | ConnectPP 0.6.1 | Vampire 4.9 | CSI_Enigma 1.0.6 |
|---|---|---|---|---|---|---|---|---|
| Solved/101 | 69/101 | 42/101 | 34/101 | 21/101 | 18/101 | 1/101 | 70/101 | 46/101 |
| Av. WC Time | 58.00 | 115.02 | 114.13 | 50.54 | 143.54 | 417.48 | 21.69 | 124.19 |
| Av. CPU Time | 385.06 | 732.98 | 882.54 | 389.78 | 514.39 | 417.14 | 141.11 | 946.18 |
| Solutions/101 | 69/101 | 42/101 | 28/101 | 16/101 | 16/101 | 1/101 | 0/101 | 0/101 |
| μWCEfficiency | 172 | 43 | 17 | 41 | 8 | 0 | 195 | 28 |
| μEfficiency | 75 | 20 | 5 | 16 | 6 | 0 | 78 | 8 |
| SotAC | 0.39 | 0.19 | 0.14 | 0.07 | 0.06 | 0.00 | - | 0.21 |
| Core Usage/> 1.0 | 5.89/66 | 6.68/41 | 7.09/34 | 7.24/20 | 2.81/18 | 0.00/0 | 5.91/67 | 6.32/46 |
| Core U. ≤ 1.0 | 3 | 1 | 0 | 1 | 0 | 1 | 3 | 0 |
| New Solved | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 |
| Unique Solved | 4/10 | 1/10 | 0/10 | 0/10 | 0/10 | 0/10 | 5/10 | 0/10 |
| THF without Equality | Vampire 5.0 | E 3.3.0 | Leo‑III 1.7.19 | Vampire 4.9 | Zipperpin 2.1.9999 | cvc5 1.3.0 |
|---|---|---|---|---|---|---|
| Solved/100 | 87/100 | 68/100 | 52/100 | 88/100 | 80/100 | 58/100 |
| Av. WC Time | 2.88 | 2.73 | 8.18 | 5.86 | 11.05 | 28.25 |
| Av. CPU Time | 17.01 | 18.62 | 21.29 | 38.99 | 82.38 | 28.07 |
| Solutions/100 | 85/100 | 64/100 | 52/100 | 0/100 | 0/100 | 0/100 |
| μWCEfficiency | 724 | 617 | 190 | 711 | 452 | 345 |
| μEfficiency | 584 | 568 | 108 | 594 | 362 | 372 |
| SotAC | 0.27 | 0.17 | 0.06 | - | 0.20 | 0.09 |
| Core Usage/> 1.0 | 5.10/35 | 4.56/18 | 2.36/52 | 5.05/35 | 6.21/49 | 0.00/0 |
| Core U. ≤ 1.0 | 52 | 50 | 0 | 53 | 31 | 58 |
| New Solved | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 |
| Unique Solved | 0/5 | 4/5 | 0/5 | 1/5 | 0/5 | 0/5 |
| THF with Equality | Vampire 5.0 | E 3.3.0 | Leo‑III 1.7.19 | Vampire 4.9 | Zipperpin 2.1.9999 | cvc5 1.3.0 |
|---|---|---|---|---|---|---|
| Solved/400 | 362/400 | 327/400 | 190/400 | 367/400 | 335/400 | 238/400 |
| Av. WC Time | 7.30 | 15.24 | 10.94 | 6.03 | 13.72 | 30.63 |
| Av. CPU Time | 44.78 | 57.38 | 33.42 | 34.84 | 99.05 | 30.72 |
| Solutions/400 | 354/400 | 310/400 | 189/400 | 0/400 | 0/400 | 0/400 |
| μWCEfficiency | 610 | 592 | 122 | 620 | 365 | 323 |
| μEfficiency | 443 | 536 | 60 | 444 | 271 | 332 |
| SotAC | 0.31 | 0.24 | 0.04 | - | 0.25 | 0.11 |
| Core Usage/> 1.0 | 4.49/236 | 3.83/158 | 2.76/190 | 4.41/240 | 6.20/246 | 1.53/1 |
| Core U. ≤ 1.0 | 126 | 169 | 0 | 127 | 89 | 237 |
| New Solved | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 |
| Unique Solved | 0/12 | 3/12 | 0/12 | 1/12 | 5/12 | 3/12 |
| TFA using Integers | Vampire 5.0 | iProver 3.9.3 | Vampire 4.9 | cvc5 1.3.0 |
|---|---|---|---|---|
| Solved/100 | 94/100 | 49/100 | 87/100 | 75/100 |
| Av. WC Time | 5.53 | 15.83 | 6.29 | 21.74 |
| Av. CPU Time | 35.38 | 113.24 | 38.42 | 21.53 |
| Solutions/100 | 90/100 | 43/100 | 0/100 | 0/100 |
| μWCEfficiency | 687 | 129 | 545 | 259 |
| μEfficiency | 416 | 65 | 337 | 289 |
| SotAC | 0.39 | 0.04 | - | 0.20 |
| Core Usage/> 1.0 | 4.68/67 | 4.87/46 | 4.94/65 | 0.00/0 |
| Core U. ≤ 1.0 | 27 | 3 | 22 | 75 |
| New Solved | 6/7 | 4/7 | 7/7 | 5/7 |
| Unique Solved | 2/6 | 0/6 | 1/6 | 3/6 |
| TFA using Reals | Vampire 5.0 | iProver 3.9.3 | Vampire 4.9 | cvc5 1.3.0 |
|---|---|---|---|---|
| Solved/50 | 37/50 | 25/50 | 36/50 | 33/50 |
| Av. WC Time | 1.53 | 4.50 | 0.58 | 4.27 |
| Av. CPU Time | 8.41 | 24.55 | 1.72 | 4.06 |
| Solutions/50 | 37/50 | 25/50 | 0/50 | 0/50 |
| μWCEfficiency | 710 | 228 | 687 | 529 |
| μEfficiency | 671 | 129 | 510 | 529 |
| SotAC | 0.21 | 0.01 | - | 0.12 |
| Core Usage/> 1.0 | 4.32/5 | 2.52/22 | 4.16/15 | 0.00/0 |
| Core U. ≤ 1.0 | 32 | 3 | 21 | 33 |
| New Solved | 0/0 | 0/0 | 0/0 | 0/0 |
| Unique Solved | 1/1 | 0/1 | 0/1 | 0/1 |
| Typed First-order Non-theorems | Vampire 5.0 | iProver 3.9.3 | iProver 3.9 | cvc5 1.3.0 |
|---|---|---|---|---|
| Solved/150 | 110/150 | 86/150 | 84/150 | 56/150 |
| Av. WC Time | 1.31 | 22.96 | 21.49 | 28.49 |
| Av. CPU Time | 6.98 | 172.00 | 158.71 | 28.30 |
| Solutions/150 | 110/150 | 86/150 | 84/150 | 56/150 |
| μWCEfficiency | 588 | 159 | 193 | 193 |
| μEfficiency | 364 | 158 | 238 | 197 |
| SotAC | 0.25 | 0.10 | 0.09 | 0.05 |
| Core Usage/> 1.0 | 4.76/71 | 5.78/60 | 6.33/52 | 0.00/0 |
| Core U. ≤ 1.0 | 39 | 26 | 32 | 56 |
| New Solved | 1/2 | 1/2 | 1/2 | 1/2 |
| Unique Solved | 14/14 | 0/14 | 0/14 | 0/14 |
| FOF Theorems without Equality | Vampire 5.0 | E 3.3.0 | iProver 3.9.3 | CSE_E 1.7 | Drodi 4.1.0 | ConnectPP 0.6.1 | hopCoP 0.1 | Vampire 4.9 | CSI_Enigma 1.0.6 | Zipperpin 2.1.9999 | cvc5 1.3.0 | Prover9 1109a | SPASS‑SCL 0.1 | LastButNotLeast 0 | LisaTT 0.9.1 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Solved/100 | 91/100 | 76/100 | 75/100 | 66/100 | 66/100 | 43/100 | 32/100 | 87/100 | 85/100 | 50/100 | 47/100 | 25/100 | 11/100 | 0/100 | 0/100 |
| Av. WC Time | 17.85 | 19.82 | 20.39 | 19.04 | 23.15 | 69.49 | 5.32 | 12.39 | 13.88 | 13.36 | 54.28 | 32.19 | 50.69 | - | - |
| Av. CPU Time | 120.02 | 120.28 | 140.69 | 38.52 | 181.60 | 69.31 | 34.36 | 80.56 | 89.99 | 85.41 | 54.11 | 31.90 | 251.20 | - | - |
| Solutions/100 | 91/100 | 76/100 | 67/100 | 63/100 | 45/100 | 43/100 | 32/100 | 0/100 | 0/100 | 0/100 | 0/100 | 0/100 | 0/100 | 0/100 | 0/100 |
| μWCEfficiency | 612 | 449 | 217 | 161 | 371 | 98 | 186 | 653 | 173 | 218 | 95 | 84 | 34 | - | - |
| μEfficiency | 507 | 343 | 97 | 152 | 292 | 99 | 130 | 540 | 55 | 154 | 95 | 116 | 31 | - | - |
| SotAC | 0.44 | 0.32 | 0.32 | 0.26 | 0.26 | 0.14 | 0.10 | - | 0.39 | 0.16 | 0.17 | 0.10 | 0.03 | - | - |
| Core Usage/> 1.0 | 4.98/52 | 5.18/51 | 4.07/75 | 1.66/44 | 6.65/41 | 0.00/0 | 5.35/23 | 4.43/47 | 4.53/85 | 5.26/37 | 0.00/0 | 0.00/0 | 4.20/10 | - | - |
| Core U. ≤ 1.0 | 39 | 25 | 0 | 22 | 25 | 43 | 9 | 40 | 0 | 13 | 47 | 25 | 1 | 0 | 0 |
| New Solved | 20/25 | 15/25 | 8/25 | 13/25 | 15/25 | 1/25 | 1/25 | 15/25 | 24/25 | 4/25 | 0/25 | 8/25 | 0/25 | 0/25 | 0/25 |
| Unique Solved | 0/3 | 0/3 | 0/3 | 0/3 | 0/3 | 0/3 | 0/3 | 2/3 | 1/3 | 0/3 | 0/3 | 0/3 | 0/3 | 0/3 | 0/3 |
| FOF Theorems with Equality | Vampire 5.0 | E 3.3.0 | iProver 3.9.3 | CSE_E 1.7 | Drodi 4.1.0 | ConnectPP 0.6.1 | hopCoP 0.1 | LisaTT 0.9.1 | Vampire 4.9 | CSI_Enigma 1.0.6 | cvc5 1.3.0 | Zipperpin 2.1.9999 | Prover9 1109a | LastButNotLeast 0 | SPASS‑SCL 0.1 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Solved/400 | 364/400 | 288/400 | 292/400 | 229/400 | 259/400 | 59/400 | 56/400 | 3/400 | 379/400 | 317/400 | 243/400 | 217/400 | 94/400 | 0/400 | 0/400 |
| Av. WC Time | 3.74 | 19.09 | 30.68 | 29.17 | 20.71 | 65.72 | 30.40 | 10.56 | 4.20 | 20.92 | 24.52 | 12.80 | 32.32 | - | - |
| Av. CPU Time | 21.58 | 122.77 | 226.29 | 63.39 | 158.55 | 65.51 | 233.17 | 16.73 | 24.31 | 145.48 | 24.35 | 82.27 | 32.02 | - | - |
| Solutions/400 | 364/400 | 288/400 | 211/400 | 181/400 | 165/400 | 59/400 | 43/400 | 3/400 | 0/400 | 0/400 | 0/400 | 0/400 | 0/400 | 0/400 | 0/400 |
| μWCEfficiency | 688 | 442 | 179 | 143 | 371 | 24 | 76 | 2 | 688 | 164 | 308 | 256 | 70 | - | - |
| μEfficiency | 496 | 323 | 71 | 139 | 268 | 24 | 47 | 1 | 521 | 55 | 320 | 192 | 90 | - | - |
| SotAC | 0.48 | 0.33 | 0.34 | 0.24 | 0.28 | 0.04 | 0.05 | 0.00 | - | 0.39 | 0.28 | 0.22 | 0.08 | - | - |
| Core Usage/> 1.0 | 4.30/220 | 4.81/206 | 4.77/291 | 1.62/169 | 6.36/170 | 0.00/0 | 5.94/42 | 1.87/3 | 4.62/214 | 4.36/317 | 1.02/1 | 5.37/153 | 1.00/1 | - | - |
| Core U. ≤ 1.0 | 144 | 82 | 1 | 60 | 89 | 59 | 14 | 0 | 165 | 0 | 242 | 64 | 93 | 0 | 0 |
| New Solved | 13/18 | 1/18 | 12/18 | 0/18 | 6/18 | 0/18 | 0/18 | 0/18 | 15/18 | 6/18 | 16/18 | 2/18 | 0/18 | 0/18 | 0/18 |
| Unique Solved | 3/14 | 0/14 | 0/14 | 0/14 | 0/14 | 0/14 | 0/14 | 0/14 | 6/14 | 0/14 | 5/14 | 0/14 | 0/14 | 0/14 | 0/14 |
| EPR Unsatisfiable CNF | Vampire 5.0 | iProver 3.9.3 | CSI_Enigma 1.0.6 | E 3.3.0 | Drodi‑EPR 4.1.0 | SPASS‑SCL 0.1 |
|---|---|---|---|---|---|---|
| Solved/100 | 96/100 | 85/100 | 32/100 | 29/100 | 25/100 | 11/100 |
| Av. WC Time | 13.59 | 28.64 | 11.26 | 13.65 | 19.97 | 9.59 |
| Av. CPU Time | 83.89 | 180.20 | 50.26 | 27.24 | 151.93 | 45.90 |
| Solutions/100 | 96/100 | 85/100 | 32/100 | 29/100 | 25/100 | 0/100 |
| μWCEfficiency | 303 | 94 | 59 | 168 | 119 | 92 |
| μEfficiency | 149 | 51 | 22 | 124 | 102 | 84 |
| SotAC | 0.56 | 0.47 | 0.06 | 0.05 | 0.03 | 0.00 |
| Core Usage/> 1.0 | 5.64/88 | 5.37/85 | 3.66/32 | 3.22/15 | 7.28/14 | 2.95/5 |
| Core U. ≤ 1.0 | 8 | 0 | 0 | 14 | 11 | 6 |
| New Solved | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 |
| Unique Solved | 8/8 | 0/8 | 0/8 | 0/8 | 0/8 | 0/8 |
| EPR Satisfiable CNF | Vampire 5.0 | iProver 3.9.3 | CSI_Enigma 1.0.6 | E 3.3.0 | Drodi‑EPR 4.1.0 | SPASS‑SCL 0.1 |
|---|---|---|---|---|---|---|
| Solved/100 | 90/100 | 83/100 | 66/100 | 59/100 | 55/100 | 53/100 |
| Av. WC Time | 4.71 | 8.41 | 9.64 | 21.78 | 3.33 | 3.38 |
| Av. CPU Time | 28.41 | 42.32 | 51.09 | 27.70 | 24.14 | 14.97 |
| Solutions/100 | 90/100 | 83/100 | 0/100 | 53/100 | 0/100 | 0/100 |
| μWCEfficiency | 685 | 310 | 160 | 419 | 481 | 453 |
| μEfficiency | 637 | 230 | 59 | 400 | 437 | 424 |
| SotAC | 0.40 | 0.31 | 0.14 | 0.07 | 0.06 | 0.05 |
| Core Usage/> 1.0 | 5.42/29 | 3.30/57 | 3.68/66 | 3.75/20 | 6.23/13 | 3.31/16 |
| Core U. ≤ 1.0 | 61 | 26 | 0 | 39 | 42 | 37 |
| New Solved | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 |
| Unique Solved | 5/5 | 0/5 | 0/5 | 0/5 | 0/5 | 0/5 |
| Unit Equality CNF | Vampire 5.0 | Twee 2.6.0 | E 3.3.0 | CSE_E 1.7 | Drodi 4.1.0 | Toma 0.7 | iProver 3.9.3 | Vampire 4.9 | CSI_Enigma 1.0.6 |
|---|---|---|---|---|---|---|---|---|---|
| Solved/300 | 263/300 | 258/300 | 222/300 | 167/300 | 121/300 | 114/300 | 205/300 | 258/300 | 238/300 |
| Av. WC Time | 14.22 | 18.63 | 22.33 | 33.54 | 28.92 | 68.09 | 40.38 | 10.34 | 20.74 |
| Av. CPU Time | 95.25 | 144.23 | 153.90 | 79.66 | 226.82 | 67.95 | 308.71 | 67.74 | 145.23 |
| Solutions/300 | 263/300 | 258/300 | 222/300 | 151/300 | 121/300 | 114/300 | 62/300 | 0/300 | 0/300 |
| μWCEfficiency | 421 | 410 | 369 | 94 | 109 | 39 | 99 | 443 | 146 |
| μEfficiency | 211 | 196 | 227 | 80 | 50 | 40 | 36 | 220 | 43 |
| SotAC | 0.31 | 0.30 | 0.20 | 0.09 | 0.05 | 0.04 | 0.17 | - | 0.23 |
| Core Usage/> 1.0 | 5.50/234 | 6.61/221 | 5.63/183 | 1.77/145 | 7.19/112 | 1.00/19 | 6.22/203 | 5.34/226 | 5.14/238 |
| Core U. ≤ 1.0 | 29 | 37 | 39 | 22 | 9 | 95 | 2 | 32 | 0 |
| New Solved | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 |
| Unique Solved | 3/13 | 7/13 | 0/13 | 0/13 | 0/13 | 0/13 | 0/13 | 3/13 | 0/13 |
| SLedgeHammer Theorems | Vampire 4.9 | Vampire 5.0 | E 3.3.0 | cvc5 1.3.0 | Leo‑III 1.7.19 |
|---|---|---|---|---|---|
| Solved/1000 | 441/1000 | 434/1000 | 429/1000 | 294/1000 | 38/1000 |
| Av. WC Time | 1.95 | 1.94 | 2.67 | 2.98 | 3.28 |
| Av. CPU Time | 1.71 | 1.75 | 2.43 | 2.80 | 9.05 |
| Solutions/1000 | 441/1000 | 434/1000 | 429/1000 | 0/1000 | 0/1000 |
| μWCEfficiency | 332 | 339 | 263 | 125 | 4 |
| μEfficiency | 311 | 317 | 238 | 117 | 11 |
| SotAC | - | 0.16 | 0.16 | 0.09 | 0.01 |
| Core Usage/> 1.0 | 1.01/8 | 1.01/17 | 0.00/0 | 0.00/0 | 2.76/38 |
| Core U. ≤ 1.0 | 433 | 417 | 429 | 294 | 0 |
| New Solved | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 |
| Unique Solved | 7/61 | 4/61 | 36/61 | 13/61 | 1/61 |
| I Challenge yoU | Vampire 5.0 | E 3.3.0 | iProver 3.9.3 | Drodi 4.1.0 | CSE_E 1.7 | ConnectPP 0.6.1 | Vampire 4.9 | CSI_Enigma 1.0.6 |
|---|---|---|---|---|---|---|---|---|
| Solved/101 | 69/101 | 42/101 | 34/101 | 21/101 | 18/101 | 1/101 | 70/101 | 46/101 |
| Av. WC Time | 58.00 | 115.02 | 114.13 | 50.54 | 143.54 | 417.48 | 21.69 | 124.19 |
| Av. CPU Time | 385.06 | 732.98 | 882.54 | 389.78 | 514.39 | 417.14 | 141.11 | 946.18 |
| Solutions/101 | 69/101 | 42/101 | 28/101 | 16/101 | 16/101 | 1/101 | 0/101 | 0/101 |
| μWCEfficiency | 172 | 43 | 17 | 41 | 8 | 0 | 195 | 28 |
| μEfficiency | 75 | 20 | 5 | 16 | 6 | 0 | 78 | 8 |
| SotAC | 0.39 | 0.19 | 0.14 | 0.07 | 0.06 | 0.00 | - | 0.21 |
| Core Usage/> 1.0 | 5.89/66 | 6.68/41 | 7.09/34 | 7.24/20 | 2.81/18 | 0.00/0 | 5.91/67 | 6.32/46 |
| Core U. ≤ 1.0 | 3 | 1 | 0 | 1 | 0 | 1 | 3 | 0 |
| New Solved | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 | 0/0 |
| Unique Solved | 4/10 | 1/10 | 0/10 | 0/10 | 0/10 | 0/10 | 5/10 | 0/10 |