THF/300 Satallax
 2.1
LEO‑II
 1.2.8
LEO‑II
 1.2
Isabelle
 2011
TPS
 3.110228S1a
Solved 246/300 208/300 204/300 201/300 190/300
Av. CPU Time 12.04 8.97 4.95 36.55 18.69
Solutions 0/300 208/300 204/300 201/300 0/300
μEfficiency 604.56 597.03 590.20 200.21 393.86
SOTAC 0.32 0.26 0.26 0.28 0.30
New Solved 73/105 65/105 64/105 47/105 46/105
TNT/100 Nitpick
 2011
Refute
 2011
Satallax
 2.1
Solved 71/100 69/100 29/100
Av. CPU Time 6.75 4.75 0.45
Solutions 71/100 69/100 0/100
μEfficiency 155.19 261.26 281.04
SOTAC 0.51 0.50 0.96
New Solved 19/21 19/21 1/21
TFA/100 SPASS+T
 2.2.14
Z3
 2.20
CVC3
 2.4
H2WO4
 11.07
MetiTarski
 1.8
SPASS‑XDB
 0.8
MELIA
 0.1.2
Solved 96/100 92/100 77/100 60/100 54/100 48/100 12/100
Av. CPU Time 2.74 2.15 0.26 0.12 19.85 0.31 1.10
Solutions 96/100 0/100 0/100 0/100 54/100 48/100 0/100
μEfficiency 882.65 874.58 762.39 600.00 458.51 480.00 104.89
SOTAC 0.26 0.24 0.22 0.19 0.21 0.19 0.19
New Solved 5/5 5/5 5/5 0/5 1/5 2/5 0/5
FOF/300 Vampire
 0.6
Vampire
 1.8
E‑MaLeS
 1.0
EP
 1.4pre
iProver
 0.9
leanCoP
 2.2
iProver‑Eq
 0.7
E‑KRHyper
 1.2
E‑Darwin
 1.4
Metis
 2.3
LEO‑II
 1.2.8
Otter
 3.3
Muscadet
 4.1
Solved 269/300 263/300 233/300 232/300 192/300 136/300 135/300 109/300 103/300 101/300 97/300 62/300 42/300
Av. CPU Time 12.95 13.62 18.85 22.55 9.22 46.80 8.68 8.93 6.97 24.75 25.18 5.84 8.99
Solutions 269/300 263/300 233/300 232/300 0/300 136/300 0/300 0/300 0/300 101/300 94/300 62/300 40/300
μEfficiency 583.80 602.87 416.27 420.42 439.32 201.88 375.71 280.00 262.84 201.35 165.53 160.32 97.38
SOTAC 0.19 0.19 0.16 0.16 0.14 0.13 0.11 0.10 0.11 0.10 0.10 0.09 0.15
New Solved 81/98 80/98 61/98 57/98 45/98 39/98 8/98 13/98 13/98 12/98 8/98 6/98 7/98
FNT/200 Paradox
 3.0
FIMO
 0.2
iProver‑SAT
 0.9
Nitrox
 0.2
iProver‑Eq
 0.7
E‑KRHyper
 1.2
EP
 1.4pre
E‑Darwin
 1.4
Solved 169/200 162/200 159/200 140/200 86/200 85/200 78/200 57/200
Av. CPU Time 3.33 14.43 34.93 17.42 7.52 15.92 2.40 7.23
Solutions 169/200 162/200 133/200 140/200 0/200 0/200 78/200 57/200
μEfficiency 728.43 484.37 338.06 118.80 263.50 288.32 327.43 219.28
SOTAC 0.24 0.22 0.21 0.22 0.17 0.21 0.20 0.16
New Solved 14/14 3/14 3/14 14/14 2/14 1/14 1/14 2/14
CNF/200 E
 1.4pre
Vampire
 0.6
Vampire
 1.8
iProver
 0.9
E‑Darwin
 1.4
iProver‑Eq
 0.7
E‑KRHyper
 1.2
LEO‑II
 1.2.8
Metis
 2.3
Otter
 3.3
Solved 178/200 177/200 173/200 116/200 72/200 64/200 63/200 57/200 56/200 55/200
Av. CPU Time 13.06 14.62 12.95 24.16 14.42 10.93 24.60 26.62 20.41 10.50
Solutions 0/200 177/200 173/200 0/200 0/200 0/200 0/200 52/200 56/200 55/200
μEfficiency 679.42 610.46 644.79 268.27 215.91 205.46 214.64 126.37 186.67 207.83
SOTAC 0.24 0.21 0.20 0.17 0.15 0.15 0.14 0.15 0.14 0.15
New Solved 3/4 3/4 3/4 2/4 2/4 1/4 2/4 3/4 0/4 0/4
EPR/150 iProver
 0.9
iProver
 0.8
Vampire
 1.8
iProver‑Eq
 0.7
E
 1.4pre
Metis
 2.3
E‑Darwin
 1.4
FIMO
 0.2
E‑KRHyper
 1.2
Solved 145/150 145/150 127/150 121/150 91/150 78/150 70/150 62/150 60/150
Av. CPU Time 12.70 14.95 15.79 24.78 7.90 20.85 12.64 1.81 10.02
Solutions 62/150 61/150 58/150 0/150 0/150 78/150 54/150 58/150 0/150
μEfficiency 508.26 496.84 579.99 447.61 471.80 309.75 385.15 370.90 356.66
SOTAC 0.20 0.20 0.17 0.16 0.14 0.14 0.13 0.13 0.13
New Solved 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0
UEQ/200 Waldmeister
 710
E
 1.4pre
Vampire
 1.8
Metis
 2.3
Otter
 3.3
E‑Darwin
 1.4
iProver‑Eq
 0.7
iProver
 0.9
E‑KRHyper
 1.2
Solved 195/200 155/200 151/200 53/200 34/200 19/200 18/200 4/200 2/200
Av. CPU Time 11.91 18.59 33.25 68.81 1.36 55.44 63.71 43.49 28.21
Solutions 195/200 0/200 151/200 53/200 34/200 0/200 0/200 0/200 0/200
μEfficiency 707.39 528.49 309.70 51.99 147.49 18.01 27.22 0.92 0.54
SOTAC 0.41 0.30 0.29 0.23 0.24 0.18 0.19 0.20 0.19
New Solved 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0
LTB/225 Vampire‑LTB
 1.8
E‑LTB
 1.4pre
iProver‑SInE
 0.9
iProver‑Eq‑SInE
 0.7
E‑KRHyper‑LTB
 1.2
Solved 139/225 111/225 54/225 17/225 14/225
Av. CPU Time 9.59 56.25 99.42 120.52 4.93
Av. WC Time 3.62 21.33 15.86 22.88 4.95
Solutions 137/225 105/225 17/225 0/225 10/225
μEfficiency 129.63 64.74 21.75 4.29 14.16
SOTAC 0.53 0.46 0.34 0.25 0.25
Core Usage 1.67 2.38 3.81 2.93 1.00
New Solved 53/91 41/91 32/91 10/91 9/91
TNE/100 Satallax
 2.1
TPS
 3.110228S1a
LEO‑II
 1.2.8
Isabelle
 2011
LEO‑II
 1.2
Solved 87/100 78/100 69/100 69/100 66/100
Av. CPU Time 8.93 11.51 8.58 9.07 3.60
Solutions 0/100 0/100 69/100 69/100 66/100
μEfficiency 687.50 542.43 573.47 254.82 578.28
SOTAC 0.32 0.30 0.23 0.25 0.22
New Solved 5/5 1/5 2/5 2/5 2/5
TEQ/200 Satallax
 2.1
LEO‑II
 1.2.8
LEO‑II
 1.2
Isabelle
 2011
TPS
 3.110228S1a
Solved 159/200 139/200 138/200 132/200 112/200
Av. CPU Time 13.74 9.17 5.60 50.92 23.70
Solutions 0/200 139/200 138/200 132/200 0/200
μEfficiency 563.09 608.82 596.17 172.91 319.58
SOTAC 0.32 0.27 0.27 0.30 0.29
New Solved 68/100 63/100 62/100 45/100 45/100
TTN/20 Nitpick
 2011
Refute
 2011
Satallax
 2.1
Solved 11/20 10/20 9/20
Av. CPU Time 5.86 2.26 0.00
Solutions 11/20 10/20 0/20
μEfficiency 110.23 224.54 450.00
SOTAC 0.55 0.50 1.00
New Solved 0/0 0/0 0/0
TTE/80 Nitpick
 2011
Refute
 2011
Satallax
 2.1
Solved 60/80 59/80 20/80
Av. CPU Time 6.91 5.17 0.65
Solutions 60/80 59/80 0/80
μEfficiency 166.44 270.44 238.79
SOTAC 0.51 0.51 0.94
New Solved 19/21 19/21 1/21
TFI/50 SPASS+T
 2.2.14
Z3
 2.20
CVC3
 2.4
MetiTarski
 1.8
H2WO4
 11.07
MELIA
 0.1.2
SPASS‑XDB
 0.8
Solved 47/50 44/50 30/50 14/50 13/50 12/50 10/50
Av. CPU Time 5.36 4.48 0.35 75.79 0.13 1.10 0.35
Solutions 47/50 0/50 0/50 14/50 0/50 0/50 10/50
μEfficiency 785.30 789.17 584.78 117.03 260.00 209.78 200.00
SOTAC 0.33 0.30 0.28 0.28 0.19 0.19 0.22
New Solved 5/5 5/5 5/5 1/5 0/5 0/5 2/5
TFR/50 SPASS+T
 2.2.14
Z3
 2.20
H2WO4
 11.07
CVC3
 2.4
MetiTarski
 1.8
SPASS‑XDB
 0.8
MELIA
 0.1.2
Solved 49/50 48/50 47/50 47/50 40/50 38/50 0/50
Av. CPU Time 0.22 0.02 0.12 0.20 0.26 0.30 -
Solutions 49/50 0/50 0/50 0/50 40/50 38/50 0/50
μEfficiency 980.00 960.00 940.00 940.00 800.00 760.00 -
SOTAC 0.19 0.19 0.18 0.19 0.18 0.18 -
New Solved 0/0 0/0 0/0 0/0 0/0 0/0 0/0
FNE/100 Vampire
 1.8
Vampire
 0.6
iProver
 0.9
E‑MaLeS
 1.0
EP
 1.4pre
iProver‑Eq
 0.7
leanCoP
 2.2
E‑KRHyper
 1.2
E‑Darwin
 1.4
Metis
 2.3
LEO‑II
 1.2.8
Otter
 3.3
Muscadet
 4.1
Solved 98/100 97/100 94/100 94/100 91/100 90/100 73/100 70/100 68/100 66/100 65/100 47/100 25/100
Av. CPU Time 3.12 4.35 3.43 8.04 5.46 6.01 42.48 6.82 7.78 18.28 26.87 5.98 11.87
Solutions 98/100 97/100 0/100 94/100 91/100 0/100 73/100 0/100 0/100 66/100 64/100 47/100 25/100
μEfficiency 898.46 808.87 831.90 686.83 696.72 789.22 421.35 582.54 553.95 424.00 378.35 378.99 175.63
SOTAC 0.11 0.11 0.11 0.11 0.10 0.10 0.10 0.10 0.10 0.09 0.09 0.09 0.13
New Solved 8/8 8/8 5/8 7/8 7/8 5/8 8/8 6/8 8/8 3/8 4/8 6/8 7/8
FEQ/175 Vampire
 0.6
Vampire
 1.8
EP
 1.4pre
E‑MaLeS
 1.0
iProver
 0.9
leanCoP
 2.2
E‑KRHyper
 1.2
E‑Darwin
 1.4
LEO‑II
 1.2.8
iProver‑Eq
 0.7
Metis
 2.3
Otter
 3.3
Muscadet
 4.1
Solved 147/175 142/175 117/175 116/175 79/175 56/175 28/175 27/175 26/175 23/175 22/175 14/175 12/175
Av. CPU Time 18.67 22.32 35.94 27.82 15.58 49.74 9.37 5.40 20.87 19.80 43.45 5.68 3.75
Solutions 147/175 142/175 117/175 116/175 0/175 56/175 0/175 0/175 24/175 0/175 22/175 14/175 12/175
μEfficiency 435.94 422.74 261.38 260.31 199.97 89.33 110.81 98.16 57.59 75.35 65.06 54.16 56.82
SOTAC 0.26 0.25 0.20 0.20 0.18 0.18 0.11 0.14 0.12 0.11 0.11 0.09 0.23
New Solved 71/88 70/88 49/88 53/88 39/88 31/88 5/88 4/88 4/88 2/88 7/88 0/88 0/88
FEP/25 Vampire
 0.6
EP
 1.4pre
Vampire
 1.8
E‑MaLeS
 1.0
iProver‑Eq
 0.7
iProver
 0.9
Metis
 2.3
E‑KRHyper
 1.2
E‑Darwin
 1.4
leanCoP
 2.2
LEO‑II
 1.2.8
Muscadet
 4.1
Otter
 3.3
Solved 25/25 24/25 23/25 23/25 22/25 19/25 13/25 11/25 8/25 7/25 6/25 5/25 1/25
Av. CPU Time 12.68 22.03 4.66 17.81 8.00 11.37 25.97 21.24 5.38 68.32 25.44 7.19 1.39
Solutions 25/25 24/25 23/25 23/25 0/25 0/25 13/25 0/25 0/25 7/25 6/25 3/25 1/25
μEfficiency 718.48 428.56 681.41 425.71 824.19 544.48 264.74 254.09 251.15 111.81 69.78 68.26 28.78
SOTAC 0.15 0.15 0.14 0.14 0.14 0.14 0.12 0.13 0.10 0.10 0.10 0.10 0.09
New Solved 2/2 1/2 2/2 1/2 1/2 1/2 2/2 2/2 1/2 0/2 0/2 0/2 0/2
FNN/125 Paradox
 3.0
iProver‑SAT
 0.9
Nitrox
 0.2
FIMO
 0.2
iProver‑Eq
 0.7
EP
 1.4pre
E‑KRHyper
 1.2
E‑Darwin
 1.4
Solved 119/125 109/125 100/125 100/125 76/125 44/125 43/125 36/125
Av. CPU Time 4.66 20.45 18.08 19.84 8.03 3.08 28.13 6.36
Solutions 119/125 83/125 100/125 100/125 0/125 44/125 0/125 36/125
μEfficiency 765.48 472.04 126.19 441.00 389.84 288.80 235.68 229.27
SOTAC 0.25 0.20 0.22 0.19 0.17 0.15 0.15 0.15
New Solved 12/12 1/12 12/12 1/12 1/12 1/12 1/12 1/12
FNQ/75 FIMO
 0.2
Paradox
 3.0
iProver‑SAT
 0.9
E‑KRHyper
 1.2
Nitrox
 0.2
EP
 1.4pre
E‑Darwin
 1.4
iProver‑Eq
 0.7
Solved 62/75 50/75 50/75 42/75 40/75 34/75 21/75 10/75
Av. CPU Time 5.71 0.15 66.52 3.41 15.79 1.52 8.71 3.60
Solutions 62/75 50/75 50/75 0/75 40/75 34/75 21/75 0/75
μEfficiency 556.65 666.67 114.75 376.06 106.47 391.81 202.64 52.93
SOTAC 0.26 0.22 0.22 0.27 0.24 0.27 0.19 0.14
New Solved 2/2 2/2 2/2 0/2 2/2 0/2 1/2 1/2
HNE/30 Vampire
 1.8
Vampire
 0.6
E
 1.4pre
iProver
 0.9
iProver‑Eq
 0.7
E‑KRHyper
 1.2
E‑Darwin
 1.4
LEO‑II
 1.2.8
Otter
 3.3
Metis
 2.3
Solved 29/30 27/30 27/30 25/30 23/30 18/30 12/30 11/30 11/30 8/30
Av. CPU Time 33.11 8.02 10.57 27.18 9.25 51.05 6.93 12.01 12.92 66.87
Solutions 29/30 27/30 0/30 0/30 0/30 0/30 0/30 10/30 11/30 8/30
μEfficiency 605.16 518.00 589.74 264.67 456.53 280.16 230.69 244.08 277.84 55.91
SOTAC 0.18 0.16 0.19 0.15 0.14 0.14 0.14 0.13 0.14 0.12
New Solved 1/1 1/1 1/1 1/1 1/1 1/1 1/1 1/1 0/1 0/1
HEQ/30 E
 1.4pre
Vampire
 0.6
Vampire
 1.8
Otter
 3.3
E‑Darwin
 1.4
iProver
 0.9
LEO‑II
 1.2.8
E‑KRHyper
 1.2
Metis
 2.3
iProver‑Eq
 0.7
Solved 29/30 28/30 24/30 17/30 15/30 15/30 13/30 10/30 7/30 1/30
Av. CPU Time 10.03 17.79 15.16 0.85 16.01 62.83 21.09 38.25 0.47 1.62
Solutions 0/30 28/30 24/30 17/30 0/30 0/30 11/30 0/30 7/30 0/30
μEfficiency 822.13 631.23 537.47 481.71 327.57 86.29 137.62 148.11 222.68 20.58
SOTAC 0.25 0.21 0.19 0.19 0.14 0.16 0.15 0.15 0.13 0.12
New Solved 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0
NNE/30 iProver
 0.9
Vampire
 1.8
Vampire
 0.6
E
 1.4pre
iProver‑Eq
 0.7
LEO‑II
 1.2.8
E‑KRHyper
 1.2
Metis
 2.3
Otter
 3.3
E‑Darwin
 1.4
Solved 29/30 29/30 29/30 27/30 25/30 7/30 6/30 6/30 5/30 4/30
Av. CPU Time 3.74 10.00 24.00 35.91 7.09 15.65 28.57 41.62 52.95 17.09
Solutions 0/30 29/30 29/30 0/30 0/30 6/30 0/30 6/30 5/30 0/30
μEfficiency 630.51 722.62 511.95 553.61 580.58 119.72 132.52 49.23 23.70 40.07
SOTAC 0.19 0.19 0.19 0.21 0.18 0.14 0.15 0.13 0.13 0.13
New Solved 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0
NEQ/70 E
 1.4pre
Vampire
 0.6
Vampire
 1.8
iProver
 0.9
E‑Darwin
 1.4
E‑KRHyper
 1.2
Metis
 2.3
iProver‑Eq
 0.7
Otter
 3.3
LEO‑II
 1.2.8
Solved 62/70 61/70 60/70 46/70 31/70 28/70 20/70 15/70 14/70 13/70
Av. CPU Time 8.81 11.30 5.26 22.09 14.71 2.72 1.13 20.51 10.72 48.35
Solutions 0/70 61/70 60/70 0/70 0/70 0/70 20/70 0/70 14/70 13/70
μEfficiency 750.80 714.89 749.81 345.61 292.19 358.64 249.88 133.74 154.58 79.33
SOTAC 0.24 0.20 0.20 0.17 0.15 0.14 0.13 0.13 0.13 0.16
New Solved 2/3 2/3 2/3 1/3 1/3 1/3 0/3 0/3 0/3 2/3
PEQ/40 E
 1.4pre
Vampire
 0.6
Vampire
 1.8
Metis
 2.3
LEO‑II
 1.2.8
E‑Darwin
 1.4
Otter
 3.3
E‑KRHyper
 1.2
iProver
 0.9
iProver‑Eq
 0.7
Solved 33/40 32/40 31/40 15/40 13/40 10/40 8/40 1/40 1/40 0/40
Av. CPU Time 7.05 15.25 10.03 22.16 28.67 19.01 0.80 0.75 55.96 -
Solutions 0/40 32/40 31/40 15/40 12/40 0/40 8/40 0/40 0/40 0/40
μEfficiency 609.08 555.35 512.83 250.21 116.94 119.46 181.19 25.00 0.45 -
SOTAC 0.32 0.30 0.26 0.19 0.17 0.15 0.14 0.25 0.12 -
New Solved 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0
EPT/75 iProver
 0.9
iProver
 0.8
Vampire
 1.8
iProver‑Eq
 0.7
E
 1.4pre
Metis
 2.3
E‑Darwin
 1.4
E‑KRHyper
 1.2
FIMO
 0.2
Solved 73/75 73/75 58/75 50/75 34/75 28/75 16/75 6/75 4/75
Av. CPU Time 23.92 27.64 27.45 53.79 3.29 9.86 45.38 46.09 8.27
Solutions 0/75 0/75 58/75 0/75 0/75 28/75 0/75 0/75 0/75
μEfficiency 194.46 187.42 378.08 319.50 381.45 149.80 63.55 31.60 11.30
SOTAC 0.26 0.26 0.21 0.19 0.16 0.16 0.17 0.21 0.19
New Solved 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0
EPS/75 iProver
 0.9
iProver
 0.8
iProver‑Eq
 0.7
Vampire
 1.8
FIMO
 0.2
E
 1.4pre
E‑Darwin
 1.4
E‑KRHyper
 1.2
Metis
 2.3
Solved 72/75 72/75 71/75 69/75 58/75 57/75 54/75 54/75 50/75
Av. CPU Time 1.33 2.09 4.36 5.98 1.36 10.65 2.94 6.01 27.01
Solutions 62/75 61/75 0/75 0/75 58/75 0/75 54/75 0/75 50/75
μEfficiency 822.06 806.27 575.72 781.89 730.49 562.15 706.75 681.72 469.69
SOTAC 0.14 0.14 0.13 0.13 0.12 0.13 0.12 0.12 0.13
New Solved 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0 0/0
CYC/50 Vampire‑LTB
 1.8
E‑LTB
 1.4pre
iProver‑SInE
 0.9
iProver‑Eq‑SInE
 0.7
E‑KRHyper‑LTB
 1.2
Solved 50/50 45/50 3/50 3/50 1/50
Av. CPU Time 8.49 59.33 471.93 475.99 48.12
Av. WC Time 7.04 38.87 57.30 57.31 48.21
Solutions 50/50 43/50 0/50 0/50 0/50
μEfficiency 106.11 21.71 1.00 1.00 0.39
SOTAC 0.53 0.47 0.33 0.33 0.33
Core Usage 1.13 1.50 8.11 8.18 1.00
New Solved 0/0 0/0 0/0 0/0 0/0
ISA/75 Vampire‑LTB
 1.8
E‑LTB
 1.4pre
iProver‑SInE
 0.9
E‑KRHyper‑LTB
 1.2
iProver‑Eq‑SInE
 0.7
Solved 37/75 32/75 18/75 0/75 0/75
Av. CPU Time 6.22 66.52 71.87 - -
Av. WC Time 1.06 10.36 9.22 - -
Solutions 37/75 28/75 0/75 0/75 0/75
μEfficiency 141.48 86.84 29.71 - -
SOTAC 0.57 0.54 0.37 - -
Core Usage 1.81 3.36 4.44 - -
New Solved 37/75 32/75 18/75 0/75 0/75
MZR/80 Vampire‑LTB
 1.8
E‑LTB
 1.4pre
iProver‑SInE
 0.9
E‑KRHyper‑LTB
 1.2
iProver‑Eq‑SInE
 0.7
Solved 32/80 22/80 16/80 3/80 3/80
Av. CPU Time 11.34 48.39 115.33 1.00 133.77
Av. WC Time 1.89 8.09 19.79 1.00 23.13
Solutions 32/80 22/80 0/80 0/80 0/80
μEfficiency 106.25 58.67 14.48 10.42 2.92
SOTAC 0.57 0.42 0.37 0.32 0.26
Core Usage 1.94 2.60 3.83 1.00 3.21
New Solved 0/0 0/0 0/0 0/0 0/0
SMO/20 Vampire‑LTB
 1.8
iProver‑SInE
 0.9
E‑LTB
 1.4pre
iProver‑Eq‑SInE
 0.7
E‑KRHyper‑LTB
 1.2
Solved 20/20 17/20 12/20 11/20 10/20
Av. CPU Time 15.80 47.87 31.71 19.96 1.79
Av. WC Time 2.57 11.88 9.04 13.43 1.81
Answers 18/20 17/20 12/20 0/20 10/20
μEfficiency 237.50 72.83 113.67 34.05 116.67
SOTAC 0.37 0.29 0.24 0.23 0.21
Core Usage 2.31 2.35 2.71 1.42 1.00
New Solved 16/16 14/16 9/16 10/16 9/16