CADE-13 ATP System Competition Results

The ATP systems' output files, precisely as generated in the competition, are all available.


General Hardware Categories


Mixed Problems - Monolithic Systems

ATP System Number
of Proofs
Total
Runtime
Score A
Raw
Score B
Raw
Score A
Relative
Score B
Relative
Proof
Provided
E-SETHEO 36 5655 36 1.91 1.00 1.00 Yes
Otter-Wos 32 6037 32 1.59 0.89 0.83 Yes
SETHEO 31 6647 31 1.40 0.86 0.73 Yes
Violet 30 6694 30 1.34 0.83 0.70 Yes
LINUS 25 8445 25 0.89 0.69 0.47 No
RRTP 21 10738 21 0.59 0.58 0.31 No
CSATCHMO 6 13253 6 0.14 0.17 0.07 No
FSATCHMO 4 13841 4 0.09 0.11 0.05 No

Times taken by each system for each problem

Score A plotted as a function of the time limit    Score B plotted as a function of the time limit


Mixed Problems - Open Systems

ATP System Number
of Proofs
Total
Runtime
Score A
Raw
Score B
Raw
Score A
Relative
Score B
Relative
Proof
Provided
SPASS 32 6244 32 1.54 1.00 1.00 No
Otter-3.0.4 28 7314 28 1.15 0.88 0.75 Yes
Gandalf 25 7870 25 0.95 0.78 0.62 No

Times taken by each system for each problem

Score A plotted as a function of the time limit    Score B plotted as a function of the time limit


Unit Equality Problems - Monolithic Systems

ATP System Number
of Proofs
Total
Runtime
Score A
Raw
Score B
Raw
Score A
Relative
Score B
Relative
Proof
Provided
Otter-3.0.4 43 2570 43 5.02 1.00 1.00 Yes
Waldmeister 37 4730 37 2.35 0.86 0.47 No
DISCOUNT/GL 36 4666 36 2.31 0.84 0.46 No
Gandalf 30 7060 30 1.27 0.70 0.25 No
Barcelona 28 7297 28 1.15 0.65 0.23 No
SPASS 24 9081 24 0.79 0.56 0.16 No

Times taken by each system for each problem

Score A plotted as a function of the time limit    Score B plotted as a function of the time limit


Special Hardware Categories


Mixed Problems - Monolithic Systems

ATP System Number
of Proofs
Total
Runtime
Proof
Provided
CLIN-E 4 14307 No
CLIN-S 9 13476 No
SPTHEO 20 12204 Yes

Times taken by each system for each problem


Unit Equality Problems - Monolithic Systems

ATP System Number
of Proofs
Total
Runtime
Proof
Provided
DISCOUNT 3.0 35 6651 No

Times taken by each system for each problem


Christian Suttner, Geoff Sutcliffe 20.8.96