CADE-13 ATP System Competition Results

The ATP systems' output files, precisely as generated in the competition, are all available.

General Hardware Categories

Mixed Problems - Monolithic Systems

ATP System Number
of Proofs 		Total
Runtime 		Score A
Raw 		Score B
Raw 		Score A
Relative 		Score B
Relative 		Proof
Provided
E-SETHEO 36 5655 36 1.91 1.00 1.00 Yes
Otter-Wos 32 6037 32 1.59 0.89 0.83 Yes
SETHEO 31 6647 31 1.40 0.86 0.73 Yes
Violet 30 6694 30 1.34 0.83 0.70 Yes
LINUS 25 8445 25 0.89 0.69 0.47 No
RRTP 21 10738 21 0.59 0.58 0.31 No
CSATCHMO 6 13253 6 0.14 0.17 0.07 No
FSATCHMO 4 13841 4 0.09 0.11 0.05 No

Times taken by each system for each problem

Score A plotted as a function of the time limit    Score B plotted as a function of the time limit

Mixed Problems - Open Systems

ATP System Number
of Proofs 		Total
Runtime 		Score A
Raw 		Score B
Raw 		Score A
Relative 		Score B
Relative 		Proof
Provided
SPASS 32 6244 32 1.54 1.00 1.00 No
Otter-3.0.4 28 7314 28 1.15 0.88 0.75 Yes
Gandalf 25 7870 25 0.95 0.78 0.62 No

Times taken by each system for each problem

Score A plotted as a function of the time limit    Score B plotted as a function of the time limit

Unit Equality Problems - Monolithic Systems

ATP System Number
of Proofs 		Total
Runtime 		Score A
Raw 		Score B
Raw 		Score A
Relative 		Score B
Relative 		Proof
Provided
Otter-3.0.4 43 2570 43 5.02 1.00 1.00 Yes
Waldmeister 37 4730 37 2.35 0.86 0.47 No
DISCOUNT/GL 36 4666 36 2.31 0.84 0.46 No
Gandalf 30 7060 30 1.27 0.70 0.25 No
Barcelona 28 7297 28 1.15 0.65 0.23 No
SPASS 24 9081 24 0.79 0.56 0.16 No

Times taken by each system for each problem

Score A plotted as a function of the time limit    Score B plotted as a function of the time limit

Special Hardware Categories

Mixed Problems - Monolithic Systems

ATP System Number
of Proofs 		Total
Runtime 		Proof
Provided
CLIN-E 4 14307 No
CLIN-S 9 13476 No
SPTHEO 20 12204 Yes

Times taken by each system for each problem

Unit Equality Problems - Monolithic Systems

ATP System Number
of Proofs 		Total
Runtime 		Proof
Provided
DISCOUNT 3.0 35 6651 No

Times taken by each system for each problem

Christian Suttner, Geoff Sutcliffe 20.8.96