TPTP Results Collection

Performance Data Available

• Extracted from the TSTP Solution Library
• Summarized for analysis

Header Information

• TPTP version and tptp2X options
• CPU, RAM, and OS
• Resource limits (in particular the runtime, CPU or WC)
• ATP system settings and flags
• Result for each problem (including the runtime)

Measurements

• Number of problem results still valid (not bugfixed)
• Number of valid problems not tested, and the reason (must be a good reason)
• Number of solutions (and other results)
• Percentage success

Used for System and Problem Evaluation