Aims and Motivations

ATP requires ...

• Rigorous, scientific method
• Measurement of progress
• Acknowledgement of progress

Aim: Demonstrate progress in ATP over Time

Basis of Approach

• Evaluate ATP over time
  • Individual results do not satisfy user perspective
  • Combination in systems satisfies user and developer perspectives

• Evaluate ATP systems over time
  • Complete analytical evaluation is not possible

• Emperically evaluate ATP systems over time
  • ATP artifacts are often incomparable
  • ATP artifacts do not satisfy user perspective

• Emperically evaluate ATP systems' abilities to solve problems, over time