The CADE ATP System Competition The World Championship for Automated Theorem Proving

The CADE ATP System Competition (CASC) is the annual evaluation of fully automatic, classical logic, ATP systems - the world championship for such systems. One purpose of CASC is to provide a public evaluation of the relative capabilities of ATP systems. Additionally, CASC aims to stimulate ATP research, motivate development and implementation of robust ATP systems that can be easily and usefully deployed in applications, provide an inspiring environment for personal interaction between ATP researchers, and expose ATP systems within and beyond the ATP community. CASC evaluates the performance of ATP systems in terms of the number of problems solved with an acceptable solution output, and the average time taken for problems solved, in the context of a bounded number of eligible problems and specified time limits.

CASC is held at each CADE and IJCAR conference - the major forums for the presentation of new research in all aspects of automated deduction. The competition organizer is Geoff Sutcliffe. The competition is overseen by a panel of knowledgeable researchers who are not participating in the event. If you have any questions about the competition, please email the organizer.

Previous CASCs' Division Winners

If you would like to cite CASC (in general), please use:

@Article{Sut16,
    Author       = "Sutcliffe, G.",
    Year         = "2016",
    Title        = "{The CADE ATP System Competition - CASC}",
    Journal      = "AI Magazine",
    Volume       = "37",
    Number       = "2",
    Pages        = "99-101",
    Comment      = "TPTPCite"
}

@Article{SS06-SoCASC,
    Author       = "Sutcliffe, G. and Suttner, C.",
    Year         = "2006",
    Title        = "{The State of CASC}",
    Journal      = "AI Communications",
    Volume       = "19",
    Number       = "1",
    Pages        = "35-48"
}

@Article{PSS02,
    Author       = "Pelletier, F.J. and Sutcliffe, G. and Suttner, C.B.",
    Year         = "2002",
    Title        = "{The Development of CASC}",
    Journal      = "AI Communications",
    Volume       = "15",
    Number       = "2-3",
    Pages        = "79-90"
} 

@Article{SD23-CASC,
    Author       = "Sutcliffe, G. and Desharnais, M.",
    Year         = "2023",
    Title        = "{The 11th IJCAR Automated Theorem Proving System
                    Competition - CASC-J11}",
    Journal      = "AI Communications",
    Volume       = "36",
    Number       = "2",
    Pages        = "73-91,"
}

@Article{SD22-CASC,
    Author       = "Sutcliffe, G. and Desharnais, M.",
    Year         = "2022",
    Title        = "{The CADE-28 Automated Theorem Proving System Competition
                    - CASC-28}",
    Journal      = "AI Communications",
    Volume       = "34",
    Number       = "4",
    Pages        = "259-276"
}

@Article{Sut21-CASC,
    Author       = "Sutcliffe, G.",
    Year         = "2021",
    Title        = "{The 10th IJCAR Automated Theorem Proving System Competition
                    - CASC-J10}",
    Journal      = "AI Communications",
    Volume       = "34",
    Number       = "2",
    Pages        = "163-177"
}

@Article{Sut20-CASC,
    Author       = "Sutcliffe, G.",
    Year         = "2020",
    Title        = "{The CADE-27 Automated Theorem Proving System Competition 
                    - CASC-27}",
    Journal      = "AI Communications",
    Volume       = "32",
    Number       = "5-6",
    Pages        = "373-389"
}

@Article{Sut18-CASC,
    Author       = "Sutcliffe, G.",
    Year         = "2018",
    Title        = "{The 9th IJCAR Automated Theorem Proving System Competition
                    - CASC-29}",
    Journal      = "AI Communications",
    Volume       = "31",
    Number       = "6",
    Pages        = "495-507"
}

@Article{Sut17-CASC,
    Author       = "Sutcliffe, G.",
    Year         = "2017",
    Title        = "{The CADE-26 Automated Theorem Proving System Competition 
                    - CASC-26}",
    Journal      = "AI Communications",
    Volume       = "30",
    Number       = "6",
    Pages        = "419-432"
}

@Article{Sut16-CASC,
    Author       = "Sutcliffe, G.",
    Year         = "2016",
    Title        = "{The 8th IJCAR Automated Theorem Proving System Competition
                    - CASC-J8}",
    Journal      = "AI Communications",
    Volume       = "29",
    Number       = "5",
    Pages        = "607-619"
}

@Article{SU16-CASC,
    Author       = "Sutcliffe, G. and Urban, J.",
    Year         = "2016",
    Title        = "{The CADE-25 Automated Theorem Proving System Competition
                    - CASC-25}",
    Journal      = "AI Communications",
    Volume       = "29",
    Number       = "3",
    Pages        = "423-433"
}

@Article{Sut15-CASC,
    Author       = "Sutcliffe, G.",
    Year         = "2015",
    Title        = "{The 7th IJCAR Automated Theorem Proving System Competition
                    - CASC-J7}",
    Journal      = "AI Communications",
    Volume       = "28",
    Number       = "4",
    Pages        = "683-692"
}

@Article{Sut14-CASC,
    Author       = "Sutcliffe, G.",
    Year         = "2014",
    Title        = "{The CADE-24 Automated Theorem Proving System Competition
                    - CASC-24}",
    Journal      = "AI Communications",
    Volume       = "27",
    Number       = "4",
    Pages        = "405-416"
}

@Article{Sut13,
    Author       = "Sutcliffe, G.",
    Year         = "2013",
    Title        = "{The 6th IJCAR Automated Theorem Proving System Competition
                    - CASC-J6}",
    Journal      = "AI Communications",
    Volume       = "26",
    Number       = "2",
    Pages        = "211-223"
}

@Article{Sut12,
    Author       = "Sutcliffe, G.",
    Year         = "2012",
    Title        = "{The CADE-23 Automated Theorem Proving System Competition
                    - CASC-23}",
    Journal      = "AI Communications",
    Volume       = "25",
    Number       = "1",
    Pages        = "49-63"
}

@Article{Sut11,
    Author       = "Sutcliffe, G.",
    Year         = "2011",
    Title        = "{The 5th IJCAR Automated Theorem Proving System Competition
                    - CASC-J5}",
    Journal      = "AI Communications",
    Volume       = "24",
    Number       = "1",
    Pages        = "75-89"
}

@Article{Sut10,
    Author       = "Sutcliffe, G.",
    Year         = "2010",
    Title        = "{The CADE-22 Automated Theorem Proving System Competition -
                    CASC-22}",
    Journal      = "AI Communications",
    Volume       = "23",
    Number       = "1",
    Pages        = "47-60"
}

@Article{Sut09,
    Author       = "Sutcliffe, G.",
    Year         = "2009",
    Title        = "{The 4th IJCAR Automated Theorem Proving Competition}",
    Journal      = "AI Communications",
    Volume       = "22",
    Number       = "1",
    Pages        = "59-72"
}

@Article{Sut08,
    Author       = "Sutcliffe, G.",
    Year         = "2008",
    Title        = "{The CADE-21 Automated Theorem Proving System Competition}",
    Journal      = "AI Communications",
    Volume       = "21",
    Number       = "1",
    Pages        = "71-82"
}

@Article{Sut07,
    Author       = "Sutcliffe, G.",
    Year         = "2007",
    Title        = "{The 3rd IJCAR Automated Theorem Proving Competition}",
    Journal      = "AI Communications",
    Volume       = "20",
    Number       = "2",
    Pages        = "117-126"
}

@Article{Sut06,
    Author       = "Sutcliffe, G.",
    Year         = "2006",
    Title        = "{The CADE-20 Automated Theorem Proving Competition}",
    Journal      = "AI Communications",
    Volume       = "19",
    Number       = "2",
    Pages        = "173-181"
}

@Article{Sut05,
    Author       = "Sutcliffe, G.",
    Year         = "2005",
    Title        = "{The IJCAR-2004 Automated Theorem Proving Competition}",
    Journal      = "AI Communications",
    Volume       = "18",
    Number       = "1",
    Pages        = "33-40"
}

@Article{SS04,
    Author       = "Sutcliffe, G. and Suttner, C.",
    Year         = "2004",
    Title        = "{The CADE-19 ATP System Competition}",
    Journal      = "AI Communications",
    Volume       = "17",
    Number       = "3",
    Pages        = "103-182"
}

@Article{SS03,
    Author       = "Sutcliffe, G. and Suttner, C.",
    Year         = "2003",
    Title        = "{The CADE-18 ATP System Competition}",
    Journal      = "Journal of Automated Reasoning",
    Volume       = "31",
    Number       = "1",
    Pages        = "23-32"
}

@Article{SSP02,
    Author       = "Sutcliffe, G. and Suttner, C. and Pelletier, F.J.",
    Year         = "2002",
    Title        = "{The IJCAR ATP System Competition}",
    Journal      = "Journal of Automated Reasoning",
    Volume       = "28",
    Number       = "3",
    Pages        = "307-320"
}

@Article{Sut01,
    Author       = "Sutcliffe, G.",
    Year         = "2001",
    Title        = "{The CADE-17 ATP System Competition}",
    Journal      = "Journal of Automated Reasoning",
    Volume       = "27",
    Number       = "3",
    Pages        = "227-250"
}

@Article{Sut00,
    Author       = "Sutcliffe, G.",
    Year         = "2000",
    Title        = "{The CADE-16 ATP System Competition}",
    Journal      = "Journal of Automated Reasoning",
    Volume       = "24",
    Number       = "3",
    Pages        = "371-396"
}

@Article{SS99,
    Author       = "Sutcliffe, G. and Suttner, C.B.",
    Year         = "1999",
    Title        = "{The CADE-15 ATP System Competition}",
    Journal      = "Journal of Automated Reasoning",
    Volume       = "23",
    Number       = "1",
    Pages        = "1-23"
}

@Article{SS98,
    Author       = "Suttner, C.B. and Sutcliffe, G.",
    Year         = "1998",
    Title        = "{The CADE-14 ATP System Competition}",
    Journal      = "Journal of Automated Reasoning",
    Volume       = "21",
    Number       = "1",
    Pages        = "99-134"
}

@Article{SS97,
    Author       = "Sutcliffe, G. and Suttner, C.B.",
    Year         = "1997",
    Title        = "{Special Issue: The CADE-13 ATP System Competition}",
    Journal      = "Journal of Automated Reasoning",
    Volume       = "18",
    Number       = "2"
}

Other people are doing similar things for other types of ATP problems:
SV-COMP	The Competition on Software Verification
ASP Solver Competition	The Answer Set Programming System Competition
SMT-COMP	The Satisfiability Modulo Theories Competition.
Termination Competition	A competition for systems for proving termination.
SAT Competition	The purpose of the competition is to identify new challenging benchmarks and to promote new solvers for the propositional satisfiability problem (SAT) as well as to compare them with state-of-the-art solvers.
MaxSAT	The objective of MaxSAT is assessing the state of the art in the field of Max-SAT solvers, as well as creating a collection of publicly available Max-SAT benchmark instances.
Pseudo-Boolean Competition	The goal of the pseudo-Boolean competition is to assess the state of the art in the field of pseudo-Boolean solvers.
CISC	An informal competition between inductive theorem proving systems.
QBF Solvers Evaluation	QBF Evaluations are a series of yearly events with the purpose of assessing the state of the art in the field of QBF solvers and QBF-based applications. The final of the evaluation are presented during the yearly SAT conferences.