The SUMO $100 Challenges


The Suggested Upper Merged Ontology (SUMO), the SUMO midlevel (MILO) ontology, and the SUMO domain ontologies, form the largest formal public ontology in existence today. They are being used for research and applications in search, linguistics and reasoning. SUMO is the only formal ontology that has been mapped to all of the WordNet lexicon. SUMO is written in the SUO-KIF language. SUMO is free and owned by the IEEE. The ontologies that extend SUMO are available under GNU General Public License. Adam Pease of Articulate Software is the Technical Editor of SUMO, and the sponsor of the SUMO challenges.

The goal of the SUMO challenges is to verify the consistency of SUMO and its extensions, or, if inconsistency is found, to provide feedback that is sufficient to produce consistency (in a reasonable way). SUMO and its extensions have been translated into the TPTP language, and are included in TPTP v3.4.0 as axiom files in the commonsense reasoning domain. These axiom files form the input for the challenges. (The translation does not completely reflect the full intent of SUMO, in that it does not capture SUMO's unique names assumption.)

There are three SUMO challenges:

  1. Verify the consistency of, or provide feedback to repair, the base SUMO ontology. This is the axiom file CSR003+0.ax.
  2. Verify the consistency of, or provide feedback to repair, the combined SUMO and MILO ontologies. These are the axiom files CSR003+0.ax and CSR003+1.ax
    And we have a winner ... Krystof Hoder found a bug in kb_Mid_level_ontology_2624 of CSR003+1.ax, which produced inconsistency.
  3. Verify the consistency of, or provide feedback to repair, the combined SUMO, MILO, and domain ontologies. These are the axiom files CSR003+0.ax, CSR003+1.ax, and CSR003+2.ax

The winners of the SUMO challenges will each receive $100 in real US dollars, to be awarded at the CADE or IJCAR following successful completion of a challenge. Who says there's no money in ATP?!