collected by | Geoff Sutcliffe geoff@cs.miami.edu | and | Christian Suttner suttner@informatik.tu-muenchen.de |
Since the first release of the TPTP Problem Library in 1993, many researchers have used the TPTP as an appropriate and convenient basis for ATP system evaluation. Some researchers, who have tested their ATP systems over the entire TPTP, have made their result data available. The data has been collected, and is used for determining system ratings, system recommendations, and the TPTP problem ratings. Currently we have data for the systems listed below.
------------------------------------------------------------------------------- ATP system name : SPTHEO m256n1 People : Christian Suttner URL : http://wwwjessen.informatik.tu-muenchen.de/~suttner/sptheo.html References : [Sut95] Suttner (1995), Parallelization of Search-based Sy TPTP release : v1.1.3 tptp2X flags : -f setheo (No use of clause type information) CPU : HP 720 RAM size : 32 MByte Operating system : HP-UX 9.X Implementation : C and PVM. Compiler: HP-UX cc. Flags: -c -g -o Resource limits : 20 seconds for task generation. 20 seconds per task Settings/flags : -cons -ir -m 256 for task generation (i.e., 256 tasks requested) -cons -dr for task processing. 1 processor used (time sharing) Results format : Solns TotTime APnTime PEnWork APnWork PL m Results values : Solns - P and number of proofs found or TMO-Non or ERR-Non (X), where X indicates the type of error TotTime - Wall clock time for parallel system, with 0 communication time, in seconds APnWork - Task generation time plus accumulated search times (summed over all processors), in seconds PEnTime - Number of inferences (generation + 1st proof task) APnWork - Accumulated number of inferences (summed over all processors) PL - Proof length of first proof found (not shortest) m - Number of tasks generated Results summary : 1328 problems (2652 in v1.1.3, 1324 Bugfixed or Removed) 14 IAP-Non 565 TMO-Non 749 UNS-Ass 1314 tested (99%) 749 solutions 57% success, over those tested 56% success, overall Comments : Not tested on problems known to be satisfiable : If a proof is found in the sequential task generation phase, CPUapn and APnWork are meaningless and marked with "-". CPUtot and PEnWork then refer to task generation : Some satisfiable problems were not_tested. They are labelled "satisfiable" : The problems with "Error" results exceeded the capacity of some component of SETHEO ------------------------------------------------------------------------------- ATP system name : CLIN 1.0 People : Shie-Jue Lee URL : ftp.cs.unc.edu:pub/projects/mi/clin/prover.tar.Z http://www.cs.unc.edu/mi/mi-provers.html References : [Lee90] Lee (1990), CLIN: An Automated Reasoning System Us : [LP92] Lee & Plaisted (1992), Eliminating Duplication wit TPTP release : v1.1.3 tptp2X flags : -f sprfn (No use of clause type information) CPU : RS/6000 550 RAM size : 512MB / 1024MB Operating system : AIX 3.2.5 Implementation : Prolog. Compiler: ECLiPSe 3.4.5. Flags: nodbgcomp Resource limits : 1800 seconds Settings/flags : assign(support_list,[f]). set(slidepriority) Maximum clause size method Results format : Solns TotTime ModTime Clauses Results values : Solns - P and number of proofs found or M and number of models found or TMO-Non or var_lim (limit of 20 distinct variables exceeded) or cls_lim (limit of 1600 input clauses exceeded) TotTime - CPU time, in seconds Clauses - Number of clauses retained Results summary : 1328 problems (2652 in v1.1.3, 1324 Bugfixed or Removed) 4 ERR-Non 664 TMO-Non 651 UNS-Ass 9 SAT-Ass 1328 tested (100%) 660 solutions 50% success, over those tested 50% success, overall Comments : CLIN automatically switches to All support and the Maximum clause size method for propositional problems ------------------------------------------------------------------------------- ATP system name : CLIN-E 0.35FM People : Geoff Alexander URL : References : [Ale95] Alexander (1995), Proving First-Order Equality The TPTP release : v1.1.3 tptp2X flags : -f sprfn (No use of clause type information) CPU : RS/6000 550 RAM size : 512MB / 1024MB Operating system : AIX 3.2.5 Implementation : C++. Compiler: IBM C Set++. Flags: -03 -qinlglue Resource limits : 1800 seconds Settings/flags : Forward support. Maximum clause size method Unit literal deletion on. Unit literal subsumption on Results format : Solns TotTime ModTime Memory Clauses Results values : Solns - P and number of proofs found or M and number of models found or TMO-Non TotTime - CPU time, in seconds Memory - Memory used, in K Clauses - Number of clauses retained Results summary : 1328 problems (2652 in v1.1.3, 1324 Bugfixed or Removed) 783 TMO-Non 536 UNS-Ass 9 SAT-Ass 1328 tested (100%) 545 solutions 41% success, over those tested 41% success, overall Comments : CLIN-E automatically switches to All support and the Sum clause size method for propositional problems ------------------------------------------------------------------------------- ATP system name : CLIN-S 1.0+ People : Heng Chu URL : ftp.cs.unc.edu:pub/projects/mi/clin-s/* http://www.cs.unc.edu/Research/mi/mi-provers.html References : [CP94] Chu & Plaisted (1994), Semantically Guided First-o TPTP release : v1.1.3 tptp2X flags : -f sprfn ?? (No use of clause type information) CPU : DEC station 5000/120 RAM size : ?? Operating system : ?? Implementation : Prolog. Compiler: Quintus. Flags: ?? Resource limits : 1000 seconds ?MEMORY? Settings/flags : FL (Model literal filtering) on, NP (Natural replacement on model literals) on, TR (Simple term rewriting on model literals) off, MP (Minimal replacement on model literals) on, RR (Rough resolution) on, UR (UR resolution) on Backward support = Using the all positive model Results format : Solns Time Rounds Clauses Backtracks Results values : Solns - P(XX) and number of proofs found, where XX indicates how the proof was found, one of: HM=Hyper linking, MF=Model Finding, RR=Rough Resolution, US=Unit Simplification, UR=UR resolution or M and number of models found or TMO-Non or ERR-Non (UNK-Non error) or unsound_model Time - CPU time, in seconds Rounds - Number of hyper-linking rounds Clauses - Number of clauses retained Backtrack - Number of backtrackings caused by FL,NP,TR,MP, and UR (see Settings/flags above) Results summary : 1328 problems (2652 in v1.1.3, 1324 Bugfixed or Removed) 78 NTT-Non 25 ERR-Non 602 TMO-Non 623 UNS-Ass 1250 tested (94%) 623 solutions 50% success, over those tested 47% success, overall Comments : Hardware used was not constant; other similar machines were also used ------------------------------------------------------------------------------- ATP system name : CLIN-S 1.0- TPTP release : v1.1.3 Settings/flags : FL (Model literal filtering) on, NP (Natural replacement on model literals) on, TR (Simple term rewriting on model literals) off, MP (Minimal replacement on model literals) on, RR (Rough resolution) on, UR (UR resolution) on Forward support = Using the all negative model Results summary : 1328 problems (2652 in v1.1.3, 1324 Bugfixed or Removed) 19 NTT-Non 28 ERR-Non 680 TMO-Non 601 UNS-Ass 1309 tested (99%) 601 solutions 46% success, over those tested 45% success, overall Comments : See CLIN-S 1.0+ ------------------------------------------------------------------------------- ATP system name : LINUS 1.0.1 People : Reinhold Letz URL : References : [Let97] Letz (1997), LINUS: A Link Instantiation Prover wi TPTP release : v1.1.3 tptp2X flags : -f setheo (No use of clause type information) CPU : Sparc 10 RAM size : 128 Mb Operating system : Solaris 2.4 Implementation : LISP. Compiler: Allegro Common Lisp 4.2. Flags: ?? Resource limits : 300 seconds Settings/flags : increase_rate = 1.5 (general weighting factor) unit_div = 2 (weighting factor for units) non_unit_mult = 1 (weighting factor for non-units) no dynamic clause splitting Results format : Solns Time GroundCls UnitCls Inferences Results values : Solns - P(X) and number of proofs found, where X = S for proofs found at the propositional level, X = U for proofs found by the unit module or M and number of models found or TMO-Non Time - CPU time, in seconds GroundCls - Number of ground clauses in P(S) proofs UnitCls - Number of unit clauses in P(S) proofs Inferences - Number of inference steps in proofs Results summary : 1328 problems (2652 in v1.1.3, 1324 Bugfixed or Removed) 593 TMO-Non 726 UNS-Ass 9 SAT-Ass 1328 tested (100%) 735 solutions 55% success, over those tested 55% success, overall Comments : For unit proofs (P(U)) the number of inferences is currently missing. In a future version of LINUS it will be given ------------------------------------------------------------------------------- ATP system name : DISCOUNT 2.0-GL People : Stephan Schulz (Proof protocols, Learning) Joerg Denzinger (Distribution concept, theory for existentially qualified goals) Werner Pitz (Implementation of inference engine and distribution scheme) Martin Kronenburg (Planning component, his domain recognition engine is reused by the learning system) URL : References : [DS96] Denzinger & Schulz (1996), Learning Domain Knowled TPTP release : v1.2.1 Tested on SPCs : UEQ tptp2X flags : -f otter (No use of clause type information) CPU : SparcStation 10, 50MHz sun4m (SuperSparc Processor) RAM size : 128MB Operating system : Solaris 2.5.1 Implementation : C. Compiler: gcc 2.4.5 Flags: -O2 -D SPARC Resource limits : 150 seconds Settings/flags : -I 5 -D 1 -G 15 -R 2 -T 1 -A -3 -B 1500 -x c_global_learn Results format : Solns Time SrhTime Results values : Solns - P(X) and number of proofs found or M(X) and the number of models found, where X is "C" when the goal is universally quantified, and "P" when the goal is existentially quantified and thus overlapping into the goal is performed or TMO-Non Time - CPU time, in seconds SrhTime - Time in proof search, in seconds Results summary : 1680 problems (2752 in v1.2.1, 1072 Bugfixed or Removed) 1318 IAP-Non 106 TMO-Non 255 UNS-Ass 1 SAT-Ass 362 tested (22%) 256 solutions 71% success, over those tested 15% success, overall Comments : Used a knowledge base (implicitly named "KNOWLEDGE") generated from 664 proofs/226 problems : PCL, the "Proof Communication Language" is currently supported only for universally quantified goals : Various other people work on DISCOUNT. In particular, the learning system profits from proofs found with the distributed system and Matthias Fuchs' analogical learning ------------------------------------------------------------------------------- ATP system name : PROTEIN V2.20 People : Artificial Intelligence Research Group, University Koblenz URL : http://www.uni-koblenz.de/ag-ki/Systems/Protein/ References : [BF94] Baumgartner & Furbach (1994), PROTEIN: A PROver wi [BF94] Baumgartner & Furbach (1994), Model Elimination wi [Bau94] Baumgartner (1994), Refinements of Theory Model El [Bau96] Baumgartner (1996), Linear and Unit-Resulting Refu [BFS97] Baumgartner et al. (1997), Computing Answers with TPTP release : v2.0.0 Tested on SPCs : CNF tptp2X flags : -f protein (No use of clause type information) CPU : 143MHz Sun Ultra 1 and 75MHz SPARCstation 20 MP RAM size : 64MB and 300MB Operating system : SunOS 5.5.1 Implementation : Prolog. Compiler: Eclipse Prolog Resource limits : 300 seconds Settings/flags : Default expect trace switched off ??? Results format : Solns Time WCTime Results values : Solns - P and number of proofs found or TMO-Non or GUP-Non (No solution due to incompleteness) Time - CPU time, in seconds WCTime - Wall clock time, in seconds Results summary : 1923 problems (3277 in v2.0.0, 1354 Bugfixed or Removed) 212 IAP-Non 32 GUP-Non 849 TMO-Non 830 UNS-Ass 1711 tested (89%) 830 solutions 49% success, over those tested 43% success, overall Comments : PROTEIN with automated theory handling, as used to establish these results, is incomplete. (Without theory handling PROTEIN is complete, but it would loop e.g. on BOO008-3.) ------------------------------------------------------------------------------- ATP system name : DISCOUNT TSM2.1 People : Stephan Schulz (Term Space Maps, Proof Analysis and Learning, Hacks) Joerg Denzinger (Initial supervision, Calculus) Werner Pitz (Main inference engine) Martin Kronenburg URL : References : [DS96a] Denzinger & Schulz (1996), Learning Domain Knowled [DS96b] Denzinger & Schulz (1996), Recording and Analysing [DKS97] Denzinger et al. (1997), DISCOUNT: A Distributed a [Sch98] Schultz (1998), Term Space Mapping for DISCOUNT TPTP release : v2.1.0 Tested on SPCs : UEQ tptp2X flags : -t rm_equality:rm_eq_rstfp -f otter CPU : SparcStation Ultra2/200 RAM size : 512MB Operating system : Solaris 2.5.1 Implementation : C. Compiler: gcc-2.7.2. Flags: -O6 Resource limits : 300 seconds Settings/flags : -x otsmstandard -proofs_limit 0.4 -neg_limit 0.8 Results format : Solns Time PE Results values : Solns - P and number of proofs found or M and the number of models found or TMO-Non Time - CPU time, in seconds PE - Problem Encoding: Universally (A) or Existentially (E) quantified Results summary : 3451 problems (3622 in v2.1.0, 171 Bugfixed or Removed) 3069 IAP-Non 113 TMO-Non 268 UNS-Ass 1 SAT-Ass 382 tested (11%) 269 solutions 70% success, over those tested 8% success, overall Comments : Used a knowledge base containing 203 problems for learning ------------------------------------------------------------------------------- ATP system name : SCOTT 6.1 People : Kahlil Hodgson, John Slaney, Ewing Lusk, William McCune URL : References : [SH97] Slaney & Hodgson (1997), Extending SCOTT to use Mu [SLM94] Slaney et al. (1994), SCOTT: Semantically Constrai [Sla93] Slaney (1993), SCOTT: A Model-Guided Theorem Prove TPTP release : v3.3.0 tptp2X flags : -t add_equality:r -f scott:hypothesis:conjecture:none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 1000MB Operating system : Linux 2.6.17-1.2142_FC4 Implementation : C Resource limits : 600 seconds Settings/flags : assign(max_num_maxisets, 5) assign(min_num_maxisets, 3) assign(true_weight, 0) assign(sem_queue_limit, 2) assign(min_search_time, 500) assign(max_search_time, 2000) assign(tolerance, \"1.5\") assign(min_prob_extn, \"0.3\") assign(cost_margin, \"10.0\") assign(guidance_factor, \"5.0\") assign(min_refinement, 0) clear(demod_in_conjecture) clear(demod_in_sem_base) assign(max_int_fails, 2) assign(max_ext_fails, 2) assign(revs_to_skip_on_fail, 2) assign(limit_weight_to, 10) assign(cull_weights_over, 90) assign(memory_control_point, 10000) set(semantic_guidance) Results format : Solns Time Given Clauses ClsKept Results values : Solns - SZS standard Time - CPU time, in seconds Given - Number of given clauses in loop Clauses - Number of clauses generated ClsKept - Number of clauses kept Results summary : 9742 problems (9894 in v3.3.0, 152 Bugfixed or Removed) 673 UNK-Non 693 GUP-Non 4246 TMO-Non 1124 THM-Ref 2500 UNS-Ref 136 CSA-Mod 370 SAT-Mod 9742 tested (100%) 4130 solutions 42% success, over those tested 42% success, overall Comments : ------------------------------------------------------------------------------- ATP system name : Gandalf c-2.6 People : Tanel Tammet URL : http://www.ttu.ee/it/gandalf/ TPTP release : v3.5.0 Tested on SPCs : CNF tptp2X flags : -f otter:hypothesis:set(auto),clear(print_given) -t add_equality:r CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 1000MB Operating system : Linux 2.4.22-21mdk-i686-up-4GB Resource limits : 600s Command/settings : gandalf-wrapper -time %d %s Results format : Solns Time Given Derived Kept Results summary : 11079 problems (11395 in v3.5.0, 316 Bugfixed or Removed) 4766 IAP-Non 2449 UNK-Non 310 TMO-Non 3554 UNS-Ass 6313 tested (57%) 3554 solutions 56% success, over those tested 32% success, overall Submitted by : Geoff Sutcliffe Inserted : Tue Jul 22 06:06:34 EDT 2008 Comments : ------------------------------------------------------------------------------- ATP system name : Faust 1.0 People : Yury Puzis URL : http://umsis.miami.edu/~ypuzis/FAUST-AutomatedTheoremProver.html TPTP release : v3.5.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2794MHz RAM size : 1003MB Operating system : Linux 2.6.11-1.1369_FC4 Resource limits : 600s Command/settings : faust %s Results format : Solns Time Results summary : 11079 problems (11395 in v3.5.0, 316 Bugfixed or Removed) 4493 UNK-Non 4761 TMO-Non 546 THM-Ref 5 THM-Ass 1274 UNS-Ref 11079 tested (100%) 1825 solutions 16% success, over those tested 16% success, overall Submitted by : Geoff Sutcliffe Inserted : Tue Jul 22 06:06:34 EDT 2008 Comments : ------------------------------------------------------------------------------- ATP system name : CARINE 0.734 People : Paul Haroun URL : http://www.atpcarine.com/ TPTP release : v5.3.0 Tested on SPCs : CNF tptp2X flags : -f carine -t add_equality CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : carine %s t=%d xo=off uct=32000 Results format : Solns Time Generated Units Results summary : 18942 problems (19446 in v5.3.0, 504 Bugfixed or Removed) 11220 IAP-Non 5702 UNK-Non 100 GUP-Non 1176 TMO-Non 744 UNS-Ref 7722 tested (41%) 744 solutions 10% success, over those tested 4% success, overall Submitted by : Geoff Sutcliffe Inserted : Mon Dec 5 10:56:46 EST 2011 Comments : ------------------------------------------------------------------------------- ATP system name : LeanTaP 2.3 People : Bernhard Beckert URL : http://www.uni-koblenz.de/~beckert/leantap/ TPTP release : v5.3.0 Tested on SPCs : FOF CNF tptp2X flags : -f leantap -t add_equality CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : leantap %s Results format : Solns Time Results summary : 18942 problems (19446 in v5.3.0, 504 Bugfixed or Removed) 3846 IAP-Non 2793 UNK-Non 11577 TMO-Non 411 THM-Ass 315 UNS-Ass 15096 tested (80%) 726 solutions 5% success, over those tested 4% success, overall Submitted by : Geoff Sutcliffe Inserted : Mon Dec 5 12:49:08 EST 2011 Comments : ------------------------------------------------------------------------------- ATP system name : Mace2 2.2 People : William McCune URL : http://www.cs.unm.edu/~mccune/otter/ TPTP release : v5.3.0 Tested on SPCs : FOF_CSA FOF_SAT CNF_SAT FOF_UNK CNF_UNK tptp2X flags : -f otter:hypothesis:set(auto),clear(print_given) -t stdfof+add_equality:r CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : mace-script %s Results format : Solns Time Size Results summary : 18942 problems (19446 in v5.3.0, 504 Bugfixed or Removed) 13720 IAP-Non 1161 UNK-Non 2083 GUP-Non 1360 TMO-Non 136 CSA-FMo 482 SAT-FMo 5222 tested (28%) 618 solutions 12% success, over those tested 3% success, overall Submitted by : Geoff Sutcliffe Inserted : Mon Dec 5 13:02:24 EST 2011 Comments : Flags: -N 12 -p -k 100000 ------------------------------------------------------------------------------- ATP system name : ToFoF 0.1 People : Geoff Sutcliffe, Michael Schick URL : http://www.cs.miami.edu/~tptp/ATPSystems/ToFoF/ TPTP release : v5.3.0 Tested on SPCs : TFF_NAR tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : tofof %d %s Results format : Solns Time Results summary : 18942 problems (19446 in v5.3.0, 504 Bugfixed or Removed) 18789 IAP-Non 21 UNK-Non 1 GUP-Non 97 TMO-Non 34 THM-CRf 153 tested (1%) 34 solutions 22% success, over those tested 0% success, overall Submitted by : Geoff Sutcliffe Inserted : Mon Dec 5 15:46:18 EST 2011 Comments : ------------------------------------------------------------------------------- ATP system name : ToFoF-SAT 0.1 People : Geoff Sutcliffe, Michael Schick URL : http://www.cs.miami.edu/~tptp/ATPSystems/ToFoF/ TPTP release : v5.3.0 Tested on SPCs : TFF_NAR tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : tofof %d %s --model Results format : Solns Time Size Results summary : 18942 problems (19446 in v5.3.0, 504 Bugfixed or Removed) 18787 IAP-Non 27 UNK-Non 3 GUP-Non 122 TMO-Non 3 THM-Ass 155 tested (1%) 3 solutions 2% success, over those tested 0% success, overall Submitted by : Geoff Sutcliffe Inserted : Mon Dec 5 15:46:46 EST 2011 Comments : ------------------------------------------------------------------------------- ATP system name : Yices 1.0.29 People : URL : http://yices.csl.sri.com/ TPTP release : v5.3.0 Tested on SPCs : TFF tptp2X flags : -f smt -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2800MHz RAM size : 2005MB Operating system : Linux 2.6.32.26-175.fc12.i686.PAE Resource limits : 300s Command/settings : yices -smt %s Results format : Solns Time Results summary : 18942 problems (19446 in v5.3.0, 504 Bugfixed or Removed) 17964 IAP-Non 504 UNK-Non 131 GUP-Non 1 TMO-Non 321 THM-Ass 21 CSA-Ass 978 tested (5%) 342 solutions 35% success, over those tested 2% success, overall Submitted by : Geoff Sutcliffe Inserted : Mon Dec 5 16:03:18 EST 2011 Comments : ------------------------------------------------------------------------------- ATP system name : Ayane 1.1 People : Russell Wallace URL : http://code.google.com/p/ayane/ TPTP release : v5.3.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : ayane -t %d %s Results format : Solns Time Results summary : 18942 problems (19446 in v5.3.0, 504 Bugfixed or Removed) 3846 IAP-Non 11060 UNK-Non 77 GUP-Non 1661 TMO-Non 1056 THM-CRf 1242 UNS-CRf 15096 tested (80%) 2298 solutions 15% success, over those tested 12% success, overall Submitted by : Geoff Sutcliffe Inserted : Mon Dec 5 10:35:47 EST 2011 Comments : ------------------------------------------------------------------------------- ATP system name : omkbTT 1.0 People : Sarah Winkler URL : http://cl-informatik.uibk.ac.at/software/omkbtt/ TPTP release : v5.3.0 Tested on SPCs : CNF_UEQ tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : omkbtt -t %d %s -p Results format : Solns Time Results summary : 18942 problems (19446 in v5.3.0, 504 Bugfixed or Removed) 16590 IAP-Non 1290 UNK-Non 72 GUP-Non 621 TMO-Non 364 UNS-CRf 5 SAT-Sat 2352 tested (12%) 369 solutions 16% success, over those tested 2% success, overall Submitted by : Geoff Sutcliffe Inserted : Mon Dec 5 13:55:36 EST 2011 Comments : ------------------------------------------------------------------------------- ATP system name : randoCoP 1.1 People : Jens Otten, Thomas Raths URL : TPTP release : v5.4.0 Tested on SPCs : FOF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : randocop.sh %s %d Results format : Solns Time Results summary : 19116 problems (19459 in v5.4.0, 343 Bugfixed or Removed) 11594 IAP-Non 7 UNK-Non 4977 TMO-Non 2436 THM-Prf 59 UNS-Prf 23 CSA-Ass 20 SAT-Ass 7522 tested (39%) 2538 solutions 34% success, over those tested 13% success, overall Submitted by : Geoff Sutcliffe Inserted : Mon Jun 18 16:36:01 EDT 2012 Comments : ------------------------------------------------------------------------------- ATP system name : FDP 0.9.16 People : Peter Baumgartner URL : TPTP release : v5.4.0 Tested on SPCs : CNF tptp2X flags : -f protein -t add_equality CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : fdp-casc %s %d Results format : Solns Time Results summary : 19116 problems (19459 in v5.4.0, 343 Bugfixed or Removed) 11384 IAP-Non 1059 UNK-Non 167 GUP-Non 4060 TMO-Non 2051 UNS-Ass 395 SAT-Ass 7732 tested (40%) 2446 solutions 32% success, over those tested 13% success, overall Submitted by : Geoff Sutcliffe Inserted : Mon Jun 11 13:07:21 EDT 2012 Comments : Flags: -q -a ------------------------------------------------------------------------------- ATP system name : H2WO4 11.07 People : David Stanovsky URL : http://www.karlin.mff.cuni.cz/~stanovsk/h2wo4/ TPTP release : v6.0.0 Tested on SPCs : TF0_ARI tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 3.00GHz @ 3000MHz RAM size : 2005MB Operating system : Linux 2.6.32.26-175.fc12.i686.PAE Resource limits : 300s Command/settings : h2wo4_wrap %s %d Results format : Solns Time Results summary : 19964 problems (20306 in v6.0.0, 342 Bugfixed or Removed) 19104 IAP-Non 12 UNK-Non 299 GUP-Non 511 THM-Ass 38 CSA-Ass 860 tested (4%) 549 solutions 64% success, over those tested 3% success, overall Submitted by : Geoff Sutcliffe Inserted : Thu Aug 29 17:42:48 EDT 2013 Comments : ------------------------------------------------------------------------------- ATP system name : SPASS-XDB 0.8 People : Martin Suda, Geoff Sutcliffe, Patrick Wischnewski, Manuel Lamotte-Schubert, Gerard de Melo URL : http://www.cs.miami.edu/~tptp/ATPSystems/SPASS-XDB/ TPTP release : v6.0.0 Tested on SPCs : TF0_ARI tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : run-spass-xdb %s -EPrint=2 Results format : Solns Time Derived Queued Asked Delivered Results summary : 19964 problems (20306 in v6.0.0, 342 Bugfixed or Removed) 19104 IAP-Non 11 UNK-Non 113 GUP-Non 260 TMO-Non 476 THM-Ref 860 tested (4%) 476 solutions 55% success, over those tested 2% success, overall Submitted by : Geoff Sutcliffe Inserted : Fri Aug 30 20:11:53 EDT 2013 Comments : ------------------------------------------------------------------------------- ATP system name : Alt-Ergo 0.95.1 People : Andrei Paskevich URL : http://alt-ergo.lri.fr TPTP release : v6.1.0 Tested on SPCs : TF1 TF0 FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 3.00GHz RAM size : 2005MB Operating system : Linux 2.6.32.26-175.fc12.i686.PAE Resource limits : 300s Command/settings : Source/bin/why3 -F tptp -P alt-ergo -t %d %s Results format : Solns Time Results summary : 20247 problems (20646 in v6.1.0, 399 Bugfixed or Removed) 3001 IAP-Non 13583 UNK-Non 1901 TMO-Non 1426 THM-Ass 336 UNS-Ass 17246 tested (85%) 1762 solutions 10% success, over those tested 9% success, overall Submitted by : Geoff Sutcliffe Inserted : Fri Jun 13 11:41:27 EDT 2014 Comments : ------------------------------------------------------------------------------- ATP system name : DCTP 1.31 People : Gernot Stenz, Reinhold Letz URL : TPTP release : v6.1.0 Tested on SPCs : CNF tptp2X flags : -f oldtptp -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : dctp-wrapper -negpref -complexity -fullrewrite -alternate -resisol %s Results format : Solns Time Linkings ClausesInTableau Results summary : 20247 problems (20646 in v6.1.0, 399 Bugfixed or Removed) 12383 IAP-Non 186 UNK-Non 175 GUP-Non 3932 TMO-Non 3057 UNS-Ass 514 SAT-Ass 7864 tested (39%) 3571 solutions 45% success, over those tested 18% success, overall Submitted by : Geoff Sutcliffe Inserted : Fri Jun 13 14:20:59 EDT 2014 Comments : ------------------------------------------------------------------------------- ATP system name : FIMO 0.3 People : Orkunt Sabuncu URL : http://potassco.sourceforge.net/ TPTP release : v6.1.0 Tested on SPCs : FOF_CSA FOF_SAT CNF_SAT FOF_UNK CNF_UNK tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2800MHz RAM size : 2005MB Operating system : Linux 2.6.32.26-175.fc12.i686.PAE Resource limits : 300s Command/settings : bin/fimo -nosplit -iclingo-opts "--heuristic=Vsids --iheuristic=keep" %s Results format : Solns Time Results summary : 20247 problems (20646 in v6.1.0, 399 Bugfixed or Removed) 17286 IAP-Non 10 UNK-Non 106 GUP-Non 1584 TMO-Non 502 CSA-FMo 758 SAT-FMo 1 SAT-Ass 2961 tested (15%) 1261 solutions 43% success, over those tested 6% success, overall Submitted by : Geoff Sutcliffe Inserted : Fri Jun 13 16:25:27 EDT 2014 Comments : ------------------------------------------------------------------------------- ATP system name : HolyHammer 0.0 People : Cezary Kaliszyk URL : TPTP release : v6.1.0 Tested on SPCs : TH0 tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2609 0 2.40GHz RAM size : 32286.75MB Operating system : Linux 2.6.32-431.11.2.el6.x86_64 Resource limits : 300s Command/settings : hh %d %s Results format : Solns Time Results summary : 20247 problems (20646 in v6.1.0, 399 Bugfixed or Removed) 17246 IAP-Non 966 UNK-Non 741 TMO-Non 1294 THM-Ass 3001 tested (15%) 1294 solutions 43% success, over those tested 6% success, overall Submitted by : Geoff Sutcliffe Inserted : Fri Jun 13 17:22:21 EDT 2014 Comments : ------------------------------------------------------------------------------- ATP system name : iProver-Eq 0.85 People : Christoph Sticksel, Konstantin Korovin URL : http://www.cs.man.ac.uk/~korovink/iprover/ TPTP release : v6.1.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 3.00GHz RAM size : 2005MB Operating system : Linux 2.6.32.26-175.fc12.i686.PAE Resource limits : 300s Command/settings : iprover-cvc4-eq-nc --time_out_virtual %d %s Results format : Solns Time ILoops RLoops SLoops PropCalls Results summary : 20247 problems (20646 in v6.1.0, 399 Bugfixed or Removed) 4699 IAP-Non 1148 UNK-Non 8524 TMO-Non 2228 THM-Ass 2694 UNS-Ass 398 CSA-Ass 556 SAT-Ass 15548 tested (77%) 5876 solutions 38% success, over those tested 29% success, overall Submitted by : Geoff Sutcliffe Inserted : Fri Jun 13 18:28:48 EDT 2014 Comments : ------------------------------------------------------------------------------- ATP system name : leanCoP-Omega 0.1 People : Jens Otten, Thomas Raths, Holger Troelenberg URL : http://www.leancop.de/ TPTP release : v6.1.0 Tested on SPCs : TF0_ARI tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : leancop_omega.sh %s %d Results format : Solns Time Results summary : 20247 problems (20646 in v6.1.0, 399 Bugfixed or Removed) 19212 IAP-Non 152 UNK-Non 343 GUP-Non 256 TMO-Non 284 THM-Prf 1035 tested (5%) 284 solutions 27% success, over those tested 1% success, overall Submitted by : Geoff Sutcliffe Inserted : Sun Jun 15 22:06:24 EDT 2014 Comments : ------------------------------------------------------------------------------- ATP system name : MetiTarski 1.9 People : Larry Paulson, Behzad Akbarpour URL : http://www.cl.cam.ac.uk/~lp15/papers/Arith/ TPTP release : v6.1.0 Tested on SPCs : TF0_ARI tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2800MHz RAM size : 2005MB Operating system : Linux 2.6.32.26-175.fc12.i686.PAE Resource limits : 300s Command/settings : run-metitarski %s Results format : Solns Time Results summary : 20247 problems (20646 in v6.1.0, 399 Bugfixed or Removed) 19212 IAP-Non 124 UNK-Non 342 GUP-Non 143 TMO-Non 426 THM-CRf 1035 tested (5%) 426 solutions 41% success, over those tested 2% success, overall Submitted by : Geoff Sutcliffe Inserted : Sun Jun 15 22:47:20 EDT 2014 Comments : ------------------------------------------------------------------------------- ATP system name : S-SETHEO 0.0 People : Reinhold Letz URL : http://www4.informatik.tu-muenchen.de/~letz/setheo/ TPTP release : v6.1.0 Tested on SPCs : CNF tptp2X flags : -f oldtptp -t add_equality CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : scheme-setheo -norel -foldup -sgindex -indexfoldup -reg -mate -dynsgreord 0 %s Results format : Solns Time ProofLength Inferences Results summary : 20247 problems (20646 in v6.1.0, 399 Bugfixed or Removed) 12383 IAP-Non 2131 UNK-Non 3973 TMO-Non 1760 UNS-Ass 7864 tested (39%) 1760 solutions 22% success, over those tested 9% success, overall Submitted by : Geoff Sutcliffe Inserted : Tue Jun 17 18:24:56 EDT 2014 Comments : ------------------------------------------------------------------------------- ATP system name : SETHEO 3.3 People : Reinhold Letz URL : http://www4.informatik.tu-muenchen.de/~letz/setheo/ TPTP release : v6.1.0 Tested on SPCs : CNF tptp2X flags : -f setheo -t add_equality CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : setheo-wrapper %s Results format : Solns Time Inferences Results summary : 20247 problems (20646 in v6.1.0, 399 Bugfixed or Removed) 12383 IAP-Non 5749 UNK-Non 395 GUP-Non 620 TMO-Non 1100 UNS-Ass 7864 tested (39%) 1100 solutions 14% success, over those tested 5% success, overall Submitted by : Geoff Sutcliffe Inserted : Tue Jun 17 18:30:40 EDT 2014 Comments : Flags: inwasm -cons -foldup, sam -dr -cons ------------------------------------------------------------------------------- ATP system name : SRASS 0.1 People : Geoff Sutcliffe URL : http://www.cs.miami.edu/~tptp/ATPSystems/SRASS/ TPTP release : v6.1.0 Tested on SPCs : FOF tptp2X flags : -f tptp -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : SRASS -q2 -a 0 10 10 10 -i3 -n60 %s Results format : Solns Time Selected Unselected Results summary : 20247 problems (20646 in v6.1.0, 399 Bugfixed or Removed) 12563 IAP-Non 1592 UNK-Non 2437 TMO-Non 3627 THM-Sol 28 THM-Ass 7684 tested (38%) 3655 solutions 48% success, over those tested 18% success, overall Submitted by : Geoff Sutcliffe Inserted : Tue Jun 17 19:46:13 EDT 2014 Comments : ------------------------------------------------------------------------------- ATP system name : TPS 3.120601S1b People : Peter Andrews, Chad Brown URL : http://gtps.math.cmu.edu/tps.html TPTP release : v6.1.0 Tested on SPCs : TH0 tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz RAM size : 2005MB Operating system : Linux 2.6.32.26-175.fc12.i686.PAE Resource limits : 300s Command/settings : run-tps-S1b %s %d Results format : Solns Time Mode Results summary : 20247 problems (20646 in v6.1.0, 399 Bugfixed or Removed) 17246 IAP-Non 1499 UNK-Non 37 TMO-Non 1457 THM-Ass 8 UNS-Ass 3001 tested (15%) 1465 solutions 49% success, over those tested 7% success, overall Submitted by : Geoff Sutcliffe Inserted : Tue Jun 17 20:11:56 EDT 2014 Comments : ------------------------------------------------------------------------------- ATP system name : VanHElsing 1.0 People : Daniel Kuehlwein (Sil van de Leemput, Frank Dorssers, Wouter Geraedts) URL : TPTP release : v6.2.0 Tested on SPCs : FOF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2609 0 2.40GHz RAM size : 32286.75MB Operating system : Linux 2.6.32-504.16.2.el6.x86_64 Resource limits : 300s Command/settings : Results format : Solns Time Results summary : 20337 problems (20654 in v6.2.0, 317 Bugfixed or Removed) 12650 IAP-Non 2818 TMO-Non 4738 THM-Ref 131 UNS-Ref 7687 tested (38%) 4869 solutions 63% success, over those tested 24% success, overall Submitted by : Geoff Sutcliffe Inserted : Wed May 20 17:18:32 EDT 2015 Comments : ------------------------------------------------------------------------------- ATP system name : PEPR 0.0ps People : Tianyi Liang URL : http://homepage.cs.uiowa.edu/~tiliang/pepr/ TPTP release : v6.1.0 Tested on SPCs : CNF_EPR tptp2X flags : -f tptp:short -t none CPU : Intel(R) Xeon(R) CPU E5-2609 0 2.40GHz RAM size : 32286.75MB Operating system : Linux 2.6.32-431.1.2.el6.x86_64 Resource limits : 300s Command/settings : pepr_00_32 %s Results format : Solns Time Results summary : 20247 problems (20646 in v6.1.0, 399 Bugfixed or Removed) 19349 IAP-Non 232 UNK-Non 248 TMO-Non 242 UNS-Ass 176 SAT-Ass 898 tested (4%) 418 solutions 47% success, over those tested 2% success, overall Submitted by : Geoff Sutcliffe Inserted : Tue Jun 17 17:37:58 EDT 2014 Comments : ------------------------------------------------------------------------------- ATP system name : Refute 2015 People : Tjark Weber, Jasmin Blanchette URL : http://www.cl.cam.ac.uk/research/hvg/Isabelle/ TPTP release : v6.4.0 Tested on SPCs : TH0_CSA_NAR TH0_SAT_NAR TH0_UNK_NAR TF0_CSA TF0_SAT TF0_UNK_NAR FOF_CSA FOF_SAT FOF_UNK CNF_SAT CNF_UNK tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2609 0 2.40GHz RAM size : 32218.75MB Operating system : Linux 3.10.0-327.10.1.el7.x86_64 Resource limits : 300s Command/settings : Source/bin/isabelle tptp_refute %d %s Results format : Solns Time SolvedBy Results summary : 20615 problems (20896 in v6.4.0, 281 Bugfixed or Removed) 2060 IAP-Non 307 UNK-Non 394 GUP-Non 17391 TMO-Non 463 CSA-Ass 18555 tested (90%) 463 solutions 2% success, over those tested 2% success, overall Submitted by : Geoff Sutcliffe Inserted : Fri May 6 17:21:02 EDT 2016 Comments : ------------------------------------------------------------------------------- ATP system name : VampireZ3 1.0 People : Andrei Voronkov, Giles Reger, Martin Suda, Nikolaj Bjorner URL : http://www.vprover.org/ TPTP release : v6.4.0 Tested on SPCs : TF0 FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2609 0 2.40GHz RAM size : 32218.75MB Operating system : Linux 3.10.0-327.10.1.el7.x86_64 Resource limits : 300s Command/settings : vampireZ3 --mode casc -m 20000 -t %d %s Results format : Solns Time Results summary : 20615 problems (20896 in v6.4.0, 281 Bugfixed or Removed) 3618 IAP-Non 241 UNK-Non 5097 GUP-Non 40 TMO-Non 5670 THM-Ref 4 THM-Ass 4711 UNS-Ref 1 UNS-Ass 6 CSA-FMo 12 CSA-Ass 445 CSA-Sat 9 SAT-FMo 39 SAT-Ass 722 SAT-Sat 16997 tested (82%) 11619 solutions 68% success, over those tested 56% success, overall Submitted by : Geoff Sutcliffe Inserted : Fri May 6 17:23:07 EDT 2016 Comments : ------------------------------------------------------------------------------- ATP system name : CiME 2.01 People : Benjamin Monate, Evelyn Contejean URL : http://cime.lri.fr/ TPTP release : v7.3.0 Tested on SPCs : CNF_UEQ tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2609 0 2.40GHz RAM size : 32286.75MB Operating system : Linux 2.6.32-431.11.2.el6.x86_64 Resource limits : 300s Command/settings : tptp2X_and_run_cime %s Results format : Solns Time Results summary : 22680 problems (22686 in v7.3.0, 6 Bugfixed or Removed) 21447 IAP-Non 12 UNK-Non 654 TMO-Non 526 UNS-Ref 41 SAT-Ass 1233 tested (5%) 567 solutions 46% success, over those tested 2% success, overall Submitted by : Geoff Sutcliffe Inserted : Wed Mar 6 09:46:10 EST 2019 Comments : ------------------------------------------------------------------------------- ATP system name : cocATP 0.2.0 People : Cristobal Camarero Coterillo URL : https://personales.unican.es/camareroc/cocATP/SystemDescription_cocATP.html TPTP release : v7.3.0 Tested on SPCs : TH0 tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2609 0 2.40GHz RAM size : 32286.75MB Operating system : Linux 2.6.32-431.20.3.el6.x86_64 Resource limits : 300s Command/settings : bin/CASC.py %s Results format : Solns Time Results summary : 22680 problems (22686 in v7.3.0, 6 Bugfixed or Removed) 19494 IAP-Non 620 UNK-Non 1844 TMO-Non 722 THM-Prf 3186 tested (14%) 722 solutions 23% success, over those tested 3% success, overall Submitted by : Geoff Sutcliffe Inserted : Wed Mar 6 09:46:50 EST 2019 Comments : ------------------------------------------------------------------------------- ATP system name : Isabelle 2016 People : Jasmin Blanchette, Larry Paulson, Tobias Nipkow, Makarius Wenzel URL : http://www.cl.cam.ac.uk/research/hvg/Isabelle/ TPTP release : v7.3.0 Tested on SPCs : TH1_NAR TH0_NAR TF0_NAR FOF CNF tptp2X flags : -f tptp -t none CPU : Intel(R) Xeon(R) CPU E5-2609 0 2.40GHz RAM size : 32218.75MB Operating system : Linux 3.10.0-327.36.3.el7.x86_64 Resource limits : 300s Command/settings : Source/bin/isabelle tptp_isabelle %d %s Results format : Solns Time SolvedBy Results summary : 22680 problems (22686 in v7.3.0, 6 Bugfixed or Removed) 2133 IAP-Non 463 UNK-Non 8948 TMO-Non 6684 THM-Ass 4452 UNS-Ass 20547 tested (91%) 11136 solutions 54% success, over those tested 49% success, overall Submitted by : Geoff Sutcliffe Inserted : Thu Mar 7 12:49:43 EST 2019 Comments : ------------------------------------------------------------------------------- ATP system name : Isabelle-HOT 2016 People : Jasmin Blanchette, Larry Paulson, Tobias Nipkow, Makarius Wenzel URL : http://www.cl.cam.ac.uk/research/hvg/Isabelle/ TPTP release : v7.3.0 Tested on SPCs : TH1_NAR TH0_NAR TF0_NAR FOF CNF tptp2X flags : -f tptp -t none CPU : Intel(R) Xeon(R) CPU E5-2609 0 2.40GHz RAM size : 32218.75MB Operating system : Linux 3.10.0-327.36.3.el7.x86_64 Resource limits : 300s Command/settings : Source/bin/isabelle tptp_isabelle_hot %d %s Results format : Solns Time SolvedBy Results summary : 22680 problems (22686 in v7.3.0, 6 Bugfixed or Removed) 2133 IAP-Non 7614 UNK-Non 1872 TMO-Non 6639 THM-Ass 4422 UNS-Ass 20547 tested (91%) 11061 solutions 54% success, over those tested 49% success, overall Submitted by : Geoff Sutcliffe Inserted : Thu Mar 7 12:54:36 EST 2019 Comments : ------------------------------------------------------------------------------- ATP system name : Nitpick 2016 People : Jasmin Blanchette, Larry Paulson, Tobias Nipkow, Makarius Wenzel URL : http://www.cl.cam.ac.uk/research/hvg/Isabelle/ TPTP release : v7.3.0 Tested on SPCs : TH0_CSA_NAR TH0_SAT_NAR TH0_UNK_NAR TF0_CSA_NAR TF0_SAT_NAR TF0_UNK_NAR FOF_CSA FOF_SAT FOF_UNK CNF_SAT CNF_UNK tptp2X flags : -f tptp -t none CPU : Intel(R) Xeon(R) CPU E5-2609 0 2.40GHz RAM size : 32218.75MB Operating system : Linux 3.10.0-327.36.3.el7.x86_64 Resource limits : 300s Command/settings : Source/bin/isabelle tptp_nitpick %d %s Results format : Solns Time SolvedBy Results summary : 22680 problems (22686 in v7.3.0, 6 Bugfixed or Removed) 18622 IAP-Non 168 UNK-Non 2080 TMO-Non 930 CSA-FMo 880 SAT-FMo 4058 tested (18%) 1810 solutions 45% success, over those tested 8% success, overall Submitted by : Geoff Sutcliffe Inserted : Thu Mar 7 14:53:53 EST 2019 Comments : ------------------------------------------------------------------------------- ATP system name : Mace4 1109a People : William McCune URL : http://www.cs.unm.edu/~mccune/prover9/ TPTP release : v7.3.0 Tested on SPCs : FOF_CSA FOF_SAT CNF_SAT FOF_UNK CNF_UNK tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2609 0 2.40GHz RAM size : 32218.75MB Operating system : Linux 3.10.0-327.36.3.el7.x86_64 Resource limits : 300s Command/settings : tptp2X_and_run_mace4 %d %s Results format : Solns Time Size Results summary : 22680 problems (22686 in v7.3.0, 6 Bugfixed or Removed) 19149 IAP-Non 478 UNK-Non 1996 TMO-Non 325 CSA-FMo 732 SAT-FMo 3531 tested (16%) 1057 solutions 30% success, over those tested 5% success, overall Submitted by : Geoff Sutcliffe Inserted : Thu Mar 7 13:39:29 EST 2019 Comments : ------------------------------------------------------------------------------- ATP system name : Muscadet 4.5 People : Dominique Pastre URL : http://www.math-info.univ-paris5.fr/~pastre/muscadet/muscadet.html TPTP release : v8.0.0 Tested on SPCs : FOF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2609 0 2.40GHz RAM size : 32286.75MB Operating system : Linux 2.6.32-573.1.1.el6.x86_64 Resource limits : 300s Command/settings : muscadet %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Fri Apr 22 10:10:41 EDT 2022 Comments : ------------------------------------------------------------------------------- ATP system name : SInE 0.4 People : Krystof Hoder URL : http://www.cs.man.ac.uk/~hoderk/sine/ TPTP release : v7.3.0 Tested on SPCs : FOF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Pentium(R) 4 CPU 2.80GHz @ 2793MHz RAM size : 2018MB Operating system : Linux 2.6.26.8-57.fc8 Resource limits : 300s Command/settings : Source/sine.py -e eprover -t %d %s Results format : Solns Time Results summary : 22680 problems (22686 in v7.3.0, 6 Bugfixed or Removed) 14055 IAP-Non 942 UNK-Non 3875 TMO-Non 3608 THM-CRf 86 THM-Ass 111 UNS-CRf 3 UNS-Ass 8625 tested (38%) 3808 solutions 44% success, over those tested 17% success, overall Submitted by : Geoff Sutcliffe Inserted : Thu Mar 7 15:23:39 EST 2019 Comments : ------------------------------------------------------------------------------- ATP system name : Satallax-MaLeS 1.3 People : Daniel Kuehlwein (Sil van de Leemput, Frank Dorssers, Wouter Geraedts) URL : TPTP release : v7.3.0 Tested on SPCs : TH0 tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2609 0 2.40GHz RAM size : 32286.75MB Operating system : Linux 2.6.32-573.1.1.el6.x86_64 Resource limits : 300s Command/settings : Results format : Solns Time Results summary : 22680 problems (22686 in v7.3.0, 6 Bugfixed or Removed) 19494 IAP-Non 59 UNK-Non 1096 TMO-Non 2031 THM-Ass 3186 tested (14%) 2031 solutions 64% success, over those tested 9% success, overall Submitted by : Geoff Sutcliffe Inserted : Thu Mar 7 15:22:30 EST 2019 Comments : ------------------------------------------------------------------------------- ATP system name : agsyHOL 1.0 People : Fredrik Lindblad URL : https://github.com/frelindb/agsyHOL TPTP release : v9.0.0 Tested on SPCs : TH0 tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : agsyHOL --proof --time-out %d --include-dir /exp/home/tptp/TPTP/ %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 09:54:59 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Beagle 0.9.51 People : Peter Baumgartner (Joshua Bax, Andreas Bauer, Tim Cosgrove) URL : http://users.cecs.anu.edu.au/~baumgart/systems/beagle/ TPTP release : v9.0.0 Tested on SPCs : TF0 FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_beagle %d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 09:56:24 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Bliksem 1.12 People : Hans de Nivelle URL : TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_bliksem %s Results format : Solns Time Generated Kept Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 10:01:43 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : ConnectPP 0.3.0 People : Sean Holden URL : https://www.cl.cam.ac.uk/~sbh11/connect++.html TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : connect++ --verbosity 0 --no-colour --tptp-proof --schedule default %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 10:13:51 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Crossbow 0.1 People : Radek Micek URL : https://github.com/radekm/crossbow TPTP release : v9.0.0 Tested on SPCs : FOF_CSA FOF_SAT FOF_UNK tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : do_Crossbow---0.1 %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 10:18:37 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : CSE 1.6 People : Shuwei Chen URL : TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_CSE %d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 10:20:12 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : CSE_E 1.5 People : Shuwei Chen URL : TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_CSE %d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 10:25:36 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : cvc5-SAT 1.0.5 People : Clark Barrett, Cesare Tinelli URL : https://cvc5.github.io/ TPTP release : v9.0.0 Tested on SPCs : TH0_NAR TF0 FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : do_cvc5 %s %d SAT Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Thu May 30 03:55:20 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Darwin 1.4.5 People : Alexander Fuchs, Peter Baumgartner, Cesare Tinelli URL : TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : darwin -pl 0 -pmc true -to %d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 10:49:53 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : DarwinFM 1.4.5 People : Alexander Fuchs, Peter Baumgartner, Cesare Tinelli URL : TPTP release : v9.0.0 Tested on SPCs : FOF_CSA FOF_SAT CNF_SAT FOF_UNK CNF_UNK tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : darwin -fd true -ppp true -pl 0 -to %d -pmtptp true %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 10:54:54 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Drodi 3.6.0 People : Oscar Contreras URL : TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_drodi %d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 10:59:49 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : E 3.1.00 People : Stephan Schulz URL : http://www.eprover.org/ TPTP release : v9.0.0 Tested on SPCs : TH0_NAR TX0_NAR TF0_NAR FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_E %s %d THM Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 22 14:17:53 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : E-SAT 3.1.00 People : Stephan Schulz URL : http://www.eprover.org/ TPTP release : v9.0.0 Tested on SPCs : TF0_NAR FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_E %s %d SAT Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 22 14:24:55 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Enigma 0.5.1 People : Jan Jakubuv URL : https://github.com/ai4reason/enigmatic TPTP release : v9.0.0 Tested on SPCs : FOF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : enigmatic-eprover.py %s %d 8 Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 11:18:03 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : ePrincess 1.0 People : Peter Backeman URL : http://user.it.uu.se/~petba168/breu/ TPTP release : v9.0.0 Tested on SPCs : FOF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : ePrincess-casc -inputFormat=tptp -timeout=%d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 11:21:16 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Equinox 6.0.1a People : Koen Claessen URL : TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:short -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : equinox --modelfile /tmp/model --no-progress --time %d --tstp %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 11:25:40 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : EQP 0.9e People : William McCune URL : http://www.cs.unm.edu/~mccune/eqp/ TPTP release : v9.0.0 Tested on SPCs : CNF_UEQ tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : tptp2X_and_run_eqp %s Results format : Solns Time Clauses Given Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 11:24:36 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : ET 2.0 People : Josef Urban (Cezary Kaliszyk, Stephan Schulz, Jiri Vyskocil) URL : TPTP release : v9.0.0 Tested on SPCs : TF0_NAR FOF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : bin/run_ET %s %d Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 12:29:00 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Etableau 0.67 People : John Hester URL : https://github.com/hesterj/Etableau TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : etableau --auto --tsmdo --quicksat=10000 --tableau=1 --tableau-saturation=1 -s -p --tableau-cores=8 --cpu-limit=%d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 12:31:53 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Fampire 1.3 People : Josef Urban URL : http://dreamers.com/lichlair/imagenes/bloodredmoon3.jpg TPTP release : v9.0.0 Tested on SPCs : FOF tptp2X flags : -f tptp -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : FlotterOnTPTP.pl -f oldtptp -s vampire -t %d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 12:37:22 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Fiesta 2 People : Robert Nieuwenhuis URL : TPTP release : v9.0.0 Tested on SPCs : CNF_UEQ tptp2X flags : -f dedam -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : fiesta-wrapper %s Results format : Solns Time Memory Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 12:40:17 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Geo-III 2018C People : Hans de Nivelle URL : TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : geo -tptp_input -nonempty -include /exp/home/tptp/TPTP -inputfile %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 12:41:10 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : GKC 0.8 People : Tanel Tammet URL : https://github.com/tammet/gkc TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : gkc %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 12:46:24 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Goeland 1.0.0 People : Julie Cailler URL : https://github.com/GoelandProver/Goeland TPTP release : v9.0.0 Tested on SPCs : FOF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : goeland -presko -dmt -proof %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 12:52:57 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : GrAnDe 1.1 People : Stephan Schulz, Geoff Sutcliffe URL : https://tptp.org/ATPSystems/GrAnDe/ TPTP release : v9.0.0 Tested on SPCs : FOF_EPR CNF_EPR CNF_PRP tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : And %s %d Results format : Solns Time EStatus Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 12:55:53 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : HOLyHammer 0.21 People : Cezary Kaliszyk URL : TPTP release : v9.0.0 Tested on SPCs : TH1_NAR TH0_NAR tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_hh %d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 12:56:44 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Infinox 1.0 People : Koen Claessen URL : TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_infinox %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 12:58:31 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : iProver 3.9 People : Konstantin Korovin URL : http://www.cs.man.ac.uk/~korovink/iprover/ TPTP release : v9.0.0 Tested on SPCs : TF0 FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_iprover %s %d THM Results format : Solns Time ILoops RLoops PropCalls Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 13:03:29 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : iProverMo 2.5-0.1 People : Guillaume Burel URL : http://www.ensiie.fr/~guillaume.burel/blackandwhite_iProverModulo.html.en TPTP release : v9.0.0 Tested on SPCs : TF0_NAR FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : bin/run_iProverMo %s %d Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 13:16:25 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : KSP 0.1.6 People : Claudia Nalon URL : https://nalon.org/#software TPTP release : v9.0.0 Tested on SPCs : NX0_PRP TF0_PRP tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_ksp %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 13:25:47 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Lash 1.13 People : Cezary Kaliszyk, Chad Brown, Jan Jakubuv URL : TPTP release : v9.0.0 Tested on SPCs : TH0_NAR tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_lash %d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 13:26:16 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : lazyCoP 0.1 People : Michael Rawson URL : https://github.com/MichaelRawson/lazycop TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_lazyCoP %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 13:28:11 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : leanCoP 2.2 People : Jens Otten URL : http://www.leancop.de/ TPTP release : v9.0.0 Tested on SPCs : FOF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : leancop.sh %s %d Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 13:32:15 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : LEO-II 1.7.0 People : Christoph Benzmueller, Frank Theiss URL : http://www.leoprover.org TPTP release : v9.0.0 Tested on SPCs : TH0_NAR FOF CNF tptp2X flags : -f tptp -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : leo --timeout %d --proofoutput 1 --foatp e --atp e=/exp/home/tptp/Systems/LEO-II---1.7.0/eprover %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 13:35:23 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Leo-III 1.7.12 People : Christoph Benzmueller, Alexander Steen URL : http://page.mi.fu-berlin.de/lex/leo3/ TPTP release : v9.0.0 Tested on SPCs : NH1 NH0 NX1 NX0 TH1 TH0 TX1 TX0 TF1 TF0 FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_Leo-III %s %d THM Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Thu May 23 18:19:06 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Leo-III-SAT 1.7.12 People : Christoph Benzmueller, Alexander Steen URL : http://page.mi.fu-berlin.de/lex/leo3/ TPTP release : v9.0.0 Tested on SPCs : NH1 NH0 NX1 NX0 TH1 TH0 TX1 TX0 TF1 TF0 FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_Leo-III %s %d SAT Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Thu May 23 18:26:21 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : MaedMax 1.4 People : Sarah Winkler URL : http://cl-informatik.uibk.ac.at/software/maedmax/ TPTP release : v9.0.0 Tested on SPCs : CNF_UEQ tptp2X flags : -f tptp -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_maedmax %d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 13:52:25 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Matita 1.0 People : Andrea Asperti URL : http://matita.cs.unibo.it/ TPTP release : v9.0.0 Tested on SPCs : CNF_UEQ tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : matitaprover --timeout %d --tptppath /exp/home/tptp/TPTP %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 13:53:14 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Metis 2.4 People : Joe Hurd URL : http://www.gilith.com/software/metis TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : metis --show proof --show saturation %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 13:54:05 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : MleanCoP 1.3 People : Jens Otten URL : http://leancop.de/mleancop TPTP release : v9.0.0 Tested on SPCs : NX0 TF0 tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_mleancop %s %d Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 13:59:26 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Moca 0.1 People : Nao Hirokawa URL : http://www.jaist.ac.jp/project/maxcomp/ TPTP release : v9.0.0 Tested on SPCs : CNF_HRN CNF_UEQ tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : moca.sh %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 13:59:55 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : nanoCoP 2.0 People : Jens Otten URL : http://www.leancop.de/ TPTP release : v9.0.0 Tested on SPCs : FOF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : nanocop.sh %s %d Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 14:01:00 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : nanoCoP-M 2.0 People : Jens Otten URL : http://leancop.de/nanocop-m/ TPTP release : v9.0.0 Tested on SPCs : NX0 TF0 tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_nanocopm %s %d Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 14:04:46 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Otter 3.3 People : William McCune URL : http://www.cs.unm.edu/~mccune/otter/ TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : otter-tptp-script %s Results format : Solns Time Given Generated Kept Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 14:05:15 EDT 2024 Comments : Flags: set(prolog_style_variables) set(auto) set(tptp_eq) ------------------------------------------------------------------------------- ATP system name : Paradox 4.0 People : Koen Claessen URL : TPTP release : v9.0.0 Tested on SPCs : FOF_CSA FOF_SAT CNF_SAT FOF_UNK CNF_UNK tptp2X flags : -f tptp:short -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : paradox --no-progress --time %d --tstp --model %s Results format : Solns Time Size Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 14:15:16 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Princess 230619 People : Philipp Ruemmer URL : http://www.philipp.ruemmer.org/princess.shtml TPTP release : v9.0.0 Tested on SPCs : TF0 FOF tptp2X flags : -f tptp -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : princess -inputFormat=tptp +threads -portfolio=casc +printProof -timeoutSec=%d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Tue May 14 14:24:37 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Prover9 1109a People : William McCune URL : http://www.cs.unm.edu/~mccune/prover9/ TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : tptp2X_and_run_prover9 %d %s Results format : Solns Time Given Generated Kept Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 08:09:59 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : PyRes 1.5 People : Stephan Schulz URL : TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : pyres-fof.py -tifbsVp -nlargest -HPickGiven5 %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 08:17:40 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : RPx 1.0 People : Anders Schlichtkrull URL : https://bitbucket.org/isafol/isafol/src/master/Functional_Ordered_Resolution_Prover/ TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_RPx %s Results format : Solns Time Given Generated Kept Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 08:21:13 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Satallax 3.5 People : Michael Faerber, Chad Brown URL : http://cl-informatik.uibk.ac.at/users/mfaerber/satallax.html TPTP release : v9.0.0 Tested on SPCs : TH0_NAR tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_satallax %d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 08:25:17 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : SATCoP 0.1 People : Michael Rawson URL : http://www.cs.uiowa.edu/~hzhang/sato/ TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : satcop --statistics %s Results format : Solns Time Extensions Reductions Attempts Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 08:26:50 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : SnakeForV 1.0 People : Martin Suda URL : https://github.com/vprover/vampire/releases/tag/snakeForV4.7%2B TPTP release : v9.0.0 Tested on SPCs : TF0 FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : vampire --input_syntax tptp --proof tptp --output_axiom_names on --mode portfolio --schedule snake_tptp_uns --cores 0 -t %d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 08:31:33 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : SnakeForV-SAT 1.0 People : Martin Suda URL : https://github.com/vprover/vampire/releases/tag/snakeForV4.7%2B TPTP release : v9.0.0 Tested on SPCs : TF0 FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : vampire --input_syntax tptp --proof tptp --output_axiom_names on --mode portfolio --schedule snake_tptp_sat --cores 0 -t %d %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 08:37:58 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : SNARK 20120808r022 People : Mark Stickel URL : http://www.ai.sri.com/~stickel/snark.html TPTP release : v9.0.0 Tested on SPCs : TF0 FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run-snark %s %d Results format : Solns Time Derived Kept Answers Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 08:43:47 EDT 2024 Comments : Settings/flags: (agenda-length-limit nil) (agenda-length-before-simplification-limit nil) (use-hyperresolution t) (use-paramodulation t) (use-factoring :pos) (use-literal-ordering-with-hyperresolution 'literal-ordering-p) (use-literal-ordering-with-paramodulation 'literal-ordering-p) (ordering-functions>constants t) (assert-context :current) (use-closure-when-satisfiable t) (use-variable-name-sorts nil) : The strategy is incomplete, so no solution does not indicate satisfiability. If the propositional abstraction of a problem is satisfiable, existence of a model is reported : Commutative unification is used for commutative function and predicate symbols. Associative-commutative unification is used for associative-commutative function symbols Commutativity and associativity axioms in the problems are detected automatically ------------------------------------------------------------------------------- ATP system name : SPASS 3.9 People : Christoph Weidenbach URL : TPTP release : v9.0.0 Tested on SPCs : FOF CNF tptp2X flags : -f tptp -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_spass %d %s Results format : Solns Time Memory Derived Kept Used Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 08:50:51 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : SPASS+T 2.2.22 People : Uwe Waldmann, Stephan Zimmer URL : TPTP release : v9.0.0 Tested on SPCs : TF0 tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : spasst-tptp-script %s %d Results format : Solns Time Memory Derived Kept Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 08:49:56 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : SuperZenon 0.0.1 People : David Delahaye, Melanie Jacquel URL : http://cedric.cnam.fr/~delahaye/super-zenon/ TPTP release : v9.0.0 Tested on SPCs : FOF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_super_zenon -p0 -itptp -om -max-time %d %s Results format : Solns Time NodesSearch MaxBranchF ProofNodes Formulas Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 08:58:43 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Toma 0.4 People : Teppei Saito URL : https://www.jaist.ac.jp/project/maxcomp/ TPTP release : v9.0.0 Tested on SPCs : CNF_UEQ tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : toma --casc %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 09:01:44 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Twee 2.4.2 People : Nick Smallbone URL : http://nick8325.github.io/twee/ TPTP release : v9.0.0 Tested on SPCs : TF0_NAR FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : parallel-twee %s --tstp --conditional-encoding if --smaller --drop-non-horn --give-up-on-saturation --explain-encoding --formal-proof Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 09:02:32 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Vampire 4.8 People : Andrei Voronkov, Giles Reger, Martin Suda URL : https://vprover.github.io/ TPTP release : v9.0.0 Tested on SPCs : TH1_NAR TH0_NAR TX1_NAR TX0 TF1_NAR TF0 FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_vampire %s %d THM Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 22 15:04:07 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Vampire-SAT 4.8 People : Andrei Voronkov, Giles Reger, Martin Suda URL : https://vprover.github.io/ TPTP release : v9.0.0 Tested on SPCs : TX0 TF0 FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_vampire %s %d SAT Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 22 15:12:14 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Waldmeister 710 People : Thomas Hillenbrand, Bernd Loechner (WEC) URL : TPTP release : v9.0.0 Tested on SPCs : CNF_UEQ tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : woody %s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 09:23:04 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Z3 4.8.9.0 People : Leonardo de Moura, Nikolaj Bjorner URL : https://github.com/Z3Prover/z3 TPTP release : v9.0.0 Tested on SPCs : TF0 FOF CNF tptp2X flags : -f tptp -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_z3_tptp -proof -model -t:%d -file:%s Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 09:23:53 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Zenon 0.7.1 People : Damien Doligez URL : TPTP release : v9.0.0 Tested on SPCs : FOF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_zenon %s %d Results format : Solns Time NodesSearch MaxBranchF ProofNodes Formulas Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 11:31:26 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : ZenonModulo 0.4.2 People : Guillaume Burel URL : https://deducteam.gitlabpages.inria.fr/zenonmodulo/ TPTP release : v9.0.0 Tested on SPCs : TF1 TF0 FOF CNF tptp2X flags : -f tptp:raw -t none CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : run_zenon_modulo %d %s Results format : Solns Time NodesSearch MaxBranchF ProofNodes Formulas Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 11:37:39 EDT 2024 Comments : ------------------------------------------------------------------------------- ATP system name : Zipperpin 2.1.9999 People : NO INFORMATION URL : https://github.com/c-cube/zipperposition TPTP release : v9.0.0 Tested on SPCs : NO INFORMATION tptp2X flags : -f NO INFORMATION -t NO INFORMATION CPU : Intel(R) Xeon(R) CPU E5-2620 v4 2.10GHz RAM size : 8042.1875MB Operating system : Linux 3.10.0-693.el7.x86_64 Resource limits : 300s Command/settings : NO INFORMATION Results format : Solns Time Results summary : Submitted by : Geoff Sutcliffe Inserted : Wed May 15 11:44:23 EDT 2024 Comments : -------------------------------------------------------------------------------