Stefan Pohl Computer Chess

Home of famous UHO openings and EAS Ratinglist


SPCC Super 3 Tournament

 

 

Tournament updates are suspended at the moment, because I want my new project Cerberus participating here. Because the Cerberus project is still in development and alpha-testing, updates of the Super 3 Tournament are not possible at the moment. Stay tuned for more information to come in early 2025...

 

 

Latest update: 2024/11/25 (next updates will follow every 10-12 days...)

Tournament overall runtime (average: 47.2 games per day are played): 193 days

Download all played games since start (May 2024) here

 

An endless RoundRobin-tournament with 3 engines, which are at the same level of strength (around 3400 Elo) but are completely different in their inner structure and their way of thinking.

Why? The strongest engine since more a decade (Stockfish) is open source, so many, many other engines are (at least) "inspired" by Stockfish... And additionally, a lot of engines (including Stockfish!) are using Lc0-training-data for building their neural nets: The high-end computerchess has become very incestuous... To say this clear here: This is not good or bad, it is just the reality of high-end computerchess in these days.

So, IMHO, it is very interesting to run a tournament with engines, which are completely different, not only in their playing-style, but also in their inner structure and way of thinking, but on a close level of playing-strength.

The Super 3 tournament is not about the results (as you can see below, all 3 engines are at the same level of strength), but about generating interesting enginegames.

             | Search    | Evaluation   | nodes per second (early middlegame)
-------------|-----------|--------------|-------------------------------------
Lc0 CPU      | MCTS      | float-neural |      1.100
-------------|-----------|--------------|-------------------------------------
Revenge 1.0  | AlphaBeta | int-neural   | 11.000.000 (10.000x faster than Lc0)
-------------|-----------|--------------|-------------------------------------
Komodo 14.1  | AlphaBeta | Handcrafted  | 19.000.000 (17.300x faster than Lc0)
-------------|-----------|--------------|-------------------------------------

As you can see, these 3 engines have nothing in common, considering their way of thinking. Komodo 14.1 uses a classical handcrafted evaluation, Lc0 CPU uses a (float) neural net, and Revenge 1 uses a (integer) nnue-net, like most modern engines in these days. Because floating-point calculations are brutally slow on CPUs, Lc0 CPU is way slower than the 2 opponents... (this is the reason, why Lc0 normally runs on the GPU, not the CPU). If you want to learn more about the neural-net of Lc0 and about nnue-nets, I recommend this e-book by Dominik Klein, which can be downloaded for free as a PDF-file.

And, additionally, Lc0 uses a complete different search (MCTS). And Revenge 1 is one of the most aggressive playing engines of all time (see the EAS-Ratinglist below).

 

HardwareAMD Ryzen 7840HS 8-core (16 threads) notebook with 32GB RAM. Turboboost off.

Speed: See above. Each engine uses 14 threads, when thinking (Lc0 cpu dnll has the UCI option "Threads" like any normal CPU-engine, so it uses the CPU like all other engines) - the GPU stays (of course) unused.

Hash: 8 GB per engine (20.000.000 NNCachesize for Lc0 - enough for storing all evaluated positions of a complete game)

GUI: CutechessGUI (GUI ends game, when a 6-piece endgame is on the board, all other games are played until mate or draw by chess-rules (3fold, 50-moves, stalemate))

Tablebases: None for engines, 6 Syzygy for CutechessGUI

Openings: My UHO_2024_8mvs_+085_+094.pgn openings are used (randomly mixed, each opening repeated with reversed colors, of course (=Gamepairs))

Ponder, Large Memory Pages & learning: Off

Thinking time: 10min+5sec per game/engine (average game-duration: 30 minutes), so only 50 games are played in 24 hours = high quality enginechess

 

Here you can see the shortest wins with sacrifices, played between the latest two site-updates, filtered by my Interesting Wins Search Tool. Download this cool tool in the "Downloads & Links" section or right here

Many thanks to ChessBase for the pgn-replayer tool, which is very easy to use (only 3 lines of code!) and very powerful - use the fan (propeller?)-icon right near the arrows below the chessboard, to start and stop the online-analyzing with the Fritz-engine! Perhaps you have to clear your browser-cache to see the latest games - otherwise the pgn-replayer does not update the games correctly...if you can not see the chessboard, check, that your browser has Javascript activated or if an AdBlocker is the problem.

 

 

 

 

Below the results (first normal Celos (by ORDO), followed by gamepair-rescored Celos, followed by EAS-Ratinglist).

 

     Program                Celo    +    - Games    Score   Av.Op. Draws

   1 Lc0 791921 CPU       : 3450    6    6  5738    51.7%   3438   49.0%
   2 Rebel Extreme 1.0    : 3449   11   11   978    51.1%   3442   48.9%
   3 Komodo 14.1 HCE      : 3441    6    6  5738    49.9%   3442   49.4%
   4 Revenge 1.0 avx2     : 3433    6    6  5738    48.2%   3446   48.6%

 

Games        : 9096 (finished)

White Wins   : 4376 (48.1 %)
Black Wins   : 263   (2.9 %)
Draws        : 4457 (49.0 %)


Gamepairs:

   # PLAYER               :    Celo  Error   Pairs    W     D    L   (%)  CFS(%)
   1 Rebel Extreme 1.0    :    3450     22     489  135   241  113  52.2      51
   2 Lc0 791921 CPU       :    3450   ----    2869  802  1443  624  53.1     100
   3 Komodo 14.1 HCE      :    3431     11    2869  712  1397  760  49.2      95
   4 Revenge 1.0 avx2     :    3423     11    2869  649  1419  801  47.4     ---

 

------------------------------------------------------------------- 
--- Number of all Gamepairs          : 4548 
--- Number of drawn Gamepairs overall: 2250 (= 49.47%) 
--- Number of 1:1 drawn Gamepairs    : 1109 (= 24.38%) 
--- Number of 2-draws drawn Gamepairs: 1141 (= 25.09%) 
------------------------------------------------------------------- 

 

 

Head to head statistics:

 

1) Rebel Extreme 1.0 3450 :    489 (+135,=241,-113),  52.2 %

   vs.                     :  pairs (   +,   =,   -),   (%) :   Diff,   SD, CFS (%)
   Lc0 791921 CPU          :    163 (  43,  78,  42),  50.3 :     +0,   11,   51.4
   Komodo 14.1 HCE         :    163 (  44,  74,  45),  49.7 :    +19,   11,   95.9
   Revenge 1.0 avx2        :    163 (  48,  89,  26),  56.7 :    +28,   11,   99.4

 

2) Lc0 791921 CPU    3450 :   2869 (+802,=1443,-624),  53.1 %

   vs.                     :  pairs (   +,    =,   -),   (%) :   Diff,   SD, CFS (%)
   Rebel Extreme 1.0       :    163 (  42,   78,  43),  49.7 :     -0,   11,   48.6
   Komodo 14.1 HCE         :   1353 ( 395,  679, 279),  54.3 :    +19,    5,  100.0
   Revenge 1.0 avx2        :   1353 ( 365,  686, 302),  52.3 :    +27,    6,  100.0

 

3) Komodo 14.1 HCE   3431 :   2869 (+712,=1397,-760),  49.2 %

   vs.                     :  pairs (   +,    =,   -),   (%) :   Diff,   SD, CFS (%)
   Rebel Extreme 1.0       :    163 (  45,   74,  44),  50.3 :    -19,   11,    4.1
   Lc0 791921 CPU          :   1353 ( 279,  679, 395),  45.7 :    -19,    5,    0.0
   Revenge 1.0 avx2        :   1353 ( 388,  644, 321),  52.5 :     +9,    5,   94.6

 

4) Revenge 1.0 avx2  3423 :   2869 (+649,=1419,-801),  47.4 %

   vs.                     :  pairs (   +,    =,   -),   (%) :   Diff,   SD, CFS (%)
   Rebel Extreme 1.0       :    163 (  26,   89,  48),  43.3 :    -28,   11,    0.6
   Lc0 791921 CPU          :   1353 ( 302,  686, 365),  47.7 :    -27,    6,    0.0
   Komodo 14.1 HCE         :   1353 ( 321,  644, 388),  47.5 :     -9,    5,    5.4


 

Here the EAS-Ratinglist, calculated by my EAS-Tool:

                                 bad  avg.win 
Rank  EAS-Score  sacs   shorts  draws  moves  Engine/player 
-------------------------------------------------------------------
   1    150675  25.31%  16.34%  13.69%   72   Revenge 1.0 avx2  
   2    135736  19.92%  11.49%  11.51%   78   Rebel Extreme 1.0  
   3     70930  11.42%  14.74%  28.62%   71   Komodo 14.1 HCE  
   4     54823  07.55%  13.64%  22.77%   72   Lc0 791921 CPU  
-------------------------------------------------------------------
*** Average length of all won games:     72 moves

 

 

A: Most high-value sacrifices (3+ pawnunits)         : [1]:05.32% Revenge 1.0 avx2  
                                                       [2]:04.21% Rebel Extreme 1.0  
                                                       [3]:02.01% Komodo 14.1 HCE  
                                                       [4]:00.26% Lc0 791921 CPU  


B: Most sacrifices overall                           : [1]:25.31% Revenge 1.0 avx2  
                                                       [2]:19.92% Rebel Extreme 1.0  
                                                       [3]:11.42% Komodo 14.1 HCE  
                                                       [4]:07.55% Lc0 791921 CPU  


C: Very short wins (40 moves or less)                : [1]:01.92% Rebel Extreme 1.0  
                                                       [2]:01.68% Revenge 1.0 avx2  
                                                       [3]:01.25% Komodo 14.1 HCE  
                                                       [4]:00.26% Lc0 791921 CPU  


D: Most short wins overall                           : [1]:16.34% Revenge 1.0 avx2  
                                                       [2]:14.74% Komodo 14.1 HCE  
                                                       [3]:13.64% Lc0 791921 CPU  
                                                       [4]:11.49% Rebel Extreme 1.0  


E: Average length of all won games                   : [1]:071 Komodo 14.1 HCE  
                                                       [2]:072 Lc0 791921 CPU  
                                                       [3]:072 Revenge 1.0 avx2  
                                                       [4]:078 Rebel Extreme 1.0  


F: Smallest number of bad draws                      : [1]:11.51% Rebel Extreme 1.0  
                                                       [2]:13.69% Revenge 1.0 avx2  
                                                       [3]:22.77% Lc0 791921 CPU  
                                                       [4]:28.62% Komodo 14.1 HCE