Discuss Scratch

ArnoHu
Scratcher
1000+ posts

Scratch Chess Engine - Game of Kings

birdracerthree wrote:

ArnoHu wrote:

GoK (TW, Difficult, white) draws against Stockfish 16 level 7 (lichess.org), at 95% vs. 96% accuracy. The two small inaccuracies won't happen on competition mode (means they are search depth related): https://lichess.org/U4jZM7kl#111

You cannot offer draw against the lichess.org engine, but result was clear with interlocked position, same material, no pawn moves, repetitive moves during endgame, and confirmed by Stockfish's own evaluation.

Most games between the two opponents have been draws lately, in former times it was more like 1 out of 10, and for that GoK always required competition mode.
Most games have been draws? That’s great! The ELO of level 7 is 2600 lichess (2300-2400 FIDE) correct?

I think some games against high rated human opponents or different high rated bots would be interesting. Maybe some games against bots on the CCRL rating list (they also use BayesElo)?

Stockfish 16 level 7 used to be 2700 on lichess, today its rating does not show up any more on the website. But 2700 lichess rating would roughly translate to 2250 FIDE. GoK (TW, comp. mode), on a very fast system, won 1 game recently against SF L7, probably drew ~5 and lost ~5.

GoK also drew 2 games and lost 1 game against a friend of mine who is 2150 FIDE. With that limited data, one might place GoK at around 2050.

Again, you need top hardware, the fastest JS runtime and a system set up for performance. Future hardware, JavaScript and TurboWarp improvements might move GoK up to 2100, without me having to change a line of code.

Disclaimer: All of this is just a best guess of mine, it could be off.

Last edited by ArnoHu (April 13, 2024 16:12:28)

ArnoHu
Scratcher
1000+ posts

Scratch Chess Engine - Game of Kings

ababoin07 wrote:

ArnoHu wrote:

ababoin07 wrote:

ArnoHu wrote:

ababoin07 wrote:

O birdracerthree wrote:

ababoin07 wrote:

I looked, and I thought (yes, it happens to me sometimes…) and I said to myself that if I generated only the pseudo-legal movements for the AI, if it is in check, it can put the opponent in check since it will lose its king but also the opponent…
You need to return a king score immediately after a king capture. Element used to prioritize its king over the opponent king. That caused issues in rare edge cases (fixed in v1.485).
I’m currently working on it. And here is the one: my AI with white against gok blitz 1: 1. e2e4 c7c5 2. d2d4 c5xd4 3. c2c3 d4xc3 4. Nb1xc3 Nb8c6 5. Ng1f3 e7e5 6. Bf1c4 Bf8c5 7. Bc4d5 Ng8e7 8. Qd1d2 Ne7xd5 9. Qd2xd5 d7d6 10. Nc3e2 Bc8e6 11. Qd5d3 Qd8a5 12. Nf3d2 Be6xa2 13. h2h3 Ba2c4 14. Qd3d5 Qa5xa1 15. Nd2xc4 Bc5b4 16. Ke1d1 Qa1a4 17. b2b3 Qa4xb3

Blitz 1 on Scratch 3 or TurboWarp? Because these are completely different levels. On Scratch 3 “Chess engine v7.2” has about 100x the think time of GoK Blitz 1.
I know you’re defending your beloved little engine, but don’t worry, even if my AI had beaten it, I would have known the win was unfair…(Both were on turbowarp).

Thanks for your interpretation of the underlying motives when asking which runtime the game was run on, and when stating the simple fact that it was played among two engines with a 100-fold think-time difference. Epistemologically there are not a lot of things we can really “know”, and my intention for sure is not among them, not for you, probably not even for myself.
Sorry but I’m terrible in English (it’s not my language…) and I do not understand despite the translator what you say, these have their limits… sorry…

No problem, it's OK.

Just for fun, I translated my message from English to French, then from French to German, using Google Translate, and it was a really good translation.

Last edited by ArnoHu (April 13, 2024 16:03:16)

ababoin07
Scratcher
100+ posts

Scratch Chess Engine - Game of Kings

Canyou explain ‘Epistemologically’?
ArnoHu
Scratcher
1000+ posts

Scratch Chess Engine - Game of Kings

ababoin07 wrote:

Canyou explain ‘Epistemologically’?

Epistemology aims to answer questions such as “What do people know?”, “What does it mean to say that people know something?”, “What makes justified beliefs justified?”, and “How do people know that they know?”.
ababoin07
Scratcher
100+ posts

Scratch Chess Engine - Game of Kings

ababoin07 wrote:

Canyou explain ‘Epistemologically’?
thank you

Last edited by ababoin07 (April 13, 2024 16:13:20)

birdracerthree
Scratcher
500+ posts

Scratch Chess Engine - Game of Kings

ababoin07 wrote:

ababoin07 wrote:

Canyou explain ‘Epistemologically’?
thank you
I’m glad I’m not the only one that didn’t know what that means

Meanwhile, Element’s TTable isn’t functioning properly., I have no idea how to fix it. It might be a general bug instead of a mate eval bug…
ArnoHu
Scratcher
1000+ posts

Scratch Chess Engine - Game of Kings

ArnoHu wrote:

ArnoHu wrote:

Epic Scratch 3 battle between GoK (Medium, white) and Element (3+8): https://lichess.org/study/3UC5y4H9/yL5kHoOc

GoK (Medium, white) wins against Scurious 2.2 (Ply4) in 18 moves, 97% accuracy, on Scratch 3: https://lichess.org/study/3UC5y4H9/PlCZVKW0

At the last move before checkmate, Scurious played invalid Rg2. Seems it tried to counter being in check, by checking as well. I remember that bug from the first GoK version; on a virtual king capture, MiniMax must return immediately with checkmate evaluation, not search the next ply.

Tweaked LMR a bit more, Scratch 3 game GoK vs Element, this time over in 23 moves. I guess Element could improve king protection / shelter evaluation: https://lichess.org/study/3UC5y4H9/X7w04H4i

GoK vs White Dove on TW, interesting checkmate sequence, GoK wins in 40 moves: https://lichess.org/study/oWyPldeN/xGq6t3LF

Rematch, GoK white, similar result: https://lichess.org/Knj9MWX0#149 (I play these games on 10 sec think-time each, for that I configure GoK think time manually, as Medium runs on 15 sec during midgame)

GoK (Medium, black) vs. Element (6+8) on TW, 95% vs. 90% accuracy: https://lichess.org/ox1vzGRW#110

Improved move ordering with the hope to achieve better LMR results, test game again WD, TW 10sec, GoK (black) wins in a high accuracy game: https://lichess.org/kOjuTfIa#78
birdracerthree
Scratcher
500+ posts

Scratch Chess Engine - Game of Kings

ArnoHu wrote:

ArnoHu wrote:

ArnoHu wrote:

Epic Scratch 3 battle between GoK (Medium, white) and Element (3+8): https://lichess.org/study/3UC5y4H9/yL5kHoOc

GoK (Medium, white) wins against Scurious 2.2 (Ply4) in 18 moves, 97% accuracy, on Scratch 3: https://lichess.org/study/3UC5y4H9/PlCZVKW0

At the last move before checkmate, Scurious played invalid Rg2. Seems it tried to counter being in check, by checking as well. I remember that bug from the first GoK version; on a virtual king capture, MiniMax must return immediately with checkmate evaluation, not search the next ply.

Tweaked LMR a bit more, Scratch 3 game GoK vs Element, this time over in 23 moves. I guess Element could improve king protection / shelter evaluation: https://lichess.org/study/3UC5y4H9/X7w04H4i

GoK vs White Dove on TW, interesting checkmate sequence, GoK wins in 40 moves: https://lichess.org/study/oWyPldeN/xGq6t3LF

Rematch, GoK white, similar result: https://lichess.org/Knj9MWX0#149 (I play these games on 10 sec think-time each, for that I configure GoK think time manually, as Medium runs on 15 sec during midgame)

GoK (Medium, black) vs. Element (6+8) on TW, 95% vs. 90% accuracy: https://lichess.org/ox1vzGRW#110

Improved move ordering with the hope to achieve better LMR results, test game again WD, TW 10sec, GoK (black) wins in a high accuracy game: https://lichess.org/kOjuTfIa#78
GoK defeats an opponent that made no mistakes or blunders. Incredible game by GoK. Element scored a 1-0-0 98% game against WD, but WD made mistakes (93%).
ScratchChessChampion
Scratcher
94 posts

Scratch Chess Engine - Game of Kings

ArnoHu wrote:

birdracerthree wrote:

ArnoHu wrote:

GoK (TW, Difficult, white) draws against Stockfish 16 level 7 (lichess.org), at 95% vs. 96% accuracy. The two small inaccuracies won't happen on competition mode (means they are search depth related): https://lichess.org/U4jZM7kl#111

You cannot offer draw against the lichess.org engine, but result was clear with interlocked position, same material, no pawn moves, repetitive moves during endgame, and confirmed by Stockfish's own evaluation.

Most games between the two opponents have been draws lately, in former times it was more like 1 out of 10, and for that GoK always required competition mode.
Most games have been draws? That’s great! The ELO of level 7 is 2600 lichess (2300-2400 FIDE) correct?

I think some games against high rated human opponents or different high rated bots would be interesting. Maybe some games against bots on the CCRL rating list (they also use BayesElo)?

Stockfish 16 level 7 used to be 2700 on lichess, today its rating does not show up any more on the website. But 2700 lichess rating would roughly translate to 2250 FIDE. GoK (TW, comp. mode), on a very fast system, won 1 game recently against SF L7, probably drew ~5 and lost ~5.

GoK also drew 2 games and lost 1 game against a friend of mine who is 2150 FIDE. With that limited data, one might place GoK at around 2050.

Again, you need top hardware, the fastest JS runtime and a system set up for performance. Future hardware, JavaScript and TurboWarp improvements might move GoK up to 2100, without me having to change a line of code.

Disclaimer: All of this is just a best guess of mine, it could be off.

Nice work! Element and White Dove were key to improving the engine.
ArnoHu
Scratcher
1000+ posts

Scratch Chess Engine - Game of Kings

birdracerthree wrote:

ArnoHu wrote:

ArnoHu wrote:

ArnoHu wrote:

Epic Scratch 3 battle between GoK (Medium, white) and Element (3+8): https://lichess.org/study/3UC5y4H9/yL5kHoOc

GoK (Medium, white) wins against Scurious 2.2 (Ply4) in 18 moves, 97% accuracy, on Scratch 3: https://lichess.org/study/3UC5y4H9/PlCZVKW0

At the last move before checkmate, Scurious played invalid Rg2. Seems it tried to counter being in check, by checking as well. I remember that bug from the first GoK version; on a virtual king capture, MiniMax must return immediately with checkmate evaluation, not search the next ply.

Tweaked LMR a bit more, Scratch 3 game GoK vs Element, this time over in 23 moves. I guess Element could improve king protection / shelter evaluation: https://lichess.org/study/3UC5y4H9/X7w04H4i

GoK vs White Dove on TW, interesting checkmate sequence, GoK wins in 40 moves: https://lichess.org/study/oWyPldeN/xGq6t3LF

Rematch, GoK white, similar result: https://lichess.org/Knj9MWX0#149 (I play these games on 10 sec think-time each, for that I configure GoK think time manually, as Medium runs on 15 sec during midgame)

GoK (Medium, black) vs. Element (6+8) on TW, 95% vs. 90% accuracy: https://lichess.org/ox1vzGRW#110

Improved move ordering with the hope to achieve better LMR results, test game again WD, TW 10sec, GoK (black) wins in a high accuracy game: https://lichess.org/kOjuTfIa#78
GoK defeats an opponent that made no mistakes or blunders. Incredible game by GoK. Element scored a 1-0-0 98% game against WD, but WD made mistakes (93%).

True, and it always depends how the game develops if such high accuracy is even possible for a Scratch engine.

The next game was even better in that regard. GoK vs. WD on TW (10-sec), 95% vs. 92% accuracy, not a single mistake or blunder: https://lichess.org/39xEjAYy#128

Game #3, GoK white, this time WD blunders, 96% vs. 88% accuracy, 40 moves: https://lichess.org/rh0A9I0O#79

Game #4, GoK wins in 22 moves: https://lichess.org/yjKM2SNH#44

Game #5, GoK (white), 95% vs. 90% accuracy, 43 moves: https://lichess.org/j7In9bYi#85

Game #6, GoK (white), 95% vs. 89% accuracy, 52 moves: https://lichess.org/xSXmplkK#103

Game #7, GoK (Difficult, white) vs. WD (P4), 97% vs 91% accuracy: https://lichess.org/Ga6G7jlc#83

New series against Element:

Game #1, GoK (white), 93% vs. 83% accuracy: https://lichess.org/KgVARWvi#55

Game #2, GoK (black), 88% vs. 82% accuracy: https://lichess.org/UuQAynA6#92

Move ordering improvements seem to have the most effect lately, not only for for earlier cutoffs / higher search depth, more so for LMR to ensure nothing is pruned that shouldn't be pruned.

And other move ordering implementations and even recommendation differ a lot. I used to have complex SEE in place, removed it again, I used to place negative capture at the end, that was not ideal either, I had to find a probability threshold for history moves, reduce the impact of PST, and all by trial and error. I must revisit the SF implementation, but AFAIR it was not too clear from its code either.

Last edited by ArnoHu (April 15, 2024 18:21:14)

Kit_Gaming
Scratcher
29 posts

Scratch Chess Engine - Game of Kings

I got this checkmate position:

Image of a bishop and two rooks checkmating the opposing king.

I put a link to an image because the ai said “Sorry, this post appears to include unsuitable language and will not be posted.” when I put the image in.

ababoin07
Scratcher
100+ posts

Scratch Chess Engine - Game of Kings

Kit_Gaming wrote:

I got this checkmate position:

Image of a bishop and two rooks checkmating the opposing king.

I put a link to an image because the ai said “Sorry, this post appears to include unsuitable language and will not be posted.” when I put the image in.
And…
ScratchChessChampion
Scratcher
94 posts

Scratch Chess Engine - Game of Kings

Hello everyone,

Due to a school event on 2nd May, the chess engine (Chess Classic 2024) tournament will now start on April 17, 2024. Please prepare your engine accordingly and share any performance advice you have before the tournament.

I'll send out the official information tomorrow. Sorry for any inconvenience this may cause. Thanks.

Here is the list of players participating in:

Amateurs Section
1. GoK Blitz 2
2. LowDoor Chess (Depth 5)
3. Scurious (Ply 5)
4. Chess Engine (v8)
5. Shallow Blue (Depth 5)

Masters Section
1. GoK Difficult
2. White Dove (P4)
3. Element (6+8)

Last edited by ScratchChessChampion (April 15, 2024 11:04:44)

ababoin07
Scratcher
100+ posts

Scratch Chess Engine - Game of Kings

ScratchChessChampion wrote:

Hello everyone,

Due to a school event on 2nd May, the chess engine (Chess Classic 2024) tournament will now start on April 17, 2024. Please prepare your engine accordingly and share any performance advice you have before the tournament.

I'll send out the official information tomorrow. Sorry for any inconvenience this may cause. Thanks.

Here is the list of players participating in:

Amateurs Section
1. GoK Blitz 1
2. LowDoor Chess (Depth 5)
3. Scurious (Ply 5)
4. Chess Engine (v8)
5. Shallow Blue (Depth 5)

Masters Section
1. GoK Difficult
2. White Dove (P4)
3. Element (6+8)
Thanks for putting mine on

Last edited by ababoin07 (April 15, 2024 10:05:49)

ArnoHu
Scratcher
1000+ posts

Scratch Chess Engine - Game of Kings

ScratchChessChampion wrote:

Hello everyone,

Due to a school event on 2nd May, the chess engine (Chess Classic 2024) tournament will now start on April 17, 2024. Please prepare your engine accordingly and share any performance advice you have before the tournament.

I'll send out the official information tomorrow. Sorry for any inconvenience this may cause. Thanks.

Here is the list of players participating in:

Amateurs Section
1. GoK Blitz 1
2. LowDoor Chess (Depth 5)
3. Scurious (Ply 5)
4. Chess Engine (v8)
5. Shallow Blue (Depth 5)

Masters Section
1. GoK Difficult
2. White Dove (P4)
3. Element (6+8)

Please GoK Blitz 2. Should still be faster than most others. Thx!
ababoin07
Scratcher
100+ posts

Scratch Chess Engine - Game of Kings

Rest assured, the tournament will take place on turbowarp?
ScratchChessChampion
Scratcher
94 posts

Scratch Chess Engine - Game of Kings

ArnoHu wrote:

ScratchChessChampion wrote:

Hello everyone,

Due to a school event on 2nd May, the chess engine (Chess Classic 2024) tournament will now start on April 17, 2024. Please prepare your engine accordingly and share any performance advice you have before the tournament.

I'll send out the official information tomorrow. Sorry for any inconvenience this may cause. Thanks.

Here is the list of players participating in:

Amateurs Section
1. GoK Blitz 1
2. LowDoor Chess (Depth 5)
3. Scurious (Ply 5)
4. Chess Engine (v8)
5. Shallow Blue (Depth 5)

Masters Section
1. GoK Difficult
2. White Dove (P4)
3. Element (6+8)

Please GoK Blitz 2. Should still be faster than most others. Thx!

Ok, no problem
ScratchChessChampion
Scratcher
94 posts

Scratch Chess Engine - Game of Kings

ababoin07 wrote:

Rest assured, the tournament will take place on turbowarp?

Yes.
ababoin07
Scratcher
100+ posts

Scratch Chess Engine - Game of Kings

ScratchChessChampion wrote:

ababoin07 wrote:

Rest assured, the tournament will take place on turbowarp?

Yes.
Otherwise I would have forfeited^^ thank you
ScratchChessChampion
Scratcher
94 posts

Scratch Chess Engine - Game of Kings

ababoin07 wrote:

ScratchChessChampion wrote:

ababoin07 wrote:

Rest assured, the tournament will take place on turbowarp?

Yes.
Otherwise I would have forfeited^^ thank you

No problem

Powered by DjangoBB