Cinnamon chess engine - Regression test

cinnamon 1.2a

Test file Solved
wac.epd 273/300
arasan12.epd 15/215
sbd.epd 46/134
kaufman.epd 20/25
zugzwang.epd 2/5
bk.epd 16/24
mate.epd 55/71

 tc = 40/4, no tablebase, no open book
Rank Name Elo + - games score oppo. draws
cinnamon 1.2a 14
5
5
4740 54%
-14% 32%
cinnamon 1.1c -14
5
5
4740 46%
14%
32%

 tc = 40/4, tablebase, open book

Rank Name Elo + - games score oppo. draws
cinnamon 1.2a 21
6
5
4244 56%
-21% 28%
cinnamon 1.1c -21
5
6
4244 44%
21%
28%

perft depth 5 one cpu no hash fen r3k2r/p1ppqpb1/bn2pnp1/3PN3/1p2P3/2N2Q1p/PPPBBPPP/R3K2R w KQkq -

on i5 CPU M 430 2.27GHz Linux 3.2.0-57-generic gcc 4.8.2

19 sec.

cinnamon 1.1c

Test file Solved
wac.epd 277/300
arasan12.epd 16/215
sbd.epd 40/134
kaufman.epd 20/25
zugzwang.epd 3/5
bk.epd 17/24
mate.epd 57/71
BT2450.epd 2442

Rank Name Elo + - games score oppo. draws
cinnamon 1.1c


4000

61%
cinnamon 1.0


4000

39%

perft depth 5 one cpu no hash fen r3k2r/p1ppqpb1/bn2pnp1/3PN3/1p2P3/2N2Q1p/PPPBBPPP/R3K2R w KQkq -

on i5 CPU M 430 2.27GHz Linux 3.2.0-48-generic gcc 4.8.1

17 sec.

cinnamon 1.0

Test file Solved
wac.epd 277/300
arasan12.epd 17/215
sbd.epd 67/134
kaufman.epd 17/25
zugzwang.epd 2/5
bk.epd 14/24
mate.epd 56/71
BT2450.epd 2222

Rank Name Elo + - games score oppo. draws
cinnamon 1.0 496 6 8000 65% -49 41%
butterfly 0.6 -49 6 6 8000 35% 49 41%

perft depth 5 one cpu no hash fen r3k2r/p1ppqpb1/bn2pnp1/3PN3/1p2P3/2N2Q1p/PPPBBPPP/R3K2R w KQkq -

on i5 CPU M 430 2.27GHz Linux 3.2.0-48-generic gcc 4.8.1

22 sec.

butterfly 0.6

Test file Solved
wac.epd 273/300
arasan12.epd 14/215
sbd.epd 40/134
kaufman.epd 13/25
zugzwang.epd 2/5
bk.epd 12/24
mate.epd 56/71
BT2450.epd 1847

Rank Name Elo + - games score oppo. draws
butterfly 0.6 40 6 6 7919 64% -40 55%
butterfly 0.5 -40 6 6 7919 36% 40 55%

perft depth 5 one cpu no hash fen r3k2r/p1ppqpb1/bn2pnp1/3PN3/1p2P3/2N2Q1p/PPPBBPPP/R3K2R w KQkq -

on i5 CPU M 430 2.27GHz Linux 3.2.0-48-generic gcc 4.8.1

28 sec.

butterfly 0.5

Test file Solved
wac.epd 266/300
arasan12.epd 16/215
sbd.epd 39/134
kaufman.epd 8/25
zugzwang.epd 3/5
bk.epd 12/24
mate.epd 67/71
BT2450 1806

Rank Name Elo + - games score oppo. draws
butterfly 0.5 32 6 6 6820 62% -32 65%
butterfly 0.4 -32 6 6 6820 38% 32 65%

perft depth 5 one cpu no hash fen r3k2r/p1ppqpb1/bn2pnp1/3PN3/1p2P3/2N2Q1p/PPPBBPPP/R3K2R w KQkq -

on i5 CPU M 430 2.27GHz Linux 3.2.0-48-generic gcc 4.8.1

23 sec.

butterfly 0.4

Test file Solved
wac.epd 239/300
arasan12.epd 22/215
sbd.epd 38/134
kaufman.epd 7/25
zugzwang.epd 3/5
bk.epd 9/24
mate.epd 67/71

Rank Name Elo + - games score oppo. draws
butterfly 0.4 48 6 6 7991 66% -48 52%
butterfly 0.3.3 -48 6 6 7991 34% 48 52%

perft depth 5 one cpu no hash fen r3k2r/p1ppqpb1/bn2pnp1/3PN3/1p2P3/2N2Q1p/PPPBBPPP/R3K2R w KQkq -

on i5 CPU M 430 2.27GHz Linux 3.2.0-48-generic gcc 4.8.1

32 sec.

butterfly 0.3.3

Test file Solved
wac.epd 228/300
arasan12.epd 20/215
sbd.epd 40/134
kaufman.epd 6/25
zugzwang.epd 3/5
bk.epd 9/24
mate.epd 66/71

perft depth 5 one cpu no hash fen r3k2r/p1ppqpb1/bn2pnp1/3PN3/1p2P3/2N2Q1p/PPPBBPPP/R3K2R w KQkq -

on i5 CPU M 430 2.27GHz Linux 3.2.0-48-generic gcc 4.8.1

31 sec.