{"key":"d5-s4-cancel-port","idea":"Port exactly-one-tick rival-retreat cancel-and-suppress to spread 4.","approach":"Preserved RC unchanged for spreads 2 and 3. A final wrapper subclass adds the identical per-side cancellation, placement/probe suppression, and bookkeeping clears only when s == 4. Tuning compared bid-only, ask-only, both-side one-callback, and both-side two-callback ports on the sampled spread-4 seeds; it froze both-side one-callback before the separate holdout.","tried":[{"name":"bids_c1","code_sha256":"af921951ed6c511e8dd74e654db2581f2ce9fc2541c054d50daa41336661b620","mean_diff":0.20978042469249925,"se":0.17965005715639085},{"name":"asks_c1","code_sha256":"034aa3fa2205b88375860fce1f2d488c5d3aea01766ccfd7a8980a7242bd8ba5","mean_diff":0.26910747214749786,"se":0.11234172915190925},{"name":"both_c1","code_sha256":"ed16c3905ac1a782b38421802ab21b9ff6c227ecd8f21843e6ac97cd95a4e334","mean_diff":0.4834910561,"se":0.2271084823821434},{"name":"both_c2","code_sha256":"68ac6108b99e5efd4f42b04f22d91d5f7e1dd69be17ad2b2e4ca0ea28db75e69","mean_diff":0.27540743942749957,"se":0.23966302758249505}],"next":"Screen only; holdout gain is below twice its standard error, so do not promote this candidate from this evidence.","code":"H4sIAAAAAAACA+09/W/bOLK/56/Q9eEhUiK7lu2kSV9cYHu3+7q44ra7fQ+LXhAYsi07amTJkeTG6aL/+5sPUiIlSrbTdG/3XQIk0Qc5HA6HM8PhcPTs2bPvN/40t1ZB2slWaeDPrGWQLoKX1tTrrPwwzVxr2u/croN14Fr+oBMFs0WQwsNhx4+i/7LixJqHmyDrPnv27CBcrpI0t5Z+fn0wT5OllaSzIJ0kyc14tRxPr6FGEC+Cbpanfh4s7i1R4bWfBe/Fs9aK+f0qyGStv/rxNIh+wpKu9S7yp4G4fh/OgoODWTC3xtwnz3ZeHljw884aWbNwmtuRvxyno163f+Jay9FJt+daWbgYxyOv23ctfPsR3vZ63jm/wLvBCV3jcyhzu/Q3o0Gv18O66TKMR/Dw5jt4+wL+v4X/HpRf4UUPLvzlMgHgUPZ+Fizh4dC1fh31ufr8Hh6ccqHx7eiUHtLNClspIYzhduXfCxTmE7gABOdrbnWD/z1AMg+nN/fcGiA29q+BBqM+3t4EwWp8HcK7E3ETJVz5zRp7g2UmYZyNzgivMMoZzDoOsVEA/nG9XIXxXHRmhh2nWjdvEZveGV7NxRUW5HIwDFzsjTfyuJn72Zx7/esc6UDPFogbU27BmOHl7Xw05PdIjrmgB4AcL/yVJOrcY2gLj4dT3vtFg/HEYxwWmUDKE71bevz/80y8mEc0+r0Th9jm/c99YBxk6252m+Y2kLJ48e7H6ivriO9XoXNApZATp7O5vRFciD9pkK/T2Op1T6C4Da1ax1wrSKGg9RxBO0r9lbk+V9ms7A5D2uCvw9Xf/VhWD+NP9kqpvkKkw9gGetor1/KCTu/cgf9WR1wXJXOtex2lf1GysBHGiuutHKestYFaOTwEepx4JyfeC+her3vW65+dDKB+Trc9rzfon9Et/CLWtgcvvO5w0H9xdlaU887O+6fnshxX7XmDnqh6ZA30hjsbKwSKWRdE3iDKAmtTFJgnqTUGelipDxLF7itEIWJBfaa19hjgzQAe0Mbr6xXwZwJC5kZ7urE6I8vmQSfaQOdm1cHblOMTrZb2TX14EZMbB3p8A12d0k1ZZx7Ztw0cMY+SJLVvoRLwPpKUxhRwgFuq8I+f/vb9e+jqJY4oiBKg6CmMv93xugO8817QHc0gkJJ0p91o5UoQVyxmf/np9fcAHYeYHvww/u4N3MubH94qNz+/Vm7e/h2riZv3r8ubtz/9Ov7rd+8QZ0CkN/BQcmOT/F/c8l/4Q9OYJN4Q/5A0807x74CentJjr08v+ienckJTO//9y49/Q9pclY/e/fLjT7+8Lx8SF6WxC3/ukJlsu1NOEiAUUOUEyX3GhEM84BanmN1QThnJcUq08/qnJ8zsw3Oc29CezsVLbH8p2wdV0Dv1XpyfDU/OB2enp0Oii3c2PB0Mh/2T/lnv/EQM6skAnp4PPJiAJ6dnNJD9AdwPB4OT/vAcHhVow5uzofrDb3aFsANKlQk4XkLnh90hzH8UBWdDnOXQVb3Qyk/zrBwOjSwxEQRUFTDlwKnP1vEnKdJQgqHEsQsxCrJniBPWw8kyjp165WyhCcTxJ0OZ5VptARDCHiBYaPq51a9XuIPyMOogyqDwczGHwS5L0tCPbCMeRIGuv1oF8cy2oUkXcYM/d45eehwn6bKBVFMkVTG3DKRapckE6mbrpW3foaZCIWSXXZtir5ZrpFa2wGv9Pc5UrYRD7SKyiCuxLvfEMXQREZc9lCC9lU1IVTuZ+2GUPbSXgDTKIOCEoqPt/dyjE4RYtRekd1GZ9HqsPEs9Pk4dZBdo36mAK2RTOeopCgBXtO4yxVzRpqk2i7EaNijEkEUl6whVYr9zkQ4uqiEXTQgX9RSYVpHLCsRlSe+SfHdJsLsk0V0S5S7JcLckvVv2wVURcjRrvf9krT9Z60/W+pO1/mSt/2us9T3Fvy69B0/S+0l6P0nvJ+n9JL3/hNJ7+CS9n6T3k/R+kt5P0vvPIr2nkZ9lltw+tdW9VOhzQYPxOIzDfDy2syCaK8TA225cONqLRyQK0fUX5Lajv0oD9LT99kV/OpnCw38kcVB5fGd8nOXU6xP96WpK3ka+9I0VVxMzUivf/Dyf1PuWGSEDK9yN4yQPk9iPeEwMBUCEJNk6DepQYRzysZ/djFGpGFugErfrJA8YTIAE/sGHaWcoR601EEEtsDKhqhRI0jSYYqfQxVktt/JTf1mQo2SWJJwRo7hW7i/q3HIsd2wUloWC6EDNU5sLKfMvicdZHqwExCwH5lRgviG5ubE98aqLZbNxGix9YNl4UQ4ocweVmSbLVZCHeZKOJwH0dRLOiO6ZBVKr7CTRz1xDjhTVkLOdJBjMk9CPws/QtuTGzAozfRzCuVZQF3UFl4l+2YBHB9E/pp2F51a/JjRlFaBsXWzSy3E2TVbId2VUg1YwiDQw/R3B9NvBDHYEM2gHM9wRzLACRudSpcpl7wqGdHWvlG+j4ngdr2G+/U4ObR3Vg91GaC8Ud2th8M1bGD5+C60za6eZMo/GyQT5xXYaC0CbrMfUjZEKQ1XroL2PpkDvCuyFKIjtghGa66AmZlV3evZiMGwuV+z5NhYpdkabEVzfj7P1UhIWuxlEkXikKglTRVBJ1Yr8qK2iKNH4fham+X1Ny1VLmY2N2pD582ActzaX7TpEOwpLljzd9WoGw2jTgpi06ioNkxQXY8jVcB8Fn4KIl1F0D2owiBf5Na+S+BFgn9/z4lKzJMa4MoSVmOPsgsNvh7BqPHyJvHL65UEidz5UjZhL3OS/ai75KYh5p7293F0QLq654CXwC1If1tvFZXPFZeDziPW7p0PQjyGu8k67g8EpaEx8hsb4GS1GwnIxcu60QMTd98ty4YXLCli493k5dHrCu7cIS8OhGSAaUwgS9b9LVkBz2WK6t8xkbnDLZB6S+VZMSAH5SAPRMr7Af0tEBJezcq16+gCjo8p86MYg7oNFzSGs/uGaQH9pgT3YEXY5swAqza3DcnJRo6fykZxf2Hy3KMhTDCuXz9RZBm9gnimovitWG4TKTpZE5pVG4Ui1g/GHwpyghB/PyIaobMGrL394q72kMKji5c+vtZcUFlW8fPt37eV7reb71zuaG/KdYVGCkMBivRgZliPHLVpXXR4dV0nTsM46ZvdKfVlTrAZQEc3DKApmgKYfgwl/L+eBvuSiRTvIUe1tZRG0o6X0RJwWTYLyMwtnAbk9I7T2JskaqEJxaL021MAu9MknIguh3VEvM3EMYVtCCqtC+RKxqMtiwJ0KiyVbHRStDBNoLV7XbRKklouvPyG2QOkkmo2pg2DLzlBVIXBTo4gNkqtHPMI0eVVWR+7AtaYty3lKuQulHIaf7Yl0sViWwVpJt3hUMgYOXEKKj4if3MVjCrTPEPukS9fjkAYSemqwRz750ToQy1pyEKP7oaO0fkSEc7YaHjxy5nkAuHA7r8gtZqaEbp+0gSO6BXEG5j6amCWuFwTeXAEMBy1KEDtMSJH3zjOQBn9KI6hiFjUwqpxMoWst10MkexCvlwFqeru0Zhp4AX8+D3GRQ8hieBrZSl6331heohMSrWrRaH0KnBVRfJ+HjuPgYBTEI/+wcJ9Dy/inJjQLB471n1b/hGZDHX3F/ERmrTJHnbiFFaoVp4cNhSlI0J+EUUjLD1tAOLbOeuSXt7mj6q4AWmzY5edQuhDUVN7ZZu6J+fDiBW0j2ejtBVOlUyVw71QSuIaj4xh4SjGqUbdMiFl8ELfIKp/DlX1U4TODVbwK/BuBoSzU1k5BkDt0xkNdDnakIEdR7GqbWUsCaAlEvmNTW8RIIsKaxe1KiEx1rNaI4gOM4ihxresQB386IcWj7WwY5WDNCEi6JKxBk+Chou7r//1gUEyJoC82mHTBgJ0G7FmsLs8ygy4iDJFprsPG2oDIu8tD3CM8vEKpWDFI0Sv6m1Z1m6SvdooUkVFlgJnDvhqxNfJFb9r/uqbff//27UPbDvzSeAdezXz9bbmRMMG3k5qk8qnhwN8yoHLvL0DD5Tp0auscaAkB2TAMyOxQPJg4hDsMmZcfXjlbBh2hi2outO1Ux13uI/PYU2PFZgkQEoxFg5mDctuH8sVeitE01XpKPmqv1j9o5aJssGMCo3VHeLlrGzuuuq9Tm5JosyWA73Wogy8nMcIG6hRv78KZQB7ed6hgZZEbT0SBPg/j8Ay9kbmdopVlY/0jpC+6jGCUVAE8JVkICB1bdkh+gxM0nLHKcwRb8UbEE0XwSst5MpUGKPIFtIMxAjCGFzWVeEetoWJA4OgviScHzVJDnEDY2GIjDU2SUwU7fQRR+JPOBrWWoYGWLRxD67pQX8dIcsAZLg6vqNJergNaxOPG9noVBXYh+CdTV24KGrQduxKlAjowGUoUyT/NzAYRrg4A30YrawoMdEejRug1W1XIV1O0gsLmIhjmgPyDvzeNxXAzvA9cDaZV96S5QcYeLLI79H6h9p31GyzM4ihBvq8/8xHpZxzQPyw9C5Pma4k6eCLq4xN1+HJfQaAIWKgPoho1IkrPixHJQPh32mU9aaMKGFlnLB0bqHkTpHEQ1YVgoQx6SOrssnfVMoqFO3ky3TJmvUcZNEZaklgMhD6UvF4zLl+0bvPF5cvey453hRE0dN+8WNX0XnNn2zif1Fjup1gmJqMCfpuL0goEJkqgz5M7V+JOsF4yxGPUoU47H6PZ1l6iIpKbV9RNbN5s8bOCDD6FyTrbV0fuJHN2oX5VITI67TTZQeTswcF7ip7ddWTrsORJLlaod5nJDroDOwnLlIteZb1bHSAyZHEZq4DCJehYtmFPi1XwVFkFizrK+H7y03EuzTpZcUtldF9wY0fiwtVn++raz5XoRVFYOIKpbK/v4P/z8zMNFbb9snCBtt+RhTtncE+xvmQN8ku+OVLOs2YzLQTyDRQFaKaALHmFLlFgArDgL9AfyhKrZkpDQbnygaY/z0yrYKWzeMnLKlyCzaPDK4pHsHEvjLx3QDkJ5wjJ0JcKjdAWTZJLYqYO0mexn4bwy6f/hKef0UQuoxazlYiN/MxACpIdXhmi4KD0EY/JTvtP8O6Hty9bPcC/lb7cl9Z+nuAvRdsiiIKG5LcvRstntXFJiEzW9wDdLcSIS070coeVIJmn9y255wp/MvH+repS7i6C3E7CGfM2I453t6rcchpEJca43tKOyGpj1u0UPlfECFxOQ7OSX1A5dSMF3WPIckAu7j5Tip51tJJm/7U/R8chwn0lu4+x2krUMDEjCQan2L05aJCiYPxAZ8mjPWiWo43bBwLKxno1QpK8bLMVEfN2Ua0FYyBJmx3zpnCSnQvL2JL/SdfBg/vc3p1K6Ekjas2avho/1E6Pneiwc/8L3twBNREA9JU9LKKGGuEwm5l2BQqXz0bdedk4rTYMSB87ddHHLM7A8xF4PgGv76gUoXpbjMNZEGe8a1BkA0BZbgNeag4A/FtPBNCUB6A5BM20GSNQII8WTHwDvOpeC0avF1uPts4huF1blsVSDRSQwVM2UDV2JH1j08YUMzOtOGKzyMz2gpZtAwekIWhENPTo4thgZo3F5eAKaajCJ2Co5hccCFadxmrtYa12JqrTPjc251oLfQNDjp0S/+mY0V5uCg/rItu2a1juvtB+3oZR+IRtY3VzC8Ar0qJt2jzZPSDPELlYTAJBy8Wlx+S6U8gimlbpQXs6gFx7G7UGHgvyUof8FThnmlFL1hr8ORY2O2lmMgh4l0KxpB9eceZpVWn7kM6E4VKZgzg0w/rjiiYaJS35J66ANSOdjVAPTP075qhYCCsKxi25KvrIhr8w9A8OShabW9+91k5VSdeyvRGGEDWivab9GYzCpBM72itcAuBuQ1l7L/fyR18d3MJ43PD5IbJMRQ8/rgyy8+PEWB0jGTZbqm93s/5hcBv8gXEbNuBGLZhMZh34yzbLosV6hTbQgYDb/9znB1g6gKKEwR0/0FdhfHyLYi6jjzhRcesNZtYRtI6RT8XzSfF8om2DvRFMrx+2M8/AWpM8E48sWJjRSuSIW9wow5FeJ+U0T8USuAxV1XNXQbElCpCOOH8phEpcXfnffMcwb97CGzxSiI1f0BYoPqGlEb7+7vCqcZFb6/BtFn4OQHFmIKMXsBp0acGJEQAj0l4UfjTCHTZTuBhUs45GgJnJdkJwhp24Ck1NnJjKQH3OzUaHUktt1uFXZMhQqAIFZb5lAgDla+CWS5XcJ6QNKlCXAJXCw5tGwdjYcl2PbAOjGMPXkDLPwWxOUTMCIYzWJRV+RUfG9qeROGAZxjYusGkveqXuVRcMgWfD0T1TGD5Aj2Otf0UEM8obREpu85KuXinzry6bd+Ko35F3qgMAM/Hbj4CRyuvHovLgicq/A5WH/85UltXRQ4zUagWw+1hUzkpUR+Dbj/EqRwNaqGk8gKrZ27eTEDcvar5fFKEe0iLHP+fnjQZBlZTbDDCptfkkfMcS+psOfFztNWgUoThCeyU3Oy73bKq5Q1ApnnjVwKisDK4GDPDa4Ruk+AUtoPZpRLdl6jXv8wUbP5ivhFgAmeWNi49+5dUX8gKHV7k07HQM+KjBPezjdLXJmJqwNcXem/sgGwNzBXGepPeAELZbGFZv59ySsMFMRikLDBwc3hzhbRJMESLTZxS852c3vzfv5dKhzkzxLXlvn6Z26ZDXWI1JDvQGtJSdNzJh0WvLFqx30gM0AOR3b4hPiWf7gmWZ+Xjbikab7N09F6Vt6Oy7iHwwLPO4yyXChRCFqIy65w2bwROcGl532KSNJrjj/J2YcJUYYZ8E8aBn1E90nqeHntJvaQ9IM18NV1ZOJ3rdfmn3l4f4qvqP2UCqGXwlotbLYXAeOGoTPuBymTxeAPErPYa3lEwgYx7QVnvEcGNjnOhJ7GvTNSuNg10k1NLHY1RQ+QS9dXpJwqWcpCeFRC7SSVUdaXmysrl7eMpoSUe5gpWz3zF3UgrUJdJ620/8qARVo7UxggqQECRVTwCVWWCAu16hRhKkRVmEgH5+zY2LTQXP1HWndQ5hy3tKsn9Jx7UuKWPzFxTTvNrmYAOlmGtRJi6p/GmgPcf5OoIYxHF+nQbZdRLJYOgqFv2eNDQAFYTvVA7naoPYEWYTaXmiD/w/cYxc/QcYmqLzX0XV4R+DzYSYoaYDysn1CDNKeU7ZeYKVKuwp5ggFEgp+DN131ch9OjsqCqC0RmvFBRYpS9yirUUrFQLWkIqlMo2z/lw7Qc2WjsBmhOcHiAVvKehHWO7wUMZdXFQ2DNoHs7TfSTqXLb0yipdbsjBUf+gt+qXJICZyOLvG6Ajiye7x7QUesqjZdQY0aA1QIvGhyGKkLQIOTO3xDH6DuvDy8A0ujqhBtLPSgLVepUXRRYTyAekCRX25qJIxpMqqlbNbKevWXSjC5/OnflQelxvyqQwPEzN6JscnGW7Pi9QpdDqFjyRKJ6eaz8pf5lpqkFu/mvSErU3MDqmsGJlur6oGtxClRWpJFKVIQkyriIdFKic4Aj/Kr8tUU352Dd35gJEDAO6gGpKEwKldV5CT00IZ1oOwPLhjq2V+T0tL0dJzfQUn0y/uaj7kfroIZLicMjRH7cvYDa1X7urW5XwdRY3Q5lVgcx1aZY3NFK4z3m72gdazr+7MN8bfdKBAnSfaocfndMynYn3WZsG3GmENHt+4MMX+MKww/POQ8veiUF7mn0N45+d8+o1WodMgjOxC9lDOy2oM5UIkJqVSVenyAdqnfqDMXIjTjpiTVqobVrLsKmIZa1BzILJdIaft3C3WzXMUtgS9Y30wbSRj62JUlOWXLq4b0ZB+wUocZ1mfMwcbLS0zwpyMGJEWSLWgXRBN1Tl8JrwkY5Rsb52didtIJhwsUvHL5CUN/iV6olgO4skHwWwIRTxCTyBg4qj4MzvJophxuNYLtQeegX4Frnovbj2jJsdUxkq/0E7G+wsVkwU+OSb7glBFK+Evo1qCja25kPJkeiMjogyz1qush3ZIL6ZCNAORQgypZUoOQ2ZBmTNJROYrKZNIctjVUseGjDSGA/earXbCg1UkL2NPs9aU09ZFctv1FJSLBE5XZPFRYxzbtG8yyic67k/H4YPpqONS16r6wsLTYvuVqgYNJ44zl4mKUAaoM54OalyUy7nKNJ3m+mlvTd9xmmeSCzVFt4fxvk1MLBLfqNpvfTTTByJqihsUBxqeG+LftksPpSHvq+EPvjH84WPDF7qUgJBGK7R7u9KcCp0tP0ZAAGoKs21V/559nn1U1ahK0DvW3mavcijLp0xblTP38zQICgbEmzFxISZALJUefYSAHdGqLoyDu/FEB4ePfH6kuZ6n9MVkO6kovziJowQ4ldDQ9TUjK8/SKV9ctktnVmU64QJX94GZFrY75lYhwhyPKFu/yQG3Q4IVCUIEwgnZIxOZ8/Gioi88WK6xLUNiYvLJdWchzPN0ppKkXhTbWqHrX2lL38rbJyvNDtlS6pQohl9hqVU+5j0fTr2qscvSj/1FUGxWIE/zlkU1DhigGOI2twnLiR/fUEouw+kySoSG/hG+uBUG9+2+cnKyxk0f8n6Sa7GeuiSIGlCouHZfNh4w05i94fRYiDH6uPMPLCiO5YjPLZDhfNMc0DrCtQvKnNvC0LWJ4MeNbIAy9JaNGPEVE7StKW4c089tdnJKKxETMHokiukJ9eUVjXbjbkbBFMej7bO2Wgn5sevPmqfTfifa1L5u0PRnatqNzni9m+ZgEa0FXAtBYeSk9oNFWOJyc0XJdFH9kON842j8QJ7mTcNhEgIC1QWgNrSu8SxFO4tcX3qSLbDLeNt+MIuaJ7h7DuuDhnbr8NbFWWXTA5s82GtKbxNZpBOvac6buaeJD0VkB9QVzGfavB5Vt3pkYVWZIge3c2TzjrkK5xVMBJQGjXv5auGL1jZJFMfJeoGUkQK7EFZNLCgLmuMJaDIYqx5VcWMzUoBzy6hiCrJnPeJszQZB6G/PQPAgLt7KydrgVXYPRQ+2ozb1V/6Uzy0KWrQPWOspBwNQkkx6grombmNJhtKtJR2eMb7HoPY1EG6B0dYhLVCXnNgmC2Vhd4vA/7Z8UAZVlIKiOjOMQgHnp3B4klElrFqNcKTCmzWCaizgiqw+ei1k4VYvtfKo5x6Eze9kHdxQWjlPhPSUAroIqZTUONh1qj7UTrvB1HaFeSYyeTdwAM4vMwuA/eswhLd/FxD49mEsJeymf7GN1y6lmi2A7SuDxx7EurH9/4FwgyfCPYxww29POHtgjkZssv+2LXnM878uD50/6SiZVgVtBv8Npw8lHwjHR9FuIq7bKEf9Ht9Z6M85SV0d5Zu2E68J5zKYZbszE294ti3sW4Zt8scbNKKtV4sQM2azvZ3LaDQYHYvqNW7qz9NK7DGFPhvD9yY7+Elq8WkU1S19JoAYRl1dNQ/yPG3KTbgjfVVmNXZLuinm6VUjIzcP0kPnwuBxptTwgWBu/LIgRzCKsCvccFDTDwN5xxzLCAMH4KH1G8x7jPGAhfDDbXmFE/9CvFELvUBQIqCugwggKB9B+SZQHH6GoPw6qMl6xpEnuNs34cgQEP7o0a7sKkwTSiXG3TgSCEqOPKa9iCPasHhezzRGdV+JxipRe2jDMxLPqZy+O8Ctjax5JZxwWX8oEGRgxZtknes7F7xjCMv5W49W8rTBz70WeHQIlFhAHFUPMEB3AAS7JysSAtqS+xjvIn8a8DYGqsqRNIQxg1kx90eAgZR/I/yCrFfdOKSdhc7I4pcKuemYhhacuRRKHkhjRO7WYjD+0tn3HMDPr82iIwlnxQf28HOeh8tDs1jemzC8vSVJg3sCUYifM5DSaZTUNoUqtHgFM2dLMineWiGxZ5J3zbrka7uzd8aPb9vg4PducPjNG5Tz5laXSaaJU8Rqi0UxSZy2GUQlnL0OH+ZJ7kfka7o9MPqR+LCjGjteBKmXNglK+6HU94jisFT/ukSml6wLlo3x/OKDiCgTrNrnYhun+OSxprjUp3IIEZ195vkuU1iVe0A8Wokc7NW9r+7WTrJrmwxW2bmqeHWG3k2efBW8wSPDGzbDk/NmF6jlVDZK/jZ2Kc42lLOQTSyjGMANWS5uDKdPPt20fiGr8+DggNLkpoONtQ9qSUu+wlyAkRoj9YHsm083nEjGqXyUYaoWZSJQ8Rq/YlHjVt56ooLgkeTICDS21rxpQodni1go7rVT5AeFgpt1U8yxaP8NB1++WQsrVzmCYxZ3BrxE6qI3HCKHoAyyRtAExgyuXATzvJ7xSBE0WJII5xLljxFAfbrfmnnLKJN8g8jdJpfQJVNRmGJZsrdRlap0uzWxgxqBcglA0C+fNk7qtEwZZZzI+owEtfdyb/k/pzTK9cC8MhL9oNo7LA5MkNIhfacax845czNeDahGuvz+T/XDwvKrQdXnmEcJ6fCqfvobZ3deZr6fA5MCvimd3DGa5fTZHOXEV3vehAdpM5VhKPSnTRmvJjQSla3QarcoIXfHSrl7/d+ra/UJsV/f/GrfHpBAW+S3KEKiijh3P75HbVE7ZF5GE6zzxm2Srd8jVwvxhJlGgZ82lBQ+TBlEeIxtG71K+DExPdMqYtniR6yIm+LbRez7qna+efEGzWA+VdATlYFmt7Q+ypVNwWLEywbrclCRvfNDA1dE4afA/DGPJJpxrJuSH32fb2JK1vjS/h3zLkgnqM+fVB2Lrxtz206zB7A96E8bKhNOW3MitORbBoLJ2WnLUaqMjAmyazXGgOrBNuu8pTOPjaeKXYV1WtIy7xw2Q0Jv57gZtHad3ZKlK8qyhnedkyeZmcWR6DIbPxOIgt/oy7yccEaRt/wtXpFKsVQx5s/vUrM8MXTHOc03pB9GhgE5mj91KiRsG39v3bUXp4/RjrMTmdVXielynGpGfrQfGoru3klFJCCkEX8LoLWbfhRhu4Mr9TsIvGVQQ+ThKftFT+lEGZLmFQ84cigiUX19YYrf3bm91ab6EQQDrZW0Ui2fXOAl2GXfNICNX2sQiSRpITF8YB+moXZKXDsIch1GARZAI+jCioLYLr4M4YjkmuWHIrDUFcmDFW/2eC0Yhc0J8WEuF1Kt+kGNS2IgEGVAKKdKqSv+zIbjHLQbHfB3x61Kw2fDxWq6oZj87jn6v3QvAn8sfcyf97jxZcp1Rd6r+mF3+TuSy3uxZV1VH1Ufff3T6YCPit1Ri7ug6RPwFRcDJh3GBe6x+iGP4oCWPw/y+zLjYFamXSoz1ukI8iJbO1c2ppXPjp+oNyWBXHDP9RRUWrN1Nlqu5ed2984HXDB+FAJrz3gLiw9KU5JygVCnaKNTBSWS2YlHjjxtp1Oq+I6zEWgFRMM8USAmacpWm9AwA1xUC8RFHh/uT+0r4O1euKd59TSvnubVI8yroWFezYdjbAoNNlyw8qmqq5qXg61hZHYRXYymcfzJtWYhLL3iacBGcq8IEcBcRxo7Vm5ltnWXjrKLnYVpPbemK+NBNC+5Y3atFMhcSJ4H2AP2b1W43GxtNNo+SEeUA6PGZL/CbrWVVEX4uXn2fjTKisa4GM0f7jzYxi3McQTTXGLMnStl3B47xrLjyuZeY8e3x1fpsTfO1xj3FC4g8xQtaR+U20fzHuMcxLsiy4X31VRGnHekMiwW63upqT8Vh/p2/wbdNn+LWV3hxZcmBLrC7fJbbTH90tpJVyrdbWxd6kqD60wmune+OAfNCyCJ7Cc/WgeZTUsfFEoHDQsf2pU4aXM0siy8pDU4nZkkeceCDiAUok+0rHjaTY7Fg4Pxj/F0vZxA997n6EVcoNkhLw8OptBaVtzb9dKCH589e8Znhy3fSkPobgfaSwMoMmOphAPhAYZRNPHJkZOt4DUMff/5wEri6L4LIA7kwdTxGFgpH49J2yosn61XQWo73eJ9xeU/Fq2Olc+v2qXSaCodBXNUL78Vx5StnuJHgbsvBwVqSTzGJHuEmctOPQXBCe8e8d4aLMQD4MIkHU8CUJU0ibUjpHzW21xaGpJl6SSaIQyXLkRVY6d3oAnBARimY+uSyEVPqY8Gz7sIOMR8DIOKXNK57aCupwVSVF+raZd+qok+1XieMhFqz4nwo+I1ZpJzDXDZL0ZZGA2ATc+J0KPi9bEGuJ5kRvSrYQdc47hiEpdug0mUSOlazBqmF7GoVEMamG6YB0uQLdg6lXqF/FqlOKkrhm4wsUx4dVTEhAY1QmgY6/+w3q9XwHMgP4JPQXpvrXC/YAmyA7f3ptF6hl6lVZpM8DNrYDr6RfcRgW5zDCH2iVsj64PbrY1EmIUx21o2F3GVHQteQvDzbit9KpudMhWAqLrVkaulBjBXco0Zv022jLLLxqCU+FCSvsw6vr754Sv6TyWKaynpHpwvKr27wSZvyQfRvKlx0O56L2hcNbCEKJG9cBQu+puMbM6DFNgpR/lEbAVQmHtgjlrzMIoy5KL8OrBiQL/QNV2ViQtXfut0WE1qe3SyLq2u2yv7xg2+5iWx/qE+MZuEdv7lr1LR/pCk74fvEvqieqGfq+rZULxU0O9J43aG1gqhJHMiVSgVOtAu6JDRI0UzD0bkE88+inbOhnsqaKXCn1xHG7q+G3EeRVP/pbaybhDaQexPWIrYh9DyoWsdQtuHTrMGB9XkT8Du+3aK3LWewdWzb6bPAT5cPWtV60UfJYEQ1BZdX2Her1D3FUiPovHN2H2t0n/S1f/GuvrPpl//Dx0kvsAdxQAA","code_encoding":"gzip+base64","code_sha256":"ed16c3905ac1a782b38421802ab21b9ff6c227ecd8f21843e6ac97cd95a4e334","comparator_sha256":"3c07bdcd221ac25729c3ebc92b21ac9e2014510ecb85816c4391ed81e933291f","target_spreads":[4],"tuning":{"seeds":{"start":330000,"end":330199,"n":200},"selected":"both_c1","variant_stats":{"bids_c1":{"code_sha256":"af921951ed6c511e8dd74e654db2581f2ce9fc2541c054d50daa41336661b620","overall":{"n":200,"sum_d":8.39121698769997,"sum_d2":52.10797619998604,"mean_diff":0.04195608493849985,"se":0.03606105709594776,"comparator_mean":97.4672213329115,"candidate_mean":97.50917741785001,"retail_diff":-0.015269078800983493,"arb_diff":0.05722516373100106},"by_spread":{"1":{"n":54,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":46.182844338938885,"candidate_mean":46.182844338938885,"retail_diff":0.0,"arb_diff":0.0},"2":{"n":57,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":87.23571902150526,"candidate_mean":87.23571902150526,"retail_diff":0.0,"arb_diff":0.0},"3":{"n":49,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":112.87398754092447,"candidate_mean":112.87398754092447,"retail_diff":0.0,"arb_diff":0.0},"4":{"n":40,"sum_d":8.39121698769997,"sum_d2":52.10797619998604,"mean_diff":0.20978042469249925,"se":0.17965005715639085,"comparator_mean":162.4077324637125,"candidate_mean":162.617512888405,"retail_diff":-0.07634539400501694,"arb_diff":0.28612581865500175}}},"asks_c1":{"code_sha256":"034aa3fa2205b88375860fce1f2d488c5d3aea01766ccfd7a8980a7242bd8ba5","overall":{"n":200,"sum_d":10.764298885899914,"sum_d2":22.584989272416514,"mean_diff":0.053821494429499565,"se":0.02351394252272681,"comparator_mean":97.4672213329115,"candidate_mean":97.521042827341,"retail_diff":-0.002632659056999387,"arb_diff":0.056454153470998136},"by_spread":{"1":{"n":54,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":46.182844338938885,"candidate_mean":46.182844338938885,"retail_diff":0.0,"arb_diff":0.0},"2":{"n":57,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":87.23571902150526,"candidate_mean":87.23571902150526,"retail_diff":0.0,"arb_diff":0.0},"3":{"n":49,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":112.87398754092447,"candidate_mean":112.87398754092447,"retail_diff":0.0,"arb_diff":0.0},"4":{"n":40,"sum_d":10.764298885899914,"sum_d2":22.584989272416514,"mean_diff":0.26910747214749786,"se":0.11234172915190925,"comparator_mean":162.4077324637125,"candidate_mean":162.67683993586,"retail_diff":-0.013163295285011145,"arb_diff":0.28227076735500134}}},"both_c1":{"code_sha256":"ed16c3905ac1a782b38421802ab21b9ff6c227ecd8f21843e6ac97cd95a4e334","overall":{"n":200,"sum_d":19.339642244,"sum_d2":89.81263397422346,"mean_diff":0.09669821122,"se":0.04700650151856573,"comparator_mean":97.4672213329115,"candidate_mean":97.5639195441315,"retail_diff":-0.017587760309993428,"arb_diff":0.11428597151099851},"by_spread":{"1":{"n":54,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":46.182844338938885,"candidate_mean":46.182844338938885,"retail_diff":0.0,"arb_diff":0.0},"2":{"n":57,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":87.23571902150526,"candidate_mean":87.23571902150526,"retail_diff":0.0,"arb_diff":0.0},"3":{"n":49,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":112.87398754092447,"candidate_mean":112.87398754092447,"retail_diff":0.0,"arb_diff":0.0},"4":{"n":40,"sum_d":19.339642244,"sum_d2":89.81263397422346,"mean_diff":0.4834910561,"se":0.2271084823821434,"comparator_mean":162.4077324637125,"candidate_mean":162.8912235198125,"retail_diff":-0.08793880155002398,"arb_diff":0.5714298575549996}}},"both_c2":{"code_sha256":"68ac6108b99e5efd4f42b04f22d91d5f7e1dd69be17ad2b2e4ca0ea28db75e69","overall":{"n":200,"sum_d":11.016297577099984,"sum_d2":92.63782250009262,"mean_diff":0.055081487885499915,"se":0.04808676946888491,"comparator_mean":97.4672213329115,"candidate_mean":97.522302820797,"retail_diff":-0.1420186454414818,"arb_diff":0.1971001332980009},"by_spread":{"1":{"n":54,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":46.182844338938885,"candidate_mean":46.182844338938885,"retail_diff":0.0,"arb_diff":0.0},"2":{"n":57,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":87.23571902150526,"candidate_mean":87.23571902150526,"retail_diff":0.0,"arb_diff":0.0},"3":{"n":49,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":112.87398754092447,"candidate_mean":112.87398754092447,"retail_diff":0.0,"arb_diff":0.0},"4":{"n":40,"sum_d":11.016297577099984,"sum_d2":92.63782250009262,"mean_diff":0.27540743942749957,"se":0.23966302758249505,"comparator_mean":162.4077324637125,"candidate_mean":162.68313990314,"retail_diff":-0.7100932272075227,"arb_diff":0.985500666490001}}}}},"paired":{"seeds":{"start":440000,"end":440499},"n":500,"complete":true,"missing_seeds":[],"overall":{"n":500,"sum_d":46.36742950200033,"sum_d2":1149.9994683544242,"mean_diff":0.09273485900400065,"se":0.06776416700534707,"comparator_mean":101.4369248623788,"candidate_mean":101.5296597213828,"retail_diff":-0.06468824246741178,"arb_diff":0.1574231014827987},"by_spread":{"1":{"n":142,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":28.7146791778493,"candidate_mean":28.7146791778493,"retail_diff":0.0,"arb_diff":0.0},"2":{"n":110,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":88.78927784058273,"candidate_mean":88.78927784058273,"retail_diff":0.0,"arb_diff":0.0},"3":{"n":119,"sum_d":0.0,"sum_d2":0.0,"mean_diff":0.0,"se":0.0,"comparator_mean":143.37780997585293,"candidate_mean":143.37780997585293,"retail_diff":0.0,"arb_diff":0.0},"4":{"n":129,"sum_d":46.36742950200033,"sum_d2":1149.9994683544242,"mean_diff":0.35943743800000255,"se":0.2619865408197737,"comparator_mean":153.5829305298,"candidate_mean":153.9423679678,"retail_diff":-0.2507296219666557,"arb_diff":0.6101670600108555}}},"failures":[],"check_values":{"310000":17.5126554022,"310001":20.6298693268,"310002":2.3903113616,"310003":248.006347259},"python_version":"3.12.3","seconds_per_simulation":0.48490826232475226}
