From 7021891bdd98900bcdef3b544153b1e140bb4cd8 Mon Sep 17 00:00:00 2001 From: Dean Wampler Date: Thu, 3 Sep 2020 07:14:51 -0700 Subject: [PATCH] Refinements for Recsys and references --- images/AnyscaleAcademyLogo.png | Bin 8320 -> 8915 bytes .../References-Reinforcement-Learning.ipynb | 13 ++++++++++++- ...3-Custom-Environments-Reward-Shaping.ipynb | 4 +++- ray-rllib/recsys/01-Recsys.ipynb | 17 ++++++++++++++--- 4 files changed, 29 insertions(+), 5 deletions(-) diff --git a/images/AnyscaleAcademyLogo.png b/images/AnyscaleAcademyLogo.png index cf83069568da11253d7e158a1a15b1f933bb0369..d84b8f023651c5cee761d29c1c2f8d8d7c06e142 100644 GIT binary patch delta 8418 zcmch6RZyJ`tS#=vio3hJySuw=q`=0CJA4$1yA_HTcP(CAixqcw*Nxl#@B6)v=VT@i zc}Uh|W=)b=36`9dtrLO)C_)uwBz1hC&rOj7bO+l$Hs22D(!VE47<}gYMFEmr*1_|3 zFg`K!9<<*FJ8h~PzvQm0yc^{;sXJ9St5<5Z*srrPH0xC8EjLjW$Sp8nN{w`F-o14T zKG5(}wzc6WXZ!aNwhA7OkNDtmTpMNf{ohZ;)A2p6HVBgV4AACJnf42?b^8gs-OlsjyY`VjfjG#2>Quumqhh zY$2?yOP$3sSX-lR{l^{@B=J4Fo`ue<;#f;Lk*d!<_US_9H!YG8Yp;+i)Q5^z_ zoC6ni%q&#zw;%v#2LmglA<(f)A`hgDIb9cQkh^M<$|DzL1^u3M@QlNu6@{J-n{hY0si zmPkO7Frf>n!+FbA;Lq(-4rFJdo^A?g;&LcH=X)L$A%i10<*+3XvZ(CJM0yUwFp@#z ziW@I2K={x}g#Z+G#yH6Q8qd+V1<(A|f!8rK9H=-@gOtXrrswJb?L;sH79bvi@Ucrt zH8b>4eq=i@&~vePA4C=(G%!c#(r);3qQDrFh!ldQ3$69CQ(GAPpjjZrOU@+qBJQ*m z^RP&h(m(%0#i3aFW+0I+@3%LO#4(m#0S!t-{qY_C)ky-I)ct_AhOrrOo=bP9_fkMV zaLG~N!B?6yp-vF@a+;_s0C%xA&ER_q4!C;luk&?J6b?WO5Hx)CLxy9@%?$diA1D;L zN7R8&su((edNF=)p2S47MKV4}by z!nA8DrOZ+Ghwa?Y5nPAmSFu-xVdTLIQ}0J;X&i{0Iy8tMh*?Xz1ssF|eq1mklGhE0 z8qE&ue||1s9pYnZI9G#@EWqxVqU$~*m=Xe*-@fLP7sd<2XPI@O5{3>_Nww>EcOcSQ z@E1W0UHqWw^c?5+Fa=a`?_6wv_9Sfq>osF<1Nk zV|DN4{#ebn*gWtk0_Z>O6R`}TX(b1{7iu-^eA%Gwk#o){093Qz}x8N8E2! zU?qnhJ5P2|a$=*C@>!RW%`9=0`zoxZ`WsG|!yq+uA4b=q%5UP(N<0-5g;q7{HB?x# zd9J?M46i39XV0w!UoP4EgZrZFYG~}%bV7>NH!w_AVC4?$gXJ=FG3oJTkMD3}>3xPk zr_u6t`<;M0g-ia4W*avkVn3kA>+n1l=z<$aCneDlsD_s3fwmz2hGxVRa)nMD2@=-| znXODubsSV;rl78T6))q!z|B&AJScrt9oVsb|6X8aTV9{ig%Fp>-gxSqN9r%mI23B0 zh3LOwC)P1-vRV{Jr%dx%*!}*^`YcxZ$!k(k*O5`Sw|>_U9zFwb+bAb+o1@WWM04k2 z!L*A7EfpaPJamauxPeFm-qD;S{zo_Pozx#~qzMoFN_6} zm9AI>I@Ndqx?L5UQ|DF3Hts?gJoa>=5h|MF_7Z9kT)$Li#QMRgdK;O5RW z{74hhF@%YR-s;81X!0WPCz;I`)`kfZG|Jab763L=mqb1`@QJo9AwL zq>gJ>@t{+l1fpHmR-FreG?_98uUaeQbnOM30Ny)VV~9&!#e^m+0)_ml_Pn{6_Sp2h z++3lo?#lG$0II+HC!deM9oytBn4VvnNVKEPBeJ`~s6Zwa6ul*KaBIu<<_S1#>p6sW zXCu zKhy$@jC}O>75IUlVu{72wj0+-72>8*0Ce_(!UJ7-jH!rg6)gveT2`~4c{|fN0@&l{ z+%*xoI!27L_PW>pCTH$@HbWO#iRl;aY^ar~Cz_lywwhu!0UO2Rijvp+;`pv z`s{JjJYMjsyAm3Kg-}HEDY}lEwEma1aJJ5nowi>>U685TYm4g#6i>(zOWdOmP`>8i z8;z67+So=d-!~Mdv%CoL{NVNdi1LkEV586qBA8!|1q(}7mp#0Zf$&IvpZ z;abU?8TCm(v zGRg(hv?!8C(iB?$wfK<7P6wLp&n=rs&@pm$iD1+Z4HKl6t971CF$G04U=08B_9BJ3 zQ~R4WR_pl0cR@ixml?1@&?>IaQ+(D^>H-*-Uisyv2ib*m?V!Wyj>*xeD|Uu@0Luf> znoY59Z}F%0`gu6g(1ak_=6nBXwux!jIJ6jF{W0fD&8&)j!^H@hZe+PFo2BvSU7dA6 zWdlQ)ZHmslFQ=H{H4E1bF#M~$;+yb>cHhrj{Yx{eJBq9w<4hwC>mB|2(`s7{L%m`= zn->N!oQjfr^0!hmSE~J1p9;p{?)4YtKQBEA^}s{WNsyUy)ZeYhcJot_#9^51P&+J+ zBtFBr4Gr?1N&dV6i3>5i3P*)3*4Fa*KdBmVH+Lv4{xq6cn+=rRfTQitOx*Xq`TbV^ zdzrJfIy1v?1xOk>A2jEb()*q6d`~dpBczsV*@x*Ohaa&r&nWt&^JPw+0bAaOvE!2m zy=n>zO**Y;>D!iG?4~~S(-4B=8Ldt2UZn#)8 z(DLS*f@`iO57Pasq0iYW+(f459OJ+!t|tm%>>hp%1OnXjkjW9py(7MHzR@~5pd$Iipi3KKRYiqw{2E_OjE zVaL*TPIuTezDQNG`sHm7CaoO$J_LmqV7q{-${Ug>wqZD-CuAF!c|>|qz*^B|5NjFr zMt2vj>1q+4@809ze<)Wk{1!oRH-EJW0341pV2nI>kMk+aoMs7MIGUs zhnSaSC|{Dcb3f_AYdRL(>T%p?_jF_W*cM@YUL+FWSgKR>IPyl!p`}&Mor!}rHS$gY zJ#k}P+w*zRJl^x4$hYdtYB?uE!OYW>`SgpMrPfejy5!zz%pm%eN0DZR;d(B#Boqo! z$%}z(Y@DYI&H+2t!`cPCTre^^+3nGdyH)fci^g{&P>c(K-23@%&(gG zANZ{5N#L%VtVryZe-G{80(QniXLjyfAeJd=`D1`a)!nJlNd1&lG|&Gx|Mf$NUPBe( z2+fa`)8E*9~P_H#POQkmKg4kkjj41ig-x z!pHjBaIICBrFrQMw=}aL!<;Lfn<*>sdVaIc@|I+Oj;Vi5VQwFrs>6`j9!=Lpl@R#>MIuiJGTUatZC-Z zOs-+`S81_3Wac0H5J4uB_Gr15Lg@nW-*eC+0)t!;gPYq3KC2{Fg{cq38$ru?)-IlO&hDIAvV|_=CQvHuy zJ=o#oBJX`xk))v_b&2zMrKL8)$w*E@R1U?3CYVI~P;}LT0b6P-&Iz9B(I%?a9d8U2 zq3hnUTB{pI^Wo)>mk=(5^!k+-yJ__>q?5H`?S>OBD_&x^Nwt2BBz!sg>K|;HT|{PH@!GiO&LNcykCPb zDgkkj1JN{`WqdYaSf0O}SXug=s<1F|8SioKTSWCxPgXgOdM|0th;CeL=xW!k zJ%;y7QJjHM;W7~#5Sa1wa@F9ddqMp^R_U_y5EOt=Ruy^LcjApG(%VubU!$<)RqPz`!O-Ve zaALNY<@%Jq_5wg5pt1EJL&rB-KVJ1#{=240MFr2CF_PTI-Qt3rgWLtpUjM2-u7j=W ztd~obX5fg3mmR;c#SWxhi;( z9JZPJ!RqLH%NxH7SHC@Y$PqB;3*Mk30}<@dM!7b>QDDajSW>L_FW%*;*!F z?}67(xWa7s%=xmCM_FgvB!p9lI3ip`!_q^7y_)RLDAg&Otzx2A|Ddh^2gV`qjoY?w zoq*F9`=(7|^!OSyOFTy45MzXwB&b10(I#DJ$8y4aZ?!0%*E1@d&XBl|PX4P;hM#NH zP*v-zn;6iX>O6bOzWX@V9aH(yfCVd$R?RM-)Sj_@8^h*{M`=*eBHCr?flzG{+n;O`2_b%cKk=*a zb!8wHNi)CbtBAOyH?Z?!^+$O3*afy4{DGLLTL9m3SNWfIZ5tF}HjK|<3x6fnR=I7! z=R3sF>y4Czt)7UluJ$0JtcrLCX1{t&(&T2S*>9AhZv;DXJp8!xY2IeTdAWXAXQ2@w z1q)~;{y)(e>9>h9*$y}cc382W`806jIxkm@i>yyzIGVA9Q9#_hWB-0O71M;ocS zNf4FNhIt``gi;pAxc)H9dGbW>;Y-{Af}QM+OAJ@XG_7L|Ovdjm95D`yJKt&M#Y=tB+Nx{c81?isJZK!fv?sF{xe>7ys`M&B$g?;-rF`mFwU8d zO-EuZw1NspBA0wje~VtoVdJZdV_}Fy+gZBbVir>E@E-O{UbUy=UsuS~#;3DSs`|ow zv)9%}s2m8tR5FX9SnF)#eGzde-f^(je#|iXMeaMUSoU3OVbz z9N3n{I6rjA-Q25EkhDPeCqJ`m%UEleL_%QdEs_Z7#rtV z1|~;H8Ao~o-b6-BW$to5fX6A4AOLFveRm2QxpCEVE7w!$N!-1hmbq=vs!-^$5yZ z7lUj9wE~ehL6lP_oTGwZG-4qy7Lvk=+5^Vkzc&HRei=+vXN^h>fQ1fA5?3#SQ$KP6 zYpHv_Zo?6o>!OClq-DOm%EpRm*DyF!pN01AG?<@pI=d$~{;XEh{NW zVHUe|{k<5fsnW%}^%+`P73@p5V9q!;{W54V+Ad?y;9M3-z&7A~yf#K8Exs>wF)H9| z3AyyJx?V`3aH{b6({fop;Z13+*^=z&4{v$&*sKoMvU z{f*s6k48jdV?!S(vEutiCO3^QjJV)O1uq^Ns8(&Nk?l_xSi_Yi3Xq@imVBR-R}N|Z zww(SlU0-n;1V%>3z*fnVEN`Pe8!8hXufg@GX%+__)@5`4dR}-;Vy5tbn%4|XgJJ*+FA&44jG4wqT_AzYTkc5^>S?*q`^gk?*E zX{3yS23Ew4^G#YOeIZ0gUv3`q6jl#=eKc6I?4(Qzu5jC(4CSx-5u&oKwKC248CFl~ zOe863VOV627gAQLpZH$)RoTq8iFEN7e~+Yg?I-U9r$jt~T($$U-}}k?`KL6sH##Cl4ekjKSuyYnX4)a`%M3kEYTP`&AH?)_gsitY1 zB-|A&vrj*ER^dzA@15zDWjIEHl>y zNS;2sn+`6DTiuzReGzpIFft9iCfz-H^89lG_JX7zE^yG5ytgR-Zscd_W)qlF>+`^p zzg_6odSmLkCa-wzYhpL(q_8-_??{Sy56P8t$TrBhU{7d|NtiYCaS)Ny@tva96cO$6 z6s1A`ox*{vJ@tQ6lXk`Dd_KG^>J@;Kg3Z&#N0MXw+xQ2k%SFTQ24|12yO*o9HlieK zi2qGVNW+94qNQ~oHctdXs+Sc`@i?gD2YljNDTh@h_H%m!4g^%&|N1L+afPF+tz^(uIR-P0Z&od4+% z_+LZ%e**#kzZMB{(C!d0&PV}f(DeO zX|!&e#oC;NME_dYsE1)JzbuT^1bB8odV7k$5k0i~6d(P^B33=jjuiRL>Ai~Ce(new z>Kp`7D^l)fULcoXUAZgziW)V7r4dy1ew&u{hiw@^hQP*qqaD|ca7C7~ukVIUT^`4{FmFB+gz ze~Pec7n^{hCa;((xmBt(f2&j<@7#mx*IpSQUDA~lz5xa!=bj!@O%P57#h$1)Rkf;YZtYU%jwD&1Qfpd_$aaU?vQdwOgmrh!m{k+q@~pU!9rzgi;qaeX6U>(y^|0{ zavovsm<8ZV$0quUB%56O#SQ%?C1}^o=ChLMCwNn%916X7z`UXQLI!BV>9RqLe`oTZXeT^z;_gJ6lV;|J+S)%5@17_z`fpe& Qq5d;PSv8p&DNxA&0WP&n-2eap delta 7819 zcmch5MNr%i&@8TtySv*0i@Uo92$tYZaJL^42!RC>bRkG^5AF`ZZLt8sEl6-D*!O>j zcX)?){pQwH)74X5T{BfPrxY$%D~<%vg4Gn|3<3~O-eISjD`md?U0+$dnnF(gB8y~| zqsSUrTNvvVu6S40@t5|UKiesR39VNwHqO4&1vOt+n%XTe_*peVP2F7kS9a;z(e`^ z2^~FVKOvzh7IhGz3HgUcjIaZ4uMe@C!s19c0qQKV0;6xul^SOn`9D4YbSOxX$I9VT z%-Hlc=U)$4G@j5YRDWu_*eZV|uPr_l7sBgSbXnIAiS@Sg8skFd;k5@jN}@oSrS_9z zqL%CTT_Fed6)yj%>SbT&G46=LNF!U|dp>4I(N1k;V!nriwtb9RD@B4;wO^mnH#2(` zwu?e0Zz!mhRW6PGiP+8nhylMezKrH-&NGd_J%3^1MO{u;mPfwl&Jp+xrts}4k|0HH z17C>B3JL~MmbA7gUr@(oEMIRw&WO8|cRye)j~wcu;o{TJ=<6E2R8SCCU=h+kCHE!u z1n6x}<~n*{N=uTGqiMY(l8yPAsM47|8ad-tCuI)Z#XvqcL){ZJ*-Xc*L5g=6;H^TqCWzBd8$9G$(!XRXa*Q7M9T3;qg-}RtTwfL06R8$zfEXaxkAb`9;pRUAr zyjumYlf2N(tU=-Mr~3At@e2~PAf38IypODEdn+1_&y!j*9ln9!ZI1We79jz96C)yj zjA`fm4Jo{h*Xg`8ZkI1c}SA7;xbKF7Qkb8qL^~hrLjocP~ z4xyGQWzyAiaV+I9rOUV74isQK`@WKK`({^q>2;!vohu3BYCga7fO4TT{yx4y%om2^XeML#CFW1zJbhR zbz|Tene85_@YOIm6z>vZ$`nA7{DfoAQ8B*H*A_TKscGH~+JvZ@#M@oo8~kne%%yP7 zCCkrWlu68-iz1fMRk+aFQ)a zE9TqLh59TGzs!JASl5;P8~t=z4*fh3Q=(|YuX?*3-NZWrU)%2CEl~trgo0%Dl51Y6 z<`YLUV6keD5*26{r>;IgqT1yozuefiI&6zez3!KVrBbwbmn{Bu-SJMJTda$f;-xFN z=LASi-~K|mn54pz&?lgt&|rp;t74mJ95<=34*?6Y9uVt6dp6CCKr`tB#;-H}x&ztD zu@4NJDal(LV~qy&Aj*outrzBx2^q70q&EEJe>8&Ea3#BtEh5bQr$HrY_aqBKd0I@* zAky~{+zS;=9!YWnIYrCy(kO6OPoqW#C;)236vitIK+bh5Juc-3nMd+{%fRhSK}bUV zI1tdF9^(`m{;TCh6#cwz3+al~ytiyn8Z{j)+^#6Ev=;7uo)Q64`!t0!eJS`E+bMMA zlwPL=8zE|0nL3CSy932HV$&SQWA(tomVLvr!xd(B-@E4WQ{A;?PS({;SmRy;y%W{yfESqwWk|6T+NhORSXmeH@ zm|4jU2(@wFp*XQVzhQ2t?um-lmg$z@f&7Lv>VMk;N8kJ(6|~ zVVHwU%BsTp2i}nKKO^J!VoG28k1jw(mWnCwosG8r_L(=?=C;EJx5rS%?(14`7%IN+ zG&`yp>w<LCgaY84eqVA&{$#?=W@n{(LXo}v^N+?gR{W3k^n1Y6hKj2!O^dH zU$n-y%D$kkQH;!wP3wy~gPBp8P7o*-Wv9Sx0D)@xoUP}or?NAv)V+6Jf9C5HN^>ehCs8`&B9fW|*ziP`<^BbN zV%6)DX5bgZe%zfz;*eKHrm6$We~;~p6F1;J=h&?lMWv-S@)4}Hg$DJ=0j?H(F|vOh zdDuIxS5wh;F)$enzw^q^vj>)0_I#ZYrz^oe0DUFuEAs#k~ zw&rxLEoX3aG(Ww*RqA9DR|v1siu|koH0p&YhI{WIN@1FF4lccnD%X1}K6Ku#~Hq-{r#kN(MH^jC?BuoL=aY1<`MCqQsB~ zxki3gy)!QBM0%P?2}9Kq>)k|_Q(}-=3gv$IyC#yezdjw}eDl0>sW%~e`&+()YQ+?1 zOjghQJm#bz!Dvr^Jkc%Hrx3StUl&)#3W*zmhg2yZ`BykQ5cNO-(o@(_T-y5{IGfag zH-@b2SJmw347bN4=<=E=*{9s^-YeMMd|xH@FxB|xN}xXJX+t{HVuNb7@%^fXMc73P z?B*HdB1XV2ykO0;(l5=Dpg+KuocSP{Ij5@SM$qC~ zyR&9f4NjW}%=|0@@;la4sV_Xx2E)VZ`?g@<^!lt#9Il1Z*Cvr4^M3a$@I`;z= z;!1az7u@nG3W2y^>>oq*yIU01TkYTVXI-h(r@dFst}0GroE2nqVu^?l4(CjOMb?{) zc=W8#8jNQ`{flfU;c_;5tSE=JxMls5l*U)O~>(h-3iSU07F;1i2ZzJ;pD3Ju;SD`rG zqr^G`+ZLB91e$4xsKH6hhOWJOleTs>W@bs2q&`&XsOi=+3%u+VE(mD14#VN#QEKnN zR#|yoI*fm4YgbQ!OZXz3i`gNvk50HS?&!tX##HyJ7-HXpG_L>L`p*C|g@*4hFu74a zbHB&c8=XilGz4D-**FOV!aQ;{Z{fL&lck)*FLY4uTFF!b`N5Me%P&u?S*+#ml1 zMZA}MyFjw@JJvv{;W>q9%!}w+i+de%NH+dfT_#1i6{B}l-7KNI#k-a#FG^9;VONy6 z-whzh4~8DU_359ShOfcSzfeChZfXlxzhzgq$4Lhoe3OhW_k@H)oRBe84~xVN0S=w=Jd!~- z_0E2%d~Z0y{a!GhTL{&FS`lwS0`ANETfx0~uo$Y5kqr^h93g$9Y@hmS2)qcNbkUYy zshM-Zuf9)bU14I}#5mntc66Fc!ve#^3!pPaUmFVG-Yp|F2cwdqk%5V7!JoYG?ojEs$7 zc@s(Eo&fLPDKYrCKk2FXBmvzhL|EEabtT>pduBRQD?0fw%r2nQFgwxYDE~uzQ`1;b z$=zi>>;;7p>e9=h2B=hjbmS#B7mgDv(ayGlF3)HOq5K=)h?)Kb^s0yA%J*8RwGqZ+ zjonxZ^c}rqE{9VnXoNek1yQ_+DXXG2l%h*;c&I|ojPUg>o#;9P2XrzdTLFaM`Bx|i zQJYml&d7pUxHuEurqGNWX4r-Yh4dR(f-FedgP*auTQQWw!O>dAK9T=?^hw8(b+|#Y z;A~{$k5r!W>i9X(8NVyHFfpyVIpB1pg#nv|G&fK_W63g8;hVmkJ&ukyAmY;CfAy|d zRg_%WrI@qdvh?)koesAY`1ReKK~&mHzMIScA^Cadm>o=$TS=sW;uUkpa`<;9IpWQI zzkJMeF$a80v&O+i3pX}fj+svSkrzT=4%<@hrhP0o8o~j@8!l=Nxv6c}#DN^p*l8Sv z|8SZYb$ImF;l!n-!volVi6aaT@r@P|*(Wt=bcc7b2QlAzw7;q%D2cv<7-dGy>ET}(VA+CAWj^4qW*Bew9Pm6r)6J_oyva+x)MB3TP|dFCZL; zA4LkEB@hb~e4ZnlAe=981qo(bK#r}wnB*OpTE#7_5Mutpf( zyx5H$wioz2tPy))I>A`AGuBP)5zJG)f?D@V*Y}LxX#bJ|NevPS%F?>7UbnCjXe5)G zc?Rkot?&d+@j13-6lO)ERyWmDC*8;Z)1i!_SYJ z?oCuknm>vq6q4@mM*awdZwU%Wq%! z_<+vL!NR7~k9?Q?=hAGNcP*P&FsZF}y8c9DjO!mcuV#l+S&`EG|Hmhs{B$%UX?v=i zN=3H%%{-fV-f)y>=+PXyqSx`UVRMml78Y$ZP)hH zOX5svqaXXe7_KvFa|5E)k_FEQz|*+CxX&?LW0Sj3b*2P;l9h`YW*<(C*W;T2G9>%B z-fiaim}wj~{8cG5HQsNIbD{T-l!Mj|x{Q5NlW3hAavuO)u3hS}4AxyM=LPOg)mlPt zCZ{UzIjWk?+V^l-n1zin)D46U+usvK%sZniN8sQJ3LtR)cR*NpiSyy`ZK7C zY^@F^eGt6hHZCm$?tNb(S8Qo z1Z{EVuhgWi3xy<#CQtcfpr_72Lmt&&&Bc(6#Z-)KTig>S;+v1`Z%%(!&VM{g&}ASo zSPrr192}O&Vvzs;T1b#tNxhq~YjpRwWbHqvI?N_*A3->dJ$Rg9l(VAS)wo7_F#8hg zzIOtdUpJ3Vw+vp;yu+5=r|Id}T+?Lk)?E$A_a`65-Nsr6%Fj7Lk7Ux70cpQW zi_njEYNu@#prkn2_c+O(2*?XiPei6GZ#0$=akhtf6(12@q3jDZ6r~!j;4~yt+ZB-6 ze2f6=6l5H+gkBS$Hjqs8)S6-vq(_vSLp0g8>G*INKKctkhhH1uo*Ei!pEQV%(5osm zq!XVbK^gXluE80>DwuI4;J?POQM~gqJy4`F-$UfXSh0J+wr^!ZIdYaEuWEgK+ZORVrFtq3TPfWI;U*NE@75Q@na~z=iyQsTvA<<*p>OXPh)k z6xjfV(c4=(YW@Dms7*vO;FRvK{vJbny71 zzn+dtss5s0oI&H2hvaP=SBDQ)>Ax~jF)BQ#T(KRd@ymc?mhq&klNc!4S{&qW^APt& z`RK!Fw3SnMUxKZNKD(~L57!}eYUkC@x^Hvkkd0WcLd`(ReNz|DA$ItM>|0YdlKv#= z17!||Kjndz{(bA0v1+)HXX?rAj{j5xJTGs#te*H^UGSE~ttJz708#gbM7@LYYl@Ww zn!!jW;T>~!Tn^mFQ*Z4+(A&lbtY8GuP}H8VKr`IAU?}*!TSxFWa^UmGU`$$Hs&NAM zV0VEh6CD18|7M(U-`-UkF7UqNxU7$_S^5%!y=6~VL`C`qFB$iHW?lVFG(m7I8ja{ z7f2{PK6Y`;KS9I{w+?%joPgCi)qVVIJAHVvG~;$+o@4QegJ4x~KaHk&VHt<@T_pxr zefGV&ydXbTD&3^N{bDX_dbf;Cba-aJUuM`C4ll<#@hq=qP?j$Ju~mth!mkQS21{q9 zL#JdN44BjGm!=A344A22P}VLHl6@A$7O1WuKq@gx&1HS~7@oF7{1~!+8_cvSVIkxt%bBsIRmYYBu zXwy`vuB&RIq0Z&b$;zb#7tin|3Bh1Ly#L7&|`2aMy`;QvRFldJFk<0A z;RN|i_{>j7j#V?fA*_v9TD0*3y5}+V_=3@rQw^Rn5( zI^bGuTq0?|0yImp#yyvbW9($ofS4V#ry8u3Ce)+iqqmas2c|JdfxR#%s4Cpp?!@3) zD0Udnq}GG8ICo8qIEL$*%jfO%7%%AU(K5}i=l9&X|1s;DG>tTz`$!C`jpyOj?5LOF z97j?^Uwywv@fUiikH*5nLY82x<;WIclz6GhPq*xNs7MvX<-DE~U8O(xTB=OBy z7r0A*dbt&LKoD>TH^@LrLsb5vW^doxZlV+D3^jMH#|qAL)^De_t$#CVD-w9 z>D$2}E>3lRaRD)iPv%J60cE#D(F_b`_u{yVaIM`KrsU2^S9^tz&QfR=;`8Z0O%8AN z%DjHNufY|S7e93*=gSAm(NH-NG}D(zn?^t)Qj4lQhr~ChWR2$`uZ<`f`-Z6wGnUZp z${2bbXWR&VoLHz=@^1E> zvOs^{Z+n%D^edUt<`iZ^qC2Nfw<4J8NIX~Ml9+RW7oRtHCua<9uLN_AoI`S`h?z&N z?jy0;Ul#ThQl39#3x4DY4u?>8aq3u9>y?fy)AuX`zREHw2P1Du*%I$zM(>s-qzln- z#C$j{maq^~Sei4tW4CowJW6M|%_B0>{kbTV6HE(2l-N@UTE__XwsOG>D(#85i_IRC z0eb^(sLN2Yk9AIFtTe~dold__p1Zt39V|Abx@e~!Pd=o=V}&Wz*jCh(G*bLv>%3|I z%KUr4?s3;Ed@G&c(0_t{N9xb*V47` zJ@x0=aW*lC_R28oC(fIGc=U916T6SUj7ux9P&9RN@aT_zEW}rW-zxD2H~L4F;Yz)C zxkF1H7v_U0w;O+pwPzaDCkJFn%$G9GY$gLN@@``y7%2IxMf#DKvzZ4iRv?7i-aw(w z;y;o_@gX$heI3L=TG(>nl@pwX%<4gANTOeZq;4RjdU9V;|BO zc`Al+`&NudHw_QXtIqQ}vsjJx+8vaKfvOqSCK6rD;<^03HkBowb zY#zfcAAWN$j%7+(QkN14q}-HAoC1_s#w}TuvjKShMFs`541_z;ockigQgL{EL9^<& zrLx6x_!)cH_ZC=~tBlbx10>D*TY{h7oQ?59$K6~F-g81%)-Vm9Y9y-EqZBk`v?ZMq zuO}CeKBjV%`+$DK(@R8qc$eJcyT^;ThkJ|nS9df;Yzp4vOK%p|j%N897y<5D!F%. " ] }, { diff --git a/ray-rllib/recsys/01-Recsys.ipynb b/ray-rllib/recsys/01-Recsys.ipynb index 10bbe64..a4e21d1 100644 --- a/ray-rllib/recsys/01-Recsys.ipynb +++ b/ray-rllib/recsys/01-Recsys.ipynb @@ -836,7 +836,9 @@ { "cell_type": "code", "execution_count": null, - "metadata": {}, + "metadata": { + "scrolled": true + }, "outputs": [], "source": [ "from ray.tune.registry import register_env\n", @@ -856,7 +858,9 @@ { "cell_type": "code", "execution_count": null, - "metadata": {}, + "metadata": { + "scrolled": true + }, "outputs": [], "source": [ "TRAIN_ITER = 20\n", @@ -1073,6 +1077,13 @@ "source": [ "ray.shutdown()" ] + }, + { + "cell_type": "code", + "execution_count": null, + "metadata": {}, + "outputs": [], + "source": [] } ], "metadata": { @@ -1091,7 +1102,7 @@ "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", - "version": "3.7.4" + "version": "3.7.7" } }, "nbformat": 4,