From 5ddea3477f88dca5868988c9327cb72a77225993 Mon Sep 17 00:00:00 2001 From: Julian Beltran Date: Tue, 1 Sep 2026 08:19:27 +1000 Subject: [PATCH] results: record imatrix PLE MTP depth sweep --- ...26-08-31-overnight-quant-bench-logs.tar.gz | Bin 0 -> 38971 bytes results/2026-08-31-overnight-quant-bench.md | 73 ++++++++++++++++++ 2 files changed, 73 insertions(+) create mode 100644 results/2026-08-31-overnight-quant-bench-logs.tar.gz create mode 100644 results/2026-08-31-overnight-quant-bench.md diff --git a/results/2026-08-31-overnight-quant-bench-logs.tar.gz b/results/2026-08-31-overnight-quant-bench-logs.tar.gz new file mode 100644 index 0000000000000000000000000000000000000000..de8beefced720d6e80f83c35c6850a6944ea5c1a GIT binary patch literal 38971 zcmeFY2~-nl*Dh*1ccajLDrhsc6NqA>q99{b#0dcv0TDt}CP4<75~dJ`R#Ze(l*kxC z1qA^Oa{@#~LdI1(M&%)VN$5R+QNR-TEELaUdo1>&K=$`9Dd~CjaN$_gq~*I zTOn+89Ety3@fWY2Lk1nvBQI=j>ufmjz2M&QvBNF9%5NyF-PD@p^^UsXUw3+%cQ5qp zr24L*W<34HWmSCH*+@P0+g=}EP_&MG%8ffbVsCF4cKB4zFEwwLvrhUf%?j{S`ewpt zR8TJ4XJUP0t4r;>*)H`j?~?=B=FQr)gK}#P40L~4ZH$VxQRlVln2+O69Y|QUvivkt zV{D4IuxDjkxQVez#3@Z;5I%cbO49JeE$J_L`CoOf$Le$UzAb8K$%<>#Ff}BGpQJ$S z$#_rCCSJUzbs8pomMn4GjT;U+bU&o+U1Ub+2E7M*14_3tw`Arit;*>+=I~qNleQ-( z%r-Vx+c>k}-7*5{tMx9RiF)fcWAo$~a1ylsD)6Ln2$qTTj#{34b5>mI)E zZy#JZxz%j)!t?2Q8QxtE^Z;Ci&hk*Zw1pPd;Wd4{Exq&YQ}@|V;0_-{^X+b32{JLw zN1gha;+PpaFU(Ora(P*G{@#p;k?gmwm`^btUafC-S)Z=od1m`7s!PD4GseSvt7w>< z7fI*$gevxbR4TvffHlE*-WeS9zS(Sf;ju~5;zgUucWUGB?DyKR&pOR@$(BNX%p2wz43i?%-NxpX6z2WljPdM|xocct#P?)^Vd*I`* zC$jMo${Aj~q{Y6o)RX1Or&lg)y|sDUQu<|GuPyH8WvzopR}|RaR(n!;$*TI|ugBd< zfB5NI7T-yvKQyp#`Ij`>YMcHbsxDhO)2p_4cgOzSN9^~1{o`Ufd*`moZQFKPYIJ2* z52!9Yxv`q6obZ!4^u9_GbzrgY(l>Wr4sLRH-cFiHFs2&Wkhk#qC|h~gwoG(qyb>nx zkHX@B%I1e04D<*RiezG?a0 zsET!u7z5KS?Frr?DebX_s<5&$b!Mx-UVJ3_@mY{1L;1k8kh$D4!2m9*#C& z{BZ4a@|tyv6c24tpKs-|`oRJ8gC2IVoF~5@IjEuHINj!|aaQr{ zZTrxlQ{9$b3Njq(y1jDqArrM-m$7MD0gazyRCfB9C7pCkzZkb+<5}MaScjekIMX#t z))}W6W}4mG6RoEQCY z`W9Jb@BEc!ndk21mF_+B@tx_FeKw0P1XRB{mC#*DOrDtDM2X!uWb|Oc1=qJ7>zd8h zFG5E~L`2Mr1D>;uUuao&^*;4^pfuROCL{E~_l-9ucBk*@diVI7md76Deskv4rv@J$ zXobC<)Vet{v;JfGZ>dzH8=9w2cm!;CKvoTY#i5*HZCujfQ;(_*i-%5Y%b~fFw?SGjq zmtmBxhmC_TRStBwZb@}jJa_!TRFcWy8pDlu7nlAlOrA}Rbg)}tCU#xscFl=#<$LJ- z)e3>Cv_pTXwhoPfTb>J~+bNpF) z#BsN`lH3q7tLl}WUI+JbtIY*4odG-#z6`-S0UQ3bEyL}0_O^LL7E?qe?y%v zo>=<((SJcUeUN;RL5hDC+jTf9Y3JszYfF-v6`ZfmTGmc@r-#;0>#sFj6xxq9ngV`V(Ab?mT*k zEc(qi%|a|!-m9Pe35ubjDv+pr@f?DxlG@sF%#JBDU)*P!5nBuKA%7N@;_+GdQa zZt^Ea#<$>H$B}F=K=_IIT`>y4KkgnBk0h4RttSA&dEzj-8{TtM5|i?RE%Og`JO6OO+)k56&gdjAET^lMp}T)h5=#_7cg zDpzX4&pl8PeA(FL4B1&2cyghuq2tp0B<~j)a>9DeJ#yv?(wD6Jm?O+}q+cb|ixQht z?yR{~7)^hBeO;*fj=24c?T@8=NO4>62Yn!Ts* z4_zInM@KXkA2~m9+i7bMCi7L2{&a1D!v4C}C8)s3?K*)|L;IWvmkxj2ZhcmM&pAaY znoEA=R&~zhZpOUh(HJFJ!lCh1=PxY2xV7Nyxq0u-bKQU7KZ(mWT(QykSO3jcyr%La zkM7-V`II-76H{4(2U;$zel+1xeNes7CnX`4Lw$2b--G$_0_(>%)m-+Bi_=J{=9(m*WoipPTNv*6B_L;J#(HH zG~dQL#&Y%&H+Fv|iboALqFZ*=-cI>UJschtxHfwC%^9Cl)>lJQ?(Mik4^1|-KD&o- zONBJsqeE#3-M;PiE=`d%sH4*PZe8hScl52h&*LB4T-ME-P}f(uW9k{ESXG=~`)+q5 zvHUJq?Lo(`MzrH%D`5fY%HloS6#k`ckvor>@q1>E>JZ!F!sNkjrNBG22SsZI&o!&7DSqeVY0NUO0~Ns^b%|ycZOQTsW8zY(=HdqA2bKGp_DpmfbB?Ws#$E)R!T+0%^C|oNoAGZ2VzC-tAYKNqTqn+pZLfd|tz9oH_`q4d08Ccd`pd(Eu^^y>ZiZMFAKe)hk% zV94@O*9&9A(STJcX}xc)UZr|QZac@bM{&Nd=)^?cdvHxiM z1*Ktyb~Eo5>U3swzpJfK#d1$c@ASLr4eUtOHb&3(y#B>+&xf(gK`TPuw0!;g_=>h5 zC;#=Pf@kQ4=TA&)N={XMcv7+b5^vp4mnRB!UtjZC3{^Iel=kx%o%rqQ;%2h_R{4&$ zGvknFuaDH|>sF)CVxs42p@&%DZyN6T{P@LF!V7jU-d!8~KDK6S z$Qs&;MZ5*OG&6SO2M;`sHI3LlF?D6X#<%CLo2ytKB5ocWJw_C{nR#q&-v0}^*r)(-I9j2MH4?Q2;3nUjx5y~pIn93 zUfCg7TyUI z$rFd|hE2|F?CfnTs#D*b)XZxMt*6eLefd@Pey_%bU)Vv!?RyrUoS&L?*nIaXFwf z9QYtXzmfA4(~wWg$COtr;ga8dTxD|qf^B<0?0=2D-!NNJp}x2KI`mDg1Ihu?Va0z) z2UN29BqjaDMNIt`vw6iq)HJAA`qOK|H%!AxpA<-M`M50K`oI`vuEPIO#`Nfz^;8vR zR&I@`xJBHHw}KUc!MrFHxt?7l)N&GNyA7~L`*&Fy0D`Z*5xONHji&6H$ye(Usm88; z>vaAt8>peeBuKYy`ziUXLnM^0x&l^K@TJc2sb#ky{(+$3z2vstyFA;9=MR{oXZ(9lE@2kpFa(&5`clC5q+q+t8JcgAMJc1sS*tOdh;Po}eZgTL#^nF}ak zyLkO40vp43xns03lmhE+$S$CPJ0evoem4j%6$$06JmF?>f4O=5HieSi`69JGPEm|> zg;Gvz{gJQF%GXU@tT!eoC=VVPknDTt+7YAehS7;B)a`mX`0>0 zM6VT3O;4|U8ngUi3`dRY>3>>~a(7h4C2!Z|y}^gteQn!U)3+9R?#Skyk8~)qI~GwS z%S_Iy-)b&T^;Hos4$e8s`lYJrN9l|GM(d@7CtH)`T{&CvnuH+p&f(mBc>;BZp4Ua( z&&Lf^*jWX}(fuUg zlF7<5*+S;*){Bu#sHlTcl-PO+q=MG0Fd=q@E;=?eA|=tX8>FO`J|4+Rb^G2aNd4vy z$O3|NL{Nr+M5% zI|sMZa(bs6Za2#eR3Nb zWtZs0;U-vX9_DQ@yu5gEr22#I9dgC6S~i>A%ZS^`>E5?HQQEusYQuZ;#wZ;}EBz;X zf9*r(kNqs*t*6yosV*kdRJUjDFX|{KJ>?aq$ zPbqe!U7sAQ*js-~c$HSSN8SAD7~7$Uw$;TZJ7SMd;FG7h{d;X!M3@p62QGkoeV1G& z^kA-$AXf7(>=;hv-wG7AHcGJ=4aiXV2kxTAab2ZuBI^?=yST_|uRj;^`bg3$?d4&1 z0sY*D=x4$bo2wB1Dr6=yI(07U=tUB=E&}6~xygwqiYjq8AN$r=3%Dm$=Pi52Cb0ox zXX^ch;~$a`_wm~lZ=&a6-aGRD~FL&L-IvSnZ6AbDKoMG2q7 zg?JMG_-G!cgOmq3L*wYSSTV$_EaeVSh?uc&5601B0b>&Xrxa*xTH?;ALX+)aeSj)U5@F;Y;#g@JaG(GKQ4~{O8N$L9!ag zDT7M+Mai&Ry))GIh@tciT;hkszkmV>dnEqQg13ATRQFNHRaTmtQyKgvl5x-@ZF9cd ze^f5Oed`5*XPi)tc>+>cv8EhTChHNkwC)L(IWXvpBcVxLoi_<0NHnA5OszOdgmC?l z2OIzS_fH1?$-qAu_&=BdQb1G`5kD#VE*hB0nT&}k;7M_5cD`ax?Wj@-h4|pm4pUkl z3pyk69iQ&VNR?YS5h#y*cgxP$*|A9W4}G!il+oKZw(_yw(T33>p`U>)98a8XQkRQK z>2dQ0fB!%DRsNyRe=_h-2L8#wKNT6zLF|Az7m7@9$@mPoNKV6!5A@ z{4oZkKs*pizW2XBumAsxshxKyxc`**DuQ+irYlNxOQU+~2h9Vz$SSGs#buGaMN#&} zb}j8zcJ@L~3s!=Kn3XquYPni?c}1CNMfYeXt|?CmDyxFz=&2Ro)c%X|J~8Q^??N#p zMFinxv%}H?9&^&avVtg&F3BR7G|AJA%1R{z1vX=wGY@s_mg1O|+cY2}Sxlx5ZK8mh zn^c_F=>bXI*}JPf>ECTvk%q@b1EQ($5~&ZQrX~-HhGe)Oz2Co235Q|~ItIxl=*sYj zsPT#Fnf{y{G=Tt>OWX2>V>syKp27&nxcrX{`Rr#3gCiTC6|p&7nTRo3CwXS3gU`>) zBalc@GoomYlDRnJq8W)89yQa?=PxvdaD!y-h?7;E)QN*$cB0ho^5oQ!1F2XnP=>-^5seJ1DD2v}P zG$U-_Pfhgay~_3=MBu}McFR8I@Nzon6p=eW%CN%FzcC+0Ac+akXa}8?M_`oisW7FN z$#{%LeW@n5GOB=t7jwFI8}AOAoXuk<$8-Gi{hBJfWLc!{QSL;?AiBv9kIu)F9ZKje z2L32{p)sS26BQ9vKo5_Q4vdZ-DSltTA#eqF`gbN)KHk9UX9g>qt(Y@U%l~F-EOexwW4*o8Y zCC2$VVb`8^cFmCHJ9W*2=PX$tA`vsRmyJrI?6udNkK0TlE!kvHwOjC zg;RGMqwE|?xM^6;?CmB(vog%|@MJNGVj`6c3wb5vK`>AK3j64~SWPECqjiq=8&VwrrE-4dxy`_*eT zQ9EQaT|G)_67?t5c_=$;GVd2MPn_Rk%QJ|K5f%VIwmdTibFFJM!xDmdbF@4@a z&4`>m8?yJzRGW~c=`zAS#j+_SXkMyr(F|^j+V{!CQ6-CHM2`vx3z12xg}h`HPk+Bg zbmpRU()&b*-p}hDa-CI7j4Gl+gYZPUyv~N=8-14&#%NM9txj6tX&*Lbn8Ya2Yw8H* zgiWUg{Foj}HV&GiD|BL@>1Z>Nru}<|K^0FlKW{6kPy4j6$Jdn9h)cC=oNCHVd8|BAQ~x8cMP{q~@gCy&bG3v3Rw=pNqhuLx77U;E9IV(0+Tq`61HxigL{C zs(Sw>mk~6d+C&WbaV@>k<%@PSG$0usOEW0Khg2IxGSEQME^ z(l_>lm>2Q?8YH*;Op}ZRM`K!t_31v0@Q8r%?=tqqqoNYej+Tg#LyXc%oBpDv>uuT$ zQ_~=MH2Cf*MzY5RGgaND>458$oL%!u(=1Mp$C~M97HBr+ zQKm~VtwdWB;#Aeei5{_?ty#eC@#B5ila0Bx)$eQ>FL&BN(N#7-|7Z}h8XBhhY#`~E zMb%@{==lsb?ogKuH#w%nB$-8~cfBHR#|#fORI}(gSCp(wDvzU-u(i8v${FIC%Gm+Q zlyF!|Hw&Js-c1PnCaVpZJWn#?KKi6C`=;=)qR)EE>>o|n2fnq5&0Rp7cGXqTNj0v{j{+du$T+gt~vZgVXr5l+YxjE7VRh4g4LE%EMn?+5!cJC( z%0RzmwxN2aYG$VRV&x0XREix(C4}AK&K7f~tEY-}W8VDW<$3Y)WakZt*V}pwjwDN$ z;!?cOc`g++L%Qtq0oEo#>oDhesAlcPV1^DImC%oIRyG*v_|nIlG_Jw2U{t}(1?ib(B?)?O1}5; zF^#_Jk&^?WvsV@*hZp?Izuh2!Cpvzs2wTn?7sv;rQ=^As^@)$=a!z9vG#-P-Gp0#V zZ^Tg7q`zpEZ3_7{;bh-m+Ep~*ECel=Nt3I4jCNIA+a`ob5z)bhiVG7!ne)W9#_v)c1jr4&} zTt#RI{DeH6-wh4*#c}h)J<*L>d5kV%gha+_lzRD&fBTD{FS?{gfoaHJAOVyIYv zLYwUZ97)iwuFY{Eqg`BNKrT$N0t-e4Pi(M#)&1;#vcFg}Xwtg)qFcCoCU1gSME0bU zJ-pqZXRlJVoOYi)Xn3e@^WfpN{c1YBDH~echoUrlq!azNO`le6h>G06m=!>B#;nMI zA)})S`P}YfwciJP#5^jyA~K>_Ff`iFPA~7%Q))S5QwdxF;4;UUw0vBD`ujT~?eZgRC;N3znhysHahKFci zP^DjO2n-UzU|itcDKNOM&TuC<^Ty`EPrvr7tp$Uw4};w91m3*^1}9#Q_B7~srFCj_ zzrJ6kU3&xF&=c=ga1cH)@;uBtBDCt@)szi3zDoY>pKMiglPh-F_!jzoJ$x^y?`3Rz z!*5~UPeTgG17Lf(>d%39O^UwI96@-YpQst$KDS|C{| zJdap7gk?Diwr|8PG(42nd4cl^36JoCw_o4?eGs|oZX_Jt0A`@7|F1qZqj7dY@F zpN9N7NpRH$>k}f!oXyf#b`Oc|Tk6a%u6Cys-KI93v0!=TW{ecr|6d$#2iN9-sfB>4 z8G)&(gQ?vGQ#%Bv_H?A+|K_khm|8NJniZIu7MR*fFtuCMrp^N_PhXI=|L=yQJ`&rx zRyDd5vR&J(T&_LO-8i(1DG*_9m9nADWpvF}VKtqL){K(LR0P?OH^gvx#8IJx-%g6Z zs!!jyKsVvKiH`Y=XdJ(L_oX25^^K;)N@$;kXGe(??I!t6{<&h>h8`c!k!NkPswtD| z9K!J%HD#qwWlHa*ZGyi`dP22-8do-32-LhRE}Mi86IG2)=I7^efjNTu`$W-fhD0_v z6d;JwYGKkTsfDwwqhgGemv|WHM*fC64%8@nXOrndkWva~MELAWA!S=*vROpgD4Qwp zGb05NMFUfk5%UcMO!v@PRSH+OiaE4sa}L$WD~5wffg0o+zd}zw$e*Fakd*%@|A9jk zR6r5=Gau=lh3W*V5#rnaQ*}+@NvS^xtjA=AV`HlYDzWj|va!`R#MEGpG{4j(vRX>n zCO?52f11AwTHVp65+~VgeLFl7SK`=eI&E7VC6=#kY{#_g$tttzCnLkg`zE_cp=oSs zzPKu`J5n6f)96Afn%!q2sO%18WVT8v(COk3LKk{wuhXQ3N9YL?$@`khi}d))@agyL zz%{qysZr2%f*3b_1x*lL_b+*DCM-g6tz#BF%gc_>AVF;+F>X}u`f5*^R97}ICDMg9 zVIG*am zi}FxY`TC9_el0^R;ZKEkv{e=CNhP(#g^8LC#;5LDN-uVc>4JRS30bZzD>%~l9_l}(z`*@kZQn8AE+O$^Ddk}=8bYNm+9FY@DN zUbD!u<0US+$zh|-G>qIlZ}xaeZHMWlN?n&YO6hNXjb!n~AQnmzA@%6@nQ?3+qdIVM zmeetg5nM!CYO|GmhxD=kyG?oN)@UEnAQ_q*;kmy`#B~uL*gTb~o3Uy~^gL*b;LNlEpPpKv^nfz_K$Y+^=-ln*C_pt~a@Br6=M%Os?MnUie=ll@hb z&1i{qcm)5vg7TDc?hE%F<(q^~h$VJ~?Iv;RMCP1;6XO2ST8F_bgBnxZ@c9$sTUNJZ zMg7_@oKV9qxdMpOMm+3G;tOSQNBxDpAtiUnC|)=VmlEt~aD>p)?9LgG#ymjr{J!8` z1UrgnYPad&F=AeB5;bWr&J*xm8`|)era)U z@!;J6Q3e9EJ-wtap<-M#|n?51)d

|g zwOUGIid9c2hZHk5(^t5Eag!R0{0=x4vS=sZsARE)=j}xnn-&_ByO9wM^Ya;B=jHU7<4#5lee1Q9g|@uBZoYAp)7_VzfM#VxKI8w zg&h8zf5-%_`i!|V@uAOqj?=dIBehyzE82D@#zzk4A7`62JgiOWvn3UDio7z94Qx!l zH22Zad@Qm4h<@_(#GQ#GpYP8T-Q;g>kv$&F)M&XRy=-nXb545M3GQI?u{L+9ad^^8 zi4SMHSLSa6vg)IHZI5|q>!g=4&ZHU}y^zElRqck>p>Rf9MH@Ab9I^n+g6HuC_bejE zor99Fzju2(5@KjhUEpxk2|^4wY^pnakXCX=EB=9Rd2r&fqs3pE-FIrwwBjmf^`0@^ ztS4SF;%7V$lWSAlRMA+ipa-M)A@GfSN-W8>v##)=$vF7TdQ9>7Uu)0F4PJZfoygjA za);NRuPL(jl99E?9zfO}{jasx(Cluk%R6|KJX#8`;}LKp0l@N{TR9uC__hqb)(|yE zCB*zW(~VD!A*14JnW!_gV*@CP|7VcTjaWqvJiWjlDj^0($W^ajsBQr{A`?r?KEtyxNLJVu zU&b`+a=wsQj}`R{>}R@}6>xn}g~zne(z8M7?mG!Htx8K}Yw;T%lrgiS{C+gOR=p2G z$H9S_`Y1Z*W&l{;^_-j8nQT7Af?03NKRGIueyi2=%h#mXlwiX-r5CmN) zkf}!)WNe}NZ~*4*zBEY{id0XmHqT>h2fI5!-X-8%y-<`70 z*{|SpQH5KQAJKLU?9XxI2QDS}7ai3?N1qkjBfDgeZ20KkKFor?>NcFJjU0H5O*%4w ziVpSCN~Ej780H7w1aWYtJ+e_C)4ObiaHc)7*MUqYz5EDg`WUtkWZGkRC!FbH*nW^{ zy%3P;5dWg=WOvS9a9J95N@b|q+l~+;FD@-P(@23+#6&uyEwn5I zhGiCCv4%O?0z;sbF|tS?0yCtSgWrm~_)(O>&99NU_x5MOI39S#pD2;a;_-4w_l|5L@*)i4|)r4Ov?Jvo6NAk{D_X^L@ItY zTQt?1!B{XJD4q1)OqE?{6|JfBAsyltt;q(QLRYTxslceAG1xO}l8$k}Jc;3|o$e&w z_=M+=d?!(f1{k8LN!&TY(3zi`$mbjhrY=#mV8c6r+ri(2)0xn}@>)8ZH0ZaJGE>Pg z=kc`@(XRlsqiH$U(lJ#$drygz`Z7)=s_^K59#>rQj@RxnoTqrh&qU=6_)fNjFUU%$ zku74y9v(mmq%nnHJ$Rb&1*P;AAtzpSn11&=fPJ_%#C7Cgt3}ZW`ZL&VWx=(fwc2O3 z5+HmP-%7^sAoxqa)OZ4nPR-Ev;WrGQKRu=5WsrgT=mSdVhGFU_5h$KFX}Sd=Pr^0i56A1yU|RpM;kS zW=ch?;Z#AJ*%?6Upt3g~+ubKM#)H)n$=U3ciBgtbKMF{F6b%+k4!BQ%;Zt)}wHjIr zgi%i;azZ#B!yn5^&UA3746s&sG@Pj9T}2yBBO$~9td)*lDt|FJoO!x^d9Z&GJaZ#w z8Xz7`31DYHOE2jc5J+|5?!mVX%vuMqd19Q@I1u1d&od-05e};fxdsXWf1;9c7!IHP z4AW+#z4XEmHFrX00k}OCRO2D4??lMcXUt--V7Fk4vBiw-L)1|~DW=$B^I|{vly+%u zv%7=a@M5rJ%0|#9X(QS0Bqu=hF72H4SbPJOuRKJ(NDkTXoEglg{!B)-)H1bB(~b?I zk}nPIOr`t0|M$R5y+=WCVxuRhnt#QXF}1+ALt?3vToEW^+(B41O4o6@Z(0DU!$Q#< zS*mIP^yixUkHh7ZrZxlSM2nhncmR4{2?mZkA-^{Y&gY~7as9=;+nq0@He!o= z@Ee-TnEG9Q2aE`;gY4J~%`^4*9L~+m%^f_A0D}yjY(TmA4M`a;B9#kZHwl4g()r@s zOF-~#6c=|71pkt?B30NCn9$Fys#>&wHkvF#Xh`dP(EbjK-rPBGZ z;SA^3pmZzN09Xso7i{qtL(J>1>w_<#GTQAOZ|#DA!_P%_w>9j7kN)|AYIru8$no&f zN^Kg^x7342z@Z>Awsco~BNpESkm@x0^m(H9C$Y+=hEuMU4A-ng8c?7QJca{-INfFI zz>>dzmPl(95vF$88n9?UzL+`*3}_{tt=LSzl!zQF4qB=JaQQOYouu03}L~K>`~=f^P|88Kf{0+>L=Y45#_jz(}AbBS^@rhmk<{hLON(Ly&+ifRQlL2_wP1 zV;fBULtXv9qOh6qWb@Ymj#x!tJd6m2e^~xCFqv580ifHYrvL9lL1gpNzhW_P5}8qO z60ssAiOh63iKu8eiNS`a;3P8B;Uoqd?t+upzuieta+GXNeyO?{t0<#_H5s@jLFRiO z6%Fzi6Kn`{Hds<`oZDj`!kO67>3ku+(etiT1AN!}*8tca8AR1w0GKeM82as2>3jyN z=Bu*LTB&rks?mes9=jHDZt8=*r=tf8hav|`+x!kVo#KVWm8yPG79QoSp|9}$qAOJZ z*i-gJu;;tOsrniSwx9^mpFr@k8Ts9EFzQ$IIj%=9-+2+lWZ7M>xz%apNoBTJj_2qcNWZT(Zg^(>f z+!-O;VjYBRJN5e!vSnwULC6+NFK6d}G1>agk!>>Lbg1FY(bK<0ktCHWIIgpDYTdbg!yHQj=*|}NV*RM6$QwY z4M4+~1=))q!(oxm28UrG1B&!RI9y3~{Rmm+QxunglJ4N*9tIn(0!TT}@-{5jN zMgY^v^`4ai!H>!7zCb=5H)w>9V9lmfJW+*Ke+mnIx8Z|{3V$Moz5i%9T?Y7LFrh- zS8dC8sB}ILB3l(kH~rWrQ#33ypbLSj!8!b^^$>2{PR$k`$~k2 zL9A^9sKY=hz|a6n0YJkmGY^JFBFzOrqoLIbK*KB34~9lVD;7Xwmu*wKG?t%>7v6iR zI@s;)5XY3y=Qxcfoo8`@TA*h-w{yOAdv}~-(f})uCIQRyxuOjPsxQpB6V&AiFsGTLiO2Gqe-1?~^Dz zLa}!sUTih&5K#1;h!^wV$?Spe(+gSfoSEk+0@?&WN@dJ3FMtC*3Z^^OawZL66C~z3 zAlN>46)*|7O2GsRs?=WtzzI46ZJ)LxT5_T%W8tfOyFi@eVM~a9147atgm!9 ziC9HAiJ%99tS?14iNS{T@cQcCj)34tv2aO(_ zvM6v7-vpyy@>*lxsD4p_g&(}@DUG3m-2yw4uYLz`cV^^QM-EQ8-v?L&qmBc-#Q=#+ zZ_o$e+^hsP4+b?8tiU&f4H9ZYdn`DY3`@$g&y^z`!#5r)j52{}x<9yI8t9y(dLEfo z^aZiKG~x-hh$NzXm~qD}sc(b7dJG0QC$( zLJfihBorENi#UF|FO-n6_h1*3uECrOh!d z4q@6VglSd(WZFPUJW!@P!)9O=4Mev!#{#jWz4EJn6WK5?-3QK)Vwe+A4~LoMscwWD z3vjK2895r(1?P%84}m^iq5uuEYb2@0nrxn$ueu4V*f7_$D}V{voIEP{0Xh@~Ayx1x z-Tt6y2U2<*0qlJsX;D)4-vL{4nCw~rxBkH8Le>JkU<30hVQS{R8KC?Zs(@i_K=GBt z=&5vSPbLba#uA?X#(1()$kY1kiePT7*w>t!>p*N5?hdj6?9OMu5BL6Zapqt0U>En{ zcrfDPmRT@h7x&@#GK4^v&AGT84=oTEXYL3qS1@XixVRfsup+$-&Tj@48o0O{)CR=G zrH@cy7q<+!IPL{h@aAYlJwyk>OkMUleM>tGYIR^kX}9tIA%|fL6cY$GU=yAJH!Fa3 z+t+*yDGbkc#UnHQ1e{t^N}H(%?9?cAP09foXNH1a1wPlfboz z1jZv07_^pP3EYH8V5PrFV540Yhy*sbMZpp{&zu>M!alGRhO65D%-BV8vzX^TwJ!&KI#6Nl0GN+)_6`N=lHmp7S~TJh zq;UJ36m~=id6eq+46X{rUk3I^!{y2w6?}LQ#Rf{)9FXn7WCeBLCGa_ApLe8|`?xk- zzl*p$gY&>rvH>Hz!a?lVHAoQW=9?ewuys4HD?zN=$MdIQ>vmpuuDkFt5V3A+m^%^c z_U09=YQZQEv2Ly`UD&$qNSKq)t}MWMBEJu(MTm6+=fc*_D4`dzZmxDfrA|2iIQXWfw9|G}9VQCPkS9)OVjU_wUB8kqa_zg%4FT)%;bNMO#K1ZE==m_H|h zDTo9H&z67$7Cwe0@UFRjgR3plZ!pqtLnLrbrVAp0-*_Ps*hqgAk-#;XPOtIf3>7BCW6j}Ro})xk)>gXTU! zLS8M51UiC*5gLpHDi1*d=QWH3RxE;q%F{3sME!pv0WoV~h6}+Y=3Lz0of$AkK0xWf zRqZdc_IG2a2qzJ=4&WsAe}udpQnp|l7712476JPPo}sj< z+YjIP8v9tHN|sf#VmHTtCYXww!TDkT;@dTy;CRl2tQsEA0r@5voX=+W@qiwFEV-y6 zTLh2usBm8ne1ZZ9@SJVz21|>_5@4Cx_1CR&PH*fD-aG$j#Q_mj3MR(!&h`7F?DI=T z4KK)cA-#k~YI2h(0Orm9oCyk_9;g;@;e#0!beCYlMGD`sxxxpC7%6=JVe;k*Ut&01 z`1C?RckU=q4shYq3n7ET*U%~hh0iNf1GF}e0PKRo=as2L1%)rs11zc_a9t<&;TvTo zMnVU)GzRPs=R1lBvk^JA9K54=T5O+11IB1vkZT`|<}NCCiXU4oJxbZSCQ? zXAiLZ{Evz}*Xl#X&$asCZW(Cx!5#^2^}(hEZuMb{5!Cq9z^HL|Ku|MM2cw3XgP;Zr zyHDB(X#W7zU}5)(#UrR;31QT@8|cEQp$EXIp`sDg5X+FB1bDoIH0OM>fh0#-lgHqz z!qp9#45)6P&kSr2;J~@+2Evf)28Y4b4K{Fab%Vp<>INDOaBm{L7Vb?bf|jal7GPhb zHvvC=1V#<%O`NModK1b>Z(`;oi{?tXYBhCQg*k4d&|xj9NQ35P5`9567P)ly>26fA!YI$DW5?| zS@p!H`hWq)j#(f z#D4Px>h?511JJp}(N%PdKCG<-L zQg@aWc`uzY(*()#mDIoUNtKuna{VAIWlBajFVyxG_pOji84#KwYw(BoOsrvbc8-Je zTl1ac4NV~K_&wjB57keVR?ti}bl*BsBKRmru{~H-?EQ zklfz}l~*~laCheFCx3qx<;yNRZY2CNN`e);kmFe$oal^)UyMF3t*v1vvs-u^et|6L z(qAt|6BHVgd6P`G3a-MG5o(BSE2l|7PMTVh8GnDbBYM#mXwaWPGGWN@Vgf_vPp6u_ zw7Jd6$>DLh;1>h3bK@tt>SnhT&!4&5;f=y~DF4i%!m3Nx=DZj8qy+TM7g==JIbW}Q~dHoW@+mwH8l8ET7$of=rTU66l|-2bG{vV^T*P}% z49sB32HJG43nz_OCbfae*^I&bCR`e4#KmP4mG4K$^6z$@^&&)-(Pg4p4+7&|V(yra zm?M_PHK7SJH3pvGg_A55?W_*)d*3KytTv;Z zVJ{9BOz3XQNvUX5*0JH+_g%B-j3erxY;c~q+w}Ozubk9gy3DXrDopMCvdI4US=NUNs? zgQ78)rm{b2$RxuJtXifH#)XeQ^Pk_@u)ZSaLs?I7|MAMksy}f5t2Z_(*;-)%GRZ(S zD>->G#%tfFC^v4~p2AOdTRRrTS?6nZr(n5xjENRcc6zU8w_wuTrflGCqMb(M-2uU9 z{p4;eK_kjj%_vGT(5NQkUllcBrh@6R)NDZNaGxqus^uxkyDwHy6l#C zLOy1@lgl;k@^|P@lMa7gVxC%&VWS8&2;0~OORQz)S=JSigIYD+{;3tEWu_66-zCAc zw~{xS7enONjC2B`3{#)vG+7g-&2#+Nu0L-wU+T#}B?lb1@G+m}?Gm5qg^I5uhMe^4TI zX%1KFq?t*2cF&ASvvnw?Nuir3P&$L{ec!*mC$b>fkE`dW zW#(77qxl>7^8B#r=zff5<#E4uv&Wjkse$h!oVK^oS{k^`ZtdF`-8^3BS>QfIms#|4%}2LW(#w+ zdhEEGvoy(F+2)t7O)1)zYUR`mAJIx~f6xczoa=ov{mCU;DQ3~__wXWCxrq+0JSrj} zLJn4I&uk=nH?B3Vu_>D$LmTB$N2PwV=fj=&q~YT@f|V0tRE0jY^_3#yNN3lf>F>uP z0))eD4Xn{Mj7QTyc!sN?`*`O%aTd@OJL?PmXbq3?< z*9g$53Mfk=!{SFc|QsWNFt=IBAN)O5Ml@+tr#!~Nt6JQgk<0KeVaOT&fI&?xwq%P z+kYU*2Gh;jYp-vu-|vgocEGDx?Z9j2Tq{_ZKXjSd@?A(VD3tMLVTV{#<)wE0T>@|B zY0X;!B0cqcZp@q0DwFG9$9U9GR@Im$X=QX>f?gIrap}AzyI;HKiefm~ZK1CGyyCKP z)0r_|Wa;ro1vhP6*UOFG@7!UrlnH07%?Y=>yU**-SU)$nbiK10WCj|T4j?mR$9A7r z7@mKBQZ~G!bc=3y$+X<44M;Lgg`e8w8o{OJNi}jwV~S6VqipE9N0Ea+&m$#1SDVPx zJ7p!9`YhvQV_zmJZJT32ZE!YLuzk6pF_@0Gb%C;wdUlA^6AX9$M**k^miA)M4wPkC z$4C!?mze^_grO?k6|@C|d)lnvAgjEFe#gt9NSZKtA0*8MrFMrH9EV#RbnrzPXcx$F zm>*fNajvCN@+(WjiSPEQXOqWuahhbWPN1J!iL(2 z4*oU`AN=PVvj^`gcRl)8!Sjm0oHwH2t%`5Nwg@5o481WhJpRA3@n0r<{MR`d{|DjY zpOlTAZ~dZd{Haw!?B;UWi>LlK%7*x(|G2Wz>4KDv*j-rJ7`$TgdHgSxjel$TwScXv zQn|*&XjpD&2f4ab;zZ&g*T!OUT$8@Zo^`v|l*t%qZ6R1$wjdKfnWWnqD4Xz1z~B{LK$eAp;*XUkNt}G%L*BUY)==A{C2ix4#o-a(bLS_sEVh84v3>a4 zqh84!d#Sb*z1gnTiu%l)UdZYTn0aE?#p+;8c3k#6l~uA-CW>0buryz*leMwZ8YeR+ zck{HXbz7(*Tc)?@ZHh;y%qr7u_L_v2d1_I1BJsCXf@aNG<9jxTRTYjYW87wUMOC_E zo3fzR<86tan#d%s*gXFtf@(+*C_0my6ibfQf7$29_;faHz zocDMqRjtuPFuhDdPg7c58S}ui=O2vu+_E&iDKML#O7*V{J+(BYJYEtrb-u6N_@Ut* z#a&f9=EJuX{CI(`e=JK*VJ5bzls^X!Hqj=-irXflwzQ2tFkjT0G)B9OWL6|=Swbz( zW?Jcxn{W8GdMS_7acA9iZC&t0i`TS;2TN<@Xmy>QtVU+%qv@)F&K_!xRy(u4<$0OO zL#Yb$jGm%-_0UT}hQuxlgp}f}BQqgd3F; z%$knSMw~D|5So{H)&y@bzioBe>)Cj%b%UvhYVK*Q%ljcb^@RQ-&ofgoCzqv|PbpJa zVa>dpUH5#L(}4@coT^yePHL+8rl6y;P_KXL+c?!eICZ_UGMHsoChYl3h##Yt*K|nt zT2Ix=0H&#P+p*M;D=Jf0m&&S)E9~T&6S|&8csknjKdTJtZ#%A2D|QAi990teqr3ci zy7Mf1cJZEQs~ROaQ>kaoY1>(^u+mi8p^a0qqrw@6oy3ySxm}vqVoNPz4_WJzD>AlA zZJXbl66LbLiEb@VYHI)e@c{j@CR3|O@3p2)m?@I358+g+Xvnva{#gpccSZpkLqfL% z4UwdysQFTzF68X=&YJ{0|2>LJ2bxJXtd2KzfQbQK!md1T-0nO^wmZFXyVFH_owr}n zpuk6Uol|L_D;nO8XAFNUaG_{r!G$S5W;bXZPlOosqW7X&%Z*Yo+ajci$gb)hoNlKWslg{rjibJ<@RI(x zN6jO3I~`hYAX`uh=vLACD=HWs!+{1k5nyT{_>f8E#Dc5>>cw)ZD_^sV>VVyk08+hB z9JPU;ia|7PiUP*qJ7p;fE~0TAQ@pf}{hD1~07*9*A7nz$pJ!aZpp_GwKux2!$<|UV zgs5xg)<=%U0w-ENf++;NK^RHcE2DuTOZ9c#$FW{o$DQO(Oi6z}e=?JoYQC+bwKF(^`-KIsOyvDPO%ir}1q8M{|qXQH(vyl$9Tkp%Hw2OZZ}#>q%+Ap6ha+}oRYvp>Xf7ukp2Wks zfrraP;IDwHaaZ_eBQ$EkP)ePKCQ73!E9d*CK<)ex2XrL3 zIKb${ncns4>Z5^Tvte%;z%B64azZdIR$Tz*3iOQ`+$S-}$&kWdFE*yB+PGb64^K~m zRsakyHjTNA7L+pX#{pS?tauPfj0i02C2iZ<&5>j z!&`9G;cGAIJnDrWgU&dN8lrMgFSL0QUwct;=n9Q0z}KESZuZ)PuCV$$LC_!&8Uz&hk z{D+)D{`^=kXfK>GOoh;7Fdt3ij3FvS(O`qLmpl{FUO3jLkoE!u1ZXc53(#HyVI+rI zwa8aOQ#d%EbA2VyNi1%ZM3*C?;#V@p2#hMRj3G`(#s*?ak-!0?%dW3-VMw*tYxzXP zLjV3adQFsh8sMS@X{5@-hyjQphbSTOR_XCT3- zMtKkmMt&X+STF*(9|;$`L(U@pWv-ktYhpy4MN#V+KL}wl`_vqfBZ`b##KLoqVHO^+ za~!o@WYpq2MpPadwZGgkP}E*SQJX;CeeA4o)E>oADfa5icijxPuC0?9?`X8&P% zKMKo2j=QyEiw`1hhRqFD*O9`3MwOGGMjU`YzKuTbOdcD@aU(|{()5zkHtD2})=SSu zNIf_ctTf$~J5w!xf^SA+ng?vof(i0@yFj1U^Ah@|N1w;beokNgjmyWh?=hzVg-=7fe|&|SwxL;6(eeW+w(A@#<)L<=E&t42Qi|?S&R|2a=~(p zs3{xnB1Fv>5H<7D&z{)sI>8966L!7%ezd36fjk(J%;4NU(8TfaLi!yT8EdP6R#RbM zW)=DdjSlx;tbp9oY3lgUnL!eu8}Oe6a0+2p?oS{9_)CZHHedOQjA`mcnzG zvV2E}DNB$_fU=}v%CfcrQMbDx;(%kU?w;AC{lxB=437Qd}h0Bp}Ve44%8R8Y@$QiRH20~V80HYv|Vvd|Kdu%F( z*HQo(2lOZ%!)qp7C|cl4H4cIv!D~4fUMrsqueo4&4H!Fs*X}tYc+CPcc5#dIFh^03 zF8I=ak}&{T1=teF7%;O_k^IlqJ+_XL{qdI=fXAdkOrzN-_bn3pDFNhGQiGg~V2lQr zmSZ&d@F~!e0Szua+<+*`!?S4cY7Rz&FP8LRG`MszMuRtWfX)cl#@Jh5DCW$a3n+(pd~{yl6|p61d*UVha#cjT^tF~7-QtFN0ERe zqVs@L;7Is~L;#0z5lNL;zJB+>d$oTZorK5)tCr<7Roe zU&$CqzaV7{7&W_){LkU6Jt1f7N4A0s6F0AA$$6lG?kB7mfJdjBm)r;Fde|SF4Br~; z#s&4^nex@`;ElsfIp`{my{jZud4Ca9H(9;B9a z{rNwYY~R7jmH`YiAnguhvOR#4Eg)YAX(y9y)SP77%wXeW8)S)-ZIlW?89>@4Ai$wy zE6K*mHmU$b0tjk&d)55kI@w}crkSK=nlUXS!L$tIS48Y4U|L2D%Y8_;u4J;sv`hk~ zWf~&MWQ%DTAT5!}Q~L`oQ~CODg&|F03~3BwNb*lecnxDnaph#$jMwGXt z@Y)3CB-UY0A{}E$acfCV0%J(lzhFq!O28_kumXCy$Eq31r)|x^s^Bv(+=SB zXA^G@Tp}xazDkgP=kIzG@%a>&`=CnzpFdwUbQC@Ohnzv07`pr}Y{~)IicGl|a>gwB zLz;3NY|8b~NKBZIG2ujv3A>`u$mhVa08BaN987pXxD8{%6c3CEH$|Spn6Ua{9L9tx zd+o6)7YR!qz=XNLm>`@7v_ovl{WH4**h~U8<(g5tnyNE}F04iWmW z?!%^BCpP5*0E>dP7$2|2W=*+nY|4dWQ?7|LrQ$ABq!B`YrlOgT@u#eo|)0e@;6 zSl7KUHsGKpkTALur7JX`YH&Yw1xSrbhg^ir4FE#<@bIqxv(LcEa2hebfvgK4sa9w~ z)yT&?SU6VU9V`s6%tJx#2#|Z{5U3h1L9Xa$L7+V|veno?#ZHDJ6iqveLDh)G<{Z2$ zYcS>1@b_QV-zG#4p?UFZ6T>+jNkoWj4TpR73pry}4^Cn}y3-U}K@IRgszYg+v6A5RIKlxSc6{P=n>M9AS`XsmidjM@!O7;~R4*NtBm% z?jhxTCsN{%K8G3$q(&W|hb`+_o*e=f@$3K`0?*FCJo^T+Y1f5$b_xdOF7?de*>90N zdoJeLTQSf6B4CkV1ilMmIVt@#s24nOKD|Hsh7p#hm!cuVB3I*yBWQ7KQk1KcoZB4& zfaQ9t&7e%~W&Qy21fo<~;2ooH+R-X)+b^rQdE2>o6}Rnv4HAu<7Jz7qUUxc#JA4bU zXms8b1eV|u7=$BK0(;^T*keu!th~1Xm%tX@h|Oyg zUaG()Fyk;JTPT4oyuk$q{pivWTmoaY#NxNQKhI*qMvMu&jr@`ezJEDNgmyUM(fVx+VT)uR)+Xu%QyL@qL*CUs& zJ{Y-tAjpBsC*SXgOW|;wkeh#T`H+l(75UbC%V1>*m9Pa~l{wJC;X}%OCy0n=Hd<}Q zt32sRCv*_BoXMpd7#n!$cB>=^FWu^&1R$$(amGQsbgL)33yTHV>I_{gz)QDV4Sc+G ztFP9fZB|axKudc7PDV2>pHI^u>w(o7CXPT$H~3j(bw1gDmUJ@wkZBixDa@}HE#1(& zLQA(Wa_NR2zR>1pO$;O?BC8XGL}YcokTcNw4y;ZjB!b9EmcUuK1db+4;2>NA1EUNj zFktS;>I_3Aa4!gnXEZfuz4K8CtbDi+m%#59fMEb7aAzqi^ki3n{KA;giuT{*|< zRN+Vfi3nMpAXK9&;TMSr^%(#Sh9%wXV(qc~kNSX4tZ9&lkktt@E>tDJ`Gcej zh70%_fCjHX*F@ZD;Mei;3;y=-X8!=a;|zFu9>UrK0BfI8xd?04GyVo@gj9HhS)Z_? z)O<0=ymf5HZW9zrkI+|!o#|Z$QZ4F49z)SL_c8ZZED1$Q23#f)us;=lxdiS0P{D(6 zjfCgxpq~?lzQUCU$a_U}RvpyC@EG>p00Bu^2L&-wI_jXW1D0}y=3EVIj)fGDp%`bY z%_&hG2c)lpn!$p5(s1`zdl*$soVP}{mYJ8<^?1KEHl#FrWGNhPw+Sn@79?2NBliN` z_)tbA@qk^^$;%5afTr9&%hJ+>^mIW0l69k-2 zUdv{oI*&0t7*u4~)i3?6U3(CYAZjRR^@%`t6g9PI^@)Wem_kJ2s7XMpPr8_N?L`qN zYCt$b8=Kt1QS(ALf~aYz!%+h+Uj-!8-^S&;fnC1zm8du21}#<8n{dFr2{e5~dNS@! zIH9|nd_V3@3}ct?tRL=8^yA({eIV{lz}ba_{1Da@(3^lw>aey_u=yeAJTf$t(0zq= zD#EHglpUmM59S5l!^b~D393EX>Z*bZ(dw%GCoRk|Dv>!`epFPg_MMs^HV6540HPeKi^UT-Dcctu#7PN4?3@h;Ebr79Il!uXOzZPF!XVFP~k(BY}6$V``NXim2DZ}}L zqzr}&BxUQ_r2K0c1FQC=jDd^|tlIm}s`ej~s=XiFf6*3dsEY}+Xnc@*$G(nhxB~VI ztVR{EZw_?Bp#t_JTL`{6q-yWyf-B&CxOWS$ig5*8&WD~4RKS%0e?U-|^Wg%73b?ZJ zHlAbnkri-dC9Z&LDmUW_xT-R+YRP8~6XXX?hyomY971M(Rx9M{3EA~cEYrv%fm9mP z?tYt|&CzhQPd0UEW>SN9wXW+4(S#I*1Sc~LlT5CWFi%X)D93d@ zRCX~nb^2*i1XrRH8Ep^o&xASW+75r0loC%wly<6xYQ=VQPx8pKEE`!!n`e@FYGlkX zEu=SxXnYK#uB|~cul~bGQRBhxGFE=GSs9%HWv((1C^qr7NOF2PpEPyd zo8%Jo)L179&weTIxhqRoATx*R$0jxK=^%;^T2BOe@VHyApD?F;6;t|eGzM7pzVyHN zWRU63kq+W{nWAs=^hiNVT|!TYx|p@;rI^~G5LOCo3*Vbj<<)mX`q$zYpYU>2c5l+; zXw;2!vm`drWjjJrciZ;5&8+S1^0II|W!zCLz3yf-h@}f>1ghSE7G~tAN!xBbBZ#Q; zVLfCh;B!c(5)WL?$ZD5*B%PQtY1p!mWM*RESTQ9vzJ5t(tbR;oI^h2DT}7maltR%I zx0#M|PDQ0DWP^J|9eZCfvJ7T3+d+Rnd`)c9l%XryAnU2^*%MRipnv<3QrI^l7dF;8 z@?`LVBT{`mZ?RWWLTZzdS86q)CA2(aN3DTprc6&uk5cNCU#cQuFi~K<$^KVkY$IR;U{-AZ7cgi6B>W9%x$9WuPUP$d5W}bdO ziy%gMgv4jT@4P&TjZs3ajG*i_&d44=bDEB+c5bb3&{%y1pVUoR8GUu~&hz`zb@mPQ zik)&^`-y;crp+4OHF(k6H=Of4b~;A6eEuOV`C@4Z@@e9+ zsZH0-JkwFuo5#myTx(|ZDwb%0NouB2bNdPVr7=8%Uyy(PdnMKdcQ2a$^4=y>gi#XS zN>q1`c}uky)kGurX=CuYQhCZWyQ%+jm{-4yASS4UiDl|yJztRbxmPH`GQ=D8Eb4+< z!sSGApP4u(ZmauRb*4;DWXQSPjn}M=-6U>`I#6#lVEV+Pfv}!wT7b!1na;GIWKBy?~?W;|IxB}#UM<-W7iQCtW8NKEziq?x5=b@G!{S;y58774?g;aCpPuk z_{e4qhOw~##>TVWt|`hCy{q8&P2QUKh4-fXWK7-gJT<-e(Ai#A;NvAqZge$&joTi- zjY4|&M)B}Iacb!UN^grI*3fX6@1Unm+V%MCT`>7cw`4VUY}t6v-Fp+m>rCO}H&3T% zK6=}~IQ!C(G|tDCzK00oOqTD)$$L3B&RKs`(dhH!yYb!oCLa!_h@K9I?cVi%duC47 zx6!2mS9TdM)GmwbTpUoGQCS>v^I*b{&0)=%vFhpav|4rA#B1t;vDdt6J#2(#+tiJX zVe?WneTzlKnQ_+Kgu&KI`J0=dUbN5QSdm@#2I%o9q;*93vHpwDe1^x3l^_^9Q)KwAQ`-G1Muesmk z$NSQ^Q(YQ$cE+!>BYofpTZ#IbBUZzY?p|~Mz?{FT?5lV~C@1sz*2<@*xwE5ZB9zXJ(o#x3WzFy$NdV6wUz7u_t z{=?VBQolU+I%QKt=;6{YU6R~}Qr51utRLUqH~h(&MqT9r2RCN={-iZiUfEI2$Na>5 z8v{+pi~L*T5>7_T|7h2<(Bnxhbe-9FBX3Q}NZb`-b?~Smwzb+mZs$Tw~^w zOF{0-IF&YBv2)F5&yDI`pxay0 z-M&4b&O^enHyRX~?52$F2K&zTV#@q%am%fNmm|cBj6TESWx1ki`2T7Bsj&8%F?{M& zIQwLis;l9MBsw)Ji?vm;a@u-HG3-MLFC&5g{v(7Q~T zc!6==G_eLBe7$ga{IkCGzO|IlJyzu%eK+Ain}h1Vmn)kM7ktjfO}-v~pmKn7u_kYu z#yg}oBs4e7qsCu2W;)N^Z6DycUeLZ+GQHi~{HopCDaR_KQ$ysr7vt3LG!{RYd^EXV z@w4eIvq?51Bjh|y2)nJFWA4>V$W`E0f=Mb>w}>KKWg(R7g+y7e{74ePHmix}U92|A zIM4l-%-l)M@d~}{(n7Ql-E}^#FFk*(XEn)h=m`z4;xLbJg*zTAXp3i|KR4y@#oCxE zV-fGj85==QJYi;2i9D8}%+x8Cx|w_G^bym^uN-NyeA7r6pOzJHh0{OxXj^{jH)k

tLWx9rwSA$+!x|+pnQYp4XxI1ijRYg$Dx^eH_X$~WxwBOf zPrZLmXcrWU1KZ%DuDIYiT>7dL_fu7F&-MoY%ZcDqRUs=SZF zH-Eqz56&K@PX}b{-pm|(%fI+k=$K%7&(JydIzv-L$pr^)=ZT94j)cndS1DKfcRLQn z>wT36)zud~18+r}6Ca11Jvf=a>SAfJHpg`u-s7n_>nSlkVZ}=Q7Z#CkC?4*9EvcEk z-{G<%RTeQ>_)x|zV$T=b#s>#^a1T~nQ4X=YV$~IkIovDG9v>uhS&ND@6!G5_#}w>q z<(~1bp9-e;rhmW5-7e1N!(Q~}QU@LNjoHQ8gYx_f{XkqFJ4h@3y8?2@2eJ*qnd|() z*DhN4)_TnEJNc;^j>?O&&cNs}>ARuoid7l07qqX{CckUvv)w(n z>yc)=hBD9x*)+9bs4eke;FBC5gAY@H!oR}HqAINH66@-I2dz6 zq|10Vqiap5Z{>A8T`^Q)0P+wZG+mp^O% zVlvCm9ziF0ZzFN*5jQE*;a%QhnTW3b)al?4Z=J(BiU(8M2 zd~?RQ(D{|}{^GP!`w=Twag1MefALp$Tl^2@RVrS!^VurCDi4*d)PKCsuII;f{@a3* zZ~p0izn#ww^AcKG8P9h_^Xl~I!6%Xq=CN=d(G+sxoixRnjl@#2Q2?1|7CJJ37e(wHE#M{x#REtCt@*<*Z=?k literal 0 HcmV?d00001 diff --git a/results/2026-08-31-overnight-quant-bench.md b/results/2026-08-31-overnight-quant-bench.md new file mode 100644 index 0000000..55e2a00 --- /dev/null +++ b/results/2026-08-31-overnight-quant-bench.md @@ -0,0 +1,73 @@ +# Imatrix / PLE / MTP depth sweep — 2026-08-31 overnight + +## Setup and gates + +- Quantizer: ROCmFPX banded `llama-quantize`, build 270 (`48a6d39f9`). +- Engine: `/home/user/source/llama.cpp-strix-halo-vulkan/build/bin/llama-cli`, build 1 (`ad914eb`). +- M2 command (no `--tensor-type` override): + + ```text + /tmp/rocmfpx-quant/build/bin/llama-quantize \ + --imatrix /mnt/ssd2/models/qwen38-flash-next/qwen38-imatrix.dat \ + /mnt/ssd2/models/qwen38-flash-next/Qwen3.8-Flash-Next-F16.gguf \ + /mnt/ssd2/models/qwen38-flash-next/Qwen3.8-Flash-Next-IQ4_XS-M2.gguf \ + IQ4_XS + ``` + +- M2 quant log: 926 imatrix entries, 1,024 chunks; `per_layer_token_embd.weight` remained Q8_0; 194 fallback tensors; 5.56 BPW; 1,779,377 ms. +- Paris gate: pass — `The capital of France is Paris...`; 57.3 s load and 26.94 t/s generation with the bounded `llama-completion -ngl 47 -c 8192` smoke. +- Sidecar dispatch gate: apepojken failed because `output_hc_norm.weight` was absent; the Nathan sidecar (`mtp-Qwen3.8-Flash-Next-Q8_0.gguf`, trailing `blk.48`) passed a 10-token Paris smoke and was used below. +- Depth prompts tokenized to 8,193 / 32,769 / 131,073 / 255,718 tokens. Contexts were explicitly bounded at 8,192 / 16,384 / 40,960 / 139,264 / 257,024; no run used the GGUF 262,144 default. +- Common benchmark flags: `-dev Vulkan0 -ngl 999 -fa on -ub 2048 -ctk q8_0 -ctv q8_0 -n 128 --temp 0 --reasoning off -st --simple-io`. MTP added `-md ...Q8_0.gguf --spec-type draft-mtp --spec-draft-n-max 6 --spec-draft-p-min 0.75`. + +## Artifact sizes + +| quant | PLE tensor | bytes | GiB | measured BPW | fallback tensors | Paris | +|---|---|---:|---:|---:|---:|---| +| Static IQ4_XS | Q8_0 | 123,993,034,048 | 115.48 | — | 194 shape fallbacks | previously clean | +| PLE IQ4_XS | IQ4_NL fallback from forced IQ4_XS | 97,444,277,856 | 90.75 | 4.41 | 195 | previously clean, 28.7 t/s | +| M2 imatrix IQ4_XS | Q8_0 | 123,044,400,736 | 114.59 | 5.56 | 194 | pass, 26.94 t/s | + +M2 is 25,600,122,880 decimal bytes (23.84 GiB) larger than PLE and 948,633,312 bytes (0.88 GiB) smaller than static. The requested command therefore produced 115G rather than the approximate 104–108G estimate, while matching the expected roughly 25 GB PLE delta. + +## Plain depth sweep + +Cells are prompt-processing / token-generation tokens per second. + +| depth | context | Static 116G | PLE 91G | M2 115G | +|---:|---:|---:|---:|---:| +| 0 | 8,192 | 88.3 / 29.5 | 93.5 / 30.2 | 87.5 / 29.6 | +| 8k | 16,384 | 471.8 / 23.2 | 504.8 / 23.8 | 492.2 / 23.8 | +| 32k | 40,960 | 392.0 / 18.6 | 401.8 / 19.0 | 386.1 / 19.0 | +| 128k | 139,264 | 266.5 / 9.4 | 268.4 / 9.5 | 268.1 / 9.4 | +| 256k | 257,024 | 202.7 / 6.2 | 204.1 / 5.5 | 203.7 / 6.2 | + +## MTP depth sweep + +| depth | context | Static 116G | PLE 91G | M2 115G | +|---:|---:|---:|---:|---:| +| 0 | 8,192 | 82.0 / 50.0 | 86.7 / 53.9 | 82.3 / 49.4 | +| 8k | 16,384 | 472.9 / 32.5 | 474.9 / 33.5 | 460.5 / 25.1 | +| 32k | 40,960 | 370.4 / 28.2 | 374.2 / 26.7 | 364.8 / 29.1 | +| 128k | 139,264 | 256.6 / 17.4 | 256.4 / 13.5 | 257.7 / 13.3 | +| 256k | 257,024 | resource ceiling, exit 137 | resource ceiling, exit 137 | resource ceiling, exit 137 | + +All three 256k MTP attempts exhausted the 33 GiB swap area before producing a timing line. Static and M2 were terminated by the admission guard at less than 4 GiB `MemAvailable` with less than 1 GiB `SwapFree`; PLE had already reached the same exit-137 outcome. Plain 256k remained stable for every quant. + +The PLE `-ub` check at 256k plain measured: `ub=512` 194.7 / 6.2, `ub=1024` 193.1 / 6.1, and `ub=2048` 204.1 / 5.5 pp/tg. Thus `ub=2048` improved prefill by 4.8% over 512 in this run, not the claimed 10%; generation was 0.7 t/s slower. + +## What each quant changes + +**Static 116G.** This is the non-imatrix baseline with the PLE table retained at Q8_0. Its 194 fallback count is dominated by geometry, not an implicit quality policy: 640-column expert-down tensors and 320-column hyper-connection up tensors cannot satisfy IQ4_XS's 256-column divisibility and therefore fall back (predominantly to IQ4_NL). Those same shape fallbacks remain in both imatrix variants, so they do not explain the cross-variant size or depth differences. + +**PLE 91G.** This uses the same 926-entry imatrix for supported trunk tensors and explicitly requests `per_layer_token_embd=IQ4_XS`. The 160-column PLE table also cannot satisfy IQ4_XS geometry, so that one deliberate override falls back to IQ4_NL and raises the fallback count from 194 to 195. That 51B-entry table cut, Q8_0 to IQ4_NL, is the real 25.6 GB size lever; the unchanged 640/320-column fallbacks are shape-forced. It wins plain prefill through the sweep and MTP at 0/8k, but its MTP generation trails static at 32k/128k. + +**M2 115G.** This applies the same imatrix to the trunk but passes no tensor override, so the 160-column PLE table has no imatrix weights and remains Q8_0. Its fallback count returns to 194, exactly the geometry-forced baseline, while the imatrix-adjusted trunk trims only 0.88 GiB versus static. Its plain depth curve is effectively static; under MTP it is similar at 0/32k, materially worse at 8k, and close to PLE at 128k. This isolates the large file-size change to PLE precision and the smaller static-versus-M2 change to imatrix-guided trunk choices. + +## Result receipts + +- Committed raw-receipt archive: `results/2026-08-31-overnight-quant-bench-logs.tar.gz` (`sha256:aec23e327a5d9637d6e11cb8e78d081dda35dcef7dd9951b112ffb1e3a236482`). It contains every per-run log, all four exact fillers, both quant logs, sweep summaries, and the 256k MTP memory traces. +- Per-run logs: `results/{STATIC-,PLE-,M2-}shvd-depth{0,8k,32k,128k}-{plain,mtp}.log`. +- 256k plain: `results/STATIC-shvd-depth256k-plain.log`, `results/M2-shvd-depth256k-plain.log`, and `results/PLE-ub2048-depth256k-plain.log`. +- 256k MTP failure receipts: matching `results/*-shvd-depth256k-mtp.log`; memory traces are in `/home/user/overnight/*-shvd-depth256k-mtp-vm.log`. +- Quant and gate receipts: `/home/user/overnight/quant-M2.log`, `results/M2-paris-smoke.log`, and `results/sidecar-smoke-{apejojken,nathan}.log`.