g<nddlmZddlmZddlmZddlmZddlmZddlmZddlm Z ddl m Z dd l m Z dd l mZdd l mZdd lmZdd lmZddlmZddlmZddlmZddlmZddlmZddlmZer6ddlmZddlmZddl m!Z!ddl"m#Z#ddl$m%Z%ddl&m'Z'ddl(m)Z)ddl*m+Z+ddlm,Z,GddeZ-y)) annotations)chain) TYPE_CHECKING)Any)Iterable)Literal)Sequence) add_row_index)parse_exprs_and_named_exprs)native_to_narwhals_dtype)select_columns_by_name)ColumnNotFoundError)CompliantLazyFrame)Implementation)flatten)generate_temporary_column_name)parse_columns_to_drop) parse_version)validate_backend_version) ModuleTypeN)Self)DaskExprDaskLazyGroupBy DaskNamespace) IntoDaskExpr)DType)VersionceZdZ d"dZd#dZd$dZd%dZd&dZd'dZd(dZ d)dZ e d*d Z d+d Z d,d Zd-d Ze d.d Zd.dZd/dZd0dZd1dZd2dZdd d3dZ d4dZdd d5dZdddddddd d6dZd7dZd2dZd8d Z d9d!Zy): DaskLazyFramec||_||_tj|_||_t |j|jyN) _native_frame_backend_versionrDASK_implementation_versionr)selfnative_dataframebackend_versionversions M/var/www/openai/venv/lib/python3.12/site-packages/narwhals/_dask/dataframe.py__init__zDaskLazyFrame.__init__&s?. /-22  !5!5t7L7LMc|jtjur|jjSdt |j}t |)NzExpected dask, got: )r'rr&to_native_namespacetypeAssertionError)r)msgs r-__native_namespace__z"DaskLazyFrame.__native_namespace__3sN   >#6#6 6'';;= =$T$*>*>%?$@AS!!r/cJddlm}||j|jS)Nrrr+r,)narwhals._dask.namespacerr%r()r)rs r-__narwhals_namespace__z$DaskLazyFrame.__narwhals_namespace__:s:T-B-BDMMZZr/c|Sr#r)s r-__narwhals_lazyframe__z$DaskLazyFrame.__narwhals_lazyframe__?s r/cR|j|j|j|SNr7) __class__r$r%)r)r,s r-_change_versionzDaskLazyFrame._change_versionBs+~~   0E0Ew  r/cR|j||j|jSr?)r@r%r()r)dfs r-_from_native_framez DaskLazyFrame._from_native_frameGs)~~  5 5t}}  r/c~|j}t|g|i|}|jdi|}|j|S)Nr;)r$r assignrD)r)exprs named_exprsrC new_seriess r- with_columnszDaskLazyFrame.with_columnsLsE   0MMM RYY $ $&&r**r/cddl}ddlm}|jj }||t j t|j|jS)Nr)PandasLikeDataFrame)implementationr+r,) pandasnarwhals._pandas_like.dataframerLr$computerPANDASr __version__r()r)pdrLresults r-collectzDaskLazyFrame.collectRsHG##++-" )00)"..9MM   r/cJ|jjjSr#)r$columnstolistr<s r-rWzDaskLazyFrame.columns_s!!))0022r/c|jjt|fd|jD}|j |d}|j |j j|S)Nc3LK|]\}}j||k(ywr#)col).0namevplxs r- z'DaskLazyFrame.filter..fs%VBUwtQ  2BUs!$r)r9all_horizontalritems_callrDr$loc)r) predicates constraintsexprmaskr_s @r-filterzDaskLazyFrame.filtercss))+!s!! :V+BSBSBUV W zz$"&&t'9'9'='=d'CDDr/c tddlm}|rXtd|DrF|sD|jt |j t ||j|jSt|g|i|}|sIddl }|j|j|j|j jStd|Drtd|jDrc|j|j!Dcgc]$\}}|j#j%|&c}}d}|j|St |j j&di|t |j)|j|j}|j|Scc}}w) Nrc3<K|]}t|tywr#) isinstancestr)r\xs r-r`z'DaskLazyFrame.select..ss;UAs+Us) npartitionsc36K|]}t|ddyw_returns_scalarFNgetattr)r\rgs r-r`z'DaskLazyFrame.select..sI54wt.65c36K|]}t|ddywrqrs)r\vals r-r`z'DaskLazyFrame.select..s R >RsGC*E 2>Rru)axisr;)dask.dataframe dataframeallrDr r$listr%r'r rN from_pandas DataFramerovaluesconcatrb to_seriesrenamerFkeys) r)rGrHddrIrSr]rwrCs r-selectzDaskLazyFrame.selectls $ S;U;;K**&&&K))((  1MMM  **r||~4;M;M;Y;YZ  I5I IcR >I>P>P>RR O ?I?O?O?QR?Q)$''-?QRYZB**2. . # %D   % % 3 3 " #  ! !    &&r**Ss )F4 c|)|j|jjSt|tr|gn|}|j }|j |j|j|jSr#) rDr$dropnarlrmr9riany_horizontalr[is_null)r)subsetr_s r- drop_nullszDaskLazyFrame.drop_nullssx >**4+=+=+D+D+FG G'4&&))+{{C..wsww/?/G/G/IJJKKr/c |jjDcic]1}|t|j||j|j3c}Scc}wr#)r$rWr r(r')r)r[s r-schemazDaskLazyFrame.schemasb ))11  2 )""3'8L8L 2    s6Ac|jSr#)rr<s r-collect_schemazDaskLazyFrame.collect_schemas {{r/ctt|||}|j|jj|S)N)compliant_framerWstrictrW)rrDr$drop)r)rWrto_drops r-rzDaskLazyFrame.drops:' '& &&t'9'9'>'>w'>'OPPr/cx|jt|j||j|jSr#)rDr r$r%r')r)r]s r-with_row_indexzDaskLazyFrame.with_row_indexs:&& ""D$*?*?AUAU   r/cX|j|jj|S)Nr)rDr$r)r)mappings r-rzDaskLazyFrame.renames'&&t'9'9'@'@'@'QRRr/c\|j|jj|ddS)NF)nrPro)rDr$head)r)rs r-rzDaskLazyFrame.heads0&&    # #aB # G  r/any)keepc |1tfd|Drd|dj}t|j}|dk(r|xs j}t d|}|j |j j|}||dk(}|jj|}|j||d }n'd d ij||} |j|| }j|S)Nc3:K|]}|jvywr#r)r\rnr)s r-r`z'DaskLazyFrame.unique..s%LVat||&;Vsz Column(s) z not found in nonen_bytesrWrxrinner)onhowrfirst)rr)rrWrr$rgroupbysizer reset_indexrmergegetdrop_duplicatesrD) r)rrr4 native_frametokenseruniquerT mapped_keeps ` r-rzDaskLazyFrame.uniques  #%LV%L"LvhnT\\NCC%c* *)) 6>+t||F21fME&&v.335<I(23 1Q I3 *f && NN9 {N S  4s A3r)rc Ht|tr|g}t|tr|g}|dk(rtdg|j|j}|j |j j di|dij|j j di|did||d|fj|S|d k(rtdg|j|j}| d }t|t|j ||j|jjtt||j!} |j j| d ||| } |j | | |d k(j|gS|dk(r| d}t|t|j ||j|jjtt||j!} |j |j j| d||S|dk(r|j } |j j| d||d|f} g} t||D]D\} }|| k7r ||jvr| j#|+|| k7s1| j#|dF|j | j| S|j |j j|j |||d|fS)Ncrossrrrr)rleft_onright_onsuffixesrantiz(`right_on` cannot be `None` in anti-joinouter)r indicatorrr left_onlysemiz(`right_on` cannot be `None` in semi-join)rrrleft_right)rrrrr;)rlrmrrWrDr$rFrr TypeErrorr r%r'rdictziprappend)r)otherrrrsuffix key_tokenindicator_tokenr4 other_nativerC result_nativeextraleft_key right_keys r-joinzDaskLazyFrame.joinsr gs #iG h $ zH '>6#BT\\#BEMM#BI**)""));YN;.E''..@)Q@%& &\ i(   &=<#BT\\#BEMM#BO@n$&''))((   Xw!78!" ##))) *B**2o&+56;;_DU;V  &=@n$&''))((   Xw!78!" **""(( #$ )  &= ..L ..44!f 5ME'*7H'=#)(Ydll-JLL+(*LLI;f!56 (> **=+=+=e+=+LM M&&    $ $##!f %   r/Nbackward)rrrby_leftby_rightrstrategyc|j} |j| j|j|j|||||||d S)N)rr)rrrleft_byright_byr directionr)r5rD merge_asofr$) r)rrrrrrrrr_s r- join_asofzDaskLazyFrame.join_asof\s`'')&& NN""##!!"'    r/c6ddlm}||t||S)Nrr)drop_null_keys)narwhals._dask.group_byrr})r)rrrs r-group_byzDaskLazyFrame.group_byxs;tT"XnMMr/c|j}|j}|dk(r,|j|jj|dSd}t |)NrxF)rrPzL`LazyFrame.tail` is not supported for Dask backend with multiple partitions.)r$rorDtailNotImplementedError)r)rr n_partitionsr4s r-rzDaskLazyFrame.tail}sX)) #// 1 **4+=+=+B+BQPU+B+VW W`C%c* *r/c td|j}|j}|j|j |j ||k\|j ||z |zdk(j |gdS)Nrr)r]rF)r)rrWr9rrir[r)r)roffsetrow_index_tokenplns r- gather_everyzDaskLazyFrame.gather_everys8DLLY))+   _  5 V(F2)F2a71<T?#ET 2  r/c|j|jj||||nd| |SdS)Nvariablevalue)id_vars value_varsvar_name value_name)rDr$melt)r)rindex variable_namers r-unpivotzDaskLazyFrame.unpivotsc&&    # #*7*C)3)?: $   FM $   r/)r*z dd.DataFramer+ztuple[int, ...]r,rreturnNone)r)rrr)rr)rr)r,rrr)rCrrr)rGrrHrrr)rr)r list[str])rerrfrrr)r)rrGrrHrrr)r)rrstr | list[str] | Nonerr)rzdict[str, DType])r)rrWrrrrr)r)rr]rmrr)r)rrzdict[str, str]rr)r)rrintrr)r)rrzlist[str] | NonerzLiteral['any', 'none']rr) r)rrzstr | Iterable[str]rrmrzbool | Sequence[bool]rrrr)r)rrrrz:Literal['left', 'inner', 'outer', 'cross', 'anti', 'semi']rrrrrrmrr)rrr str | Nonerrrrrrrrrrrz)Literal['backward', 'forward', 'nearest']rr)rrmrrrr)r)rrrrrrr) r)rrrrrrrrrrr)__name__ __module__ __qualname__r.r5r9r=rArDrJrUpropertyrWrirrrrrrrrrrrrrrrrr;r/r-r!r!%sS N& N) N  N  N"[   +  33E*+*+*+$*+  *+XL  Q S (- // /% /  /,    *      ,KR o o o H o ( o ) o o  o j##*.+/%)>H        ( )  # <   8N +    " & "      r/r!). __future__r itertoolsrtypingrrrrr narwhals._dask.utilsr r narwhals._pandas_like.utilsr r narwhals.exceptionsrnarwhals.typingrnarwhals.utilsrrrrrrtypesrrzr{rtyping_extensionsrnarwhals._dask.exprrrrr8rnarwhals._dask.typingrnarwhals.dtypesrrr!r;r/r-rsk" .<@>3.)"90(3 &,762%&| &| r/