g;ddlmZmZddlmZmZ ddlmZmZm Z m Z m Z m Z m Z mZmZ ddlmZddlmZdd Zddd d efd Zd efdZdZefdZddZy#e$rZedeedddZ[wwxYw#e$rGdd ZeZYSwxYw))Table RecordBatch) Expressionfield) DeclarationExecNodeOptionsTableSourceNodeOptionsFilterNodeOptionsProjectNodeOptionsAggregateNodeOptionsOrderByNodeOptionsHashJoinNodeOptionsAsofJoinNodeOptionsz@The pyarrow installation is not built with support for 'acero' ()N)ScanNodeOptionsc4eZdZGddZGddZy)DatasetModuleStubc eZdZy)DatasetModuleStub.DatasetN__name__ __module__ __qualname__B/var/www/openai/venv/lib/python3.12/site-packages/pyarrow/acero.pyDatasetr3 rrc eZdZy)!DatasetModuleStub.InMemoryDatasetNrrrrInMemoryDatasetr 6rrr!N)rrrrr!rrrrr2s    rrTc xtdt||}|jjDcgc] }t |}}tj |tdt |g}|jjd}|*tj |tdt|g}|Scc}w)Nscan use_threadsprojectfilter) rrschemanamesr from_sequencer _scan_optionsgetr )datasetr%declf projections filter_exprs r_dataset_to_declr2;s vwKP QD&-^^%9%9:%958%9K:  $ $ {9&8&EFG D''++H5K(( ;x):;)GH I  K;sB7Fc t|ttjfst dt |t|ttjfst dt |i} t|t tfs|g}t|D] \} } | | | < i} t|tt fs|g}t|D] \} } | | | < |jj}|jj}|dk(s|dk(rg}nE|dk(s|dk(rg}n8|dk(s|dk(r|Dcgc] }|| vs| }}n|dk(r|Dcgc] }|| vs| }}i}t|D]\} }||vs | ||<i}t|D]\} }||vs | ||<t|tjrt|| }ntd t|}t|tjrt|| }ntd t|}|rt||||||xsd |xsd }nt||||xsd |xsd }td |||g}|rL|dk(rFt|}t|}t!|}g}g}t||zD]\} }| t!|krq||vrm|j#|||| |}|j#t%j&dt%j(| t%j(||zg| |k\r||vr|r| |kr ||vr||z }|r| |k\r ||vr||z }|j#||j#t%j(| tdt+||}tj,||g}|j/| }| tk(r|S| tj0k(rtj0|St dcc}wcc}w)a\ Perform join of two tables or datasets. The result will be an output table with the result of the join operation Parameters ---------- join_type : str One of supported join types. left_operand : Table or Dataset The left operand for the join operation. left_keys : str or list[str] The left key (or keys) on which the join operation should be performed. right_operand : Table or Dataset The right operand for the join operation. right_keys : str or list[str] The right key (or keys) on which the join operation should be performed. left_suffix : str, default None Which suffix to add to left column names. This prevents confusion when the columns in left and right operands have colliding names. right_suffix : str, default None Which suffix to add to the right column names. This prevents confusion when the columns in left and right operands have colliding names. use_threads : bool, default True Whether to use multithreading or not. coalesce_keys : bool, default False If the duplicated keys should be omitted from one of the sides in the join result. output_type: Table or InMemoryDataset The output type for the exec plan result. Returns ------- result_table : Table or InMemoryDataset Expected Table or Dataset, got z left semiz left antiz right semiz right antiinnerz left outerz right outerr$ table_source)output_suffix_for_leftoutput_suffix_for_righthashjoinoptionsinputsz full outercoalescer&Unsupported output type) isinstancerdsr TypeErrortypetuplelist enumerater(r)r2rr rsetlenappendr_call_fieldr r*to_tabler!) join_type left_operand left_keys right_operand right_keys left_suffix right_suffixr% coalesce_keys output_typeleft_keys_orderidxkeyright_keys_order left_columns right_columnscolleft_column_keys_indicescolnameright_column_keys_indices left_source right_source join_optsr.left_columns_setright_columns_setright_operand_indexprojected_col_namesr0right_key_index projection result_tables r _perform_joinrjPsxP lUBJJ$7 89$|:L9MNOO meRZZ%8 99$}:M9NOPPO i% /K i(S") j4- 0 \ j)S #* &&,,L!((..MK9 #; l "i<&? g l!:( (CC7G,GC=   m #' 'C3o+EC<  "!,/ W i 03 $W -0!#!-0 W j 14 %g .1 , +&|M !.2H2VW -,' ;O " 2=A ' y*lM#.#4"$0$6B ( y*#.#4"$0$6B I{L.I Dl2|, .!,/  !,">?HCS&&32J+J#**3/ #<s34#6""$$Z"))#. 0A0A/?1A2 ++7P0P  C*=$=00;&C S,?%?//<'C#**3/""%%c*E@J! )+7JK (($ );<==[=9Le ** *!!,//122U  s) O/3O/ O4 O4c t|ttjfst dt |t|ttjfst dt |t|t tfs|g}t|t tfs|g}|jjD cgc] } | |g|zvr| } } t|jjt| z} | rtdj| t|tjrt||} ntdt|} t|tjrt||} ntdt|} t!|||||}td|| | g}|j#|}|tk(r|S|tj$k(rtj$|St dcc} w)a- Perform asof join of two tables or datasets. The result will be an output table with the result of the join operation Parameters ---------- left_operand : Table or Dataset The left operand for the join operation. left_on : str The left key (or keys) on which the join operation should be performed. left_by: str or list[str] The left key (or keys) on which the join operation should be performed. right_operand : Table or Dataset The right operand for the join operation. right_on : str or list[str] The right key (or keys) on which the join operation should be performed. right_by: str or list[str] The right key (or keys) on which the join operation should be performed. tolerance : int The tolerance to use for the asof join. The tolerance is interpreted in the same units as the "on" key. output_type: Table or InMemoryDataset The output type for the exec plan result. Returns ------- result_table : Table or InMemoryDataset r4zOColumns {} present in both tables. AsofJoin does not support column collisions.r$r6asofjoinr;r?)r@rrArrBrCrDrEr(r)rG ValueErrorformatr2rr rrLr!)rNleft_onleft_byrPright_onright_by tolerancer%rUr\r[columns_collisionsr`rarbr.ris r_perform_join_asofrusB lUBJJ$7 89$|:L9MNOO meRZZ%8 99$}:M9NOPP gt} -) h .:%++111 xj8+ + 1\00667#m:LL !!'(:!;  , +&|M ! 2<@ -,' ;O " 2=A $(HiI I{L.I D==[=9Le ** *!!,//122Os9G<c Bd}t|trtj|g}d}t j t dt |t dt|g}|jd}|r!|jjd}|S)a}Filter rows of a table based on the provided expression. The result will be an output table with only the rows matching the provided expression. Parameters ---------- table : Table or RecordBatch Table that should be filtered. expression : Expression The expression on which rows should be filtered. Returns ------- Table FTr6)r<r'r$r) r@rr from_batchesrr*r r rLcombine_chunks to_batches)table expressionis_batchr.results r _filter_tabler~Ws"H%%""E7+  $ $N,B5,IJH&7 &CD& D]]t] ,F&&(335a8 Mrc vt|tjrt|d}nt dt |}t dt |fi|}t j||g}|jd}|tk(r|S|tjk(rtj|Std)NTr$r6order_byr?) r@rArr2rr r r*rLrr!rB)table_or_dataset sort_keysrUkwargs data_sourcerr.ris r _sort_sourcerws"BJJ/&'7TJ ! 23CD :'9)'Nv'NOH  $ $k8%< =D==T=2Le ** *!!,//122rc tjtdt|tdt||g}|j |S)Nr6 aggregate)keysr$)rr*r r rL)rz aggregatesrr%r.s r _group_byrsL  $ $N$:5$ABK!5jt!LM& D ==[= 11r)T) pyarrow.librrpyarrow.computerrpyarrow._acerorrr r r r r rr ImportErrorexcstrpyarrow.datasetr-rApyarrow._datasetrrr2rjrur~rrrrrrs2+-   "  0.#"%# n3f/3#(S3l@;@3,2K   J3s8*TUV   Bs(A A5A2A--A25B B