ugddlmZddlmZmZmZddlmZmZm Z m Z m Z ddl m Z ddlmZddlZde de d efd Zdede d e fd ZGd d e ZeeegdfZGdde Zy))abstractmethod)CallableOptionalSequence)OperationRecord LogRecordSeqIdVectorScalarEncoding) Component)UUIDNvectorencodingreturncJ|tjk(r3tj|tjj S|tj k(r3tj|tjj Std|j)z"Encode a vector into a byte array.dtypeUnsupported encoding: ) r FLOAT32nparrayfloat32tobytesINT32int32 ValueErrorvaluerrs M/var/www/openai/venv/lib/python3.12/site-packages/chromadb/ingest/__init__.py encode_vectorr st>)))xxbjj199;; ^)) )xxbhh/77991(..1ABCCc|tjk(r%tj|tjS|tj k(r%tj|tjSt d|j)z!Decode a byte array into a vectorrr)r rr frombufferrrrrrs r decode_vectorr$sb>)))}}V2::66 ^)) )}}V2::661(..1ABCCr!ceZdZdZededdfdZededdfdZededede fdZ eded e ede e fd Z e edefd Zy) Producerz4Interface for writing embeddings to an ingest stream collection_idrNcy)Nselfr's r delete_logzProducer.delete_log(s r!cy)zFTruncates the log for the given collection, removing all seen records.Nr)r*s r purge_logzProducer.purge_log, r! embeddingcy)zVAdd an embedding record to the given collections log. Returns the SeqID of the record.Nr))r+r'r0s rsubmit_embeddingzProducer.submit_embedding1 r! embeddingscy)aAdd a batch of embedding records to the given collections log. Returns the SeqIDs of the records. The returned SeqIDs will be in the same order as the given SubmitEmbeddingRecords. However, it is not guaranteed that the SeqIDs will be processed in the same order as the given SubmitEmbeddingRecords. If the number of records exceeds the maximum batch size, an exception will be thrown.Nr))r+r'r4s rsubmit_embeddingszProducer.submit_embeddings8s r!cy)ziReturn the maximum number of records that can be submitted in a single call to submit_embeddings.Nr)r+s rmax_batch_sizezProducer.max_batch_sizeCr3r!)__name__ __module__ __qualname____doc__rr r,r.rr r2rr6propertyintr9r)r!rr&r&%s>     t    ! .=    ! /7/H %     r!r&ceZdZdZe ddededeedeedeedef d Z ed eddfd Z edefd Z edefd Z y)Consumerz5Interface for reading embeddings off an ingest streamNr' consume_fnstartendidrcy)auRegister a function that will be called to receive embeddings for a given collections log stream. The given function may be called any number of times, with any number of records, and may be called concurrently. Only records between start (exclusive) and end (inclusive) SeqIDs will be returned. If start is None, the first record returned will be the next record generated, not including those generated before creating the subscription. If end is None, the consumer will consume indefinitely, otherwise it will automatically be unsubscribed when the end SeqID is reached. If the function throws an exception, the function may be called again with the same or different records. Takes an optional UUID as a unique subscription ID. If no ID is provided, a new ID will be generated and returned.Nr))r+r'rBrCrDrEs r subscribezConsumer.subscribeQs0 r!subscription_idcy)zUnregister a subscription. The consume function will no longer be invoked, and resources associated with the subscription will be released.Nr))r+rHs r unsubscribezConsumer.unsubscribeks r!cy)z9Return the minimum possible SeqID in this implementation.Nr)r8s r min_seqidzConsumer.min_seqidqr/r!cy)z9Return the maximum possible SeqID in this implementation.Nr)r8s r max_seqidzConsumer.max_seqidvr/r!)NNN) r:r;r<r=rr ConsumerCallbackFnrr rGrJrLrNr)r!rrArANs? "&#!   '   e_  TN     2 4 D   5   5  r!rA)abcrtypingrrrchromadb.typesrrr r r chromadb.configr uuidr numpyrbytesr r$r&rOrAr)r!rrWs//&D&DNDuDD%D>DfD# y# Lx 23T9:+ y+ r!