ug% ddlZddlmZddlmZmZddlmZddlZddl Z ddl m Z m Z ddl mZddlmZmZddlmZmZmZGd d eZGd d eZGd deZGddeZGddeZGddeZGddeZGddeZGdde Zej@dZ!de"de"dedefd Z#d!eed"eedeefd#Z$ d)ded$e"d%e"deefd&Z%d'ed%e"defd(Z&y)*N)Sequence) TypedDict NotRequired) Traversable)SqlDBCursor)abstractmethod)SystemSettings)OpenTelemetryClientOpenTelemetryGranularity trace_methodcFeZdZUeeed<eed<eed<eed<eed<y) MigrationFilepathdirfilenameversionscopeN)__name__ __module__ __qualname__rr__annotations__strintK/var/www/openai/venv/lib/python3.12/site-packages/chromadb/db/migrations.pyrrs! k "" HM L Jrrc"eZdZUeed<eed<y) MigrationhashsqlN)rrrrrrrrr r s I Hrr c eZdZdfd ZxZS)UninitializedMigrationsErrorc$t|dy)Nz$Migrations have not been initializedsuper__init__)self __class__s rr(z%UninitializedMigrationsError.__init__s ?@rreturnN)rrrr( __classcell__r*s@rr$r$sAArr$c(eZdZdedeffd ZxZS)UnappliedMigrationsErrorrrcL||_||_t| d|d|y)NzUnapplied migrations in z, starting with version )rrr'r()r)rrr*s rr(z!UnappliedMigrationsError.__init__$s/  &se+CG9 M rrrrrrr(r-r.s@rr0r0#s C #  rr0c,eZdZdededeffd ZxZS)InconsistentVersionErrorr db_versionsource_versioncFt|d|dd|d|dzdzy)Nz#Inconsistent migration versions in :zdb version was z, source version was .zH Has the migration sequence been modified since being applied to the DB?r&)r)rr5r6r*s rr(z!InconsistentVersionError.__init__-s@ 1#a 8 |+@@PPQR SX Y rr2r.s@rr4r4,s" C S #  rr4c,eZdZdededeffd ZxZS)InconsistentHashErrorrdb_hash source_hashcFt|d|dd|d|dzdzy)NzInconsistent hashes in r8z db hash was z, source has was r9z? Was the migration file modified after being applied to the DB?r&)r)rr<r=r*s rr(zInconsistentHashError.__init__6s> %dV1 -WI%6{m1E FO P rrrrrr(r-r.s@rr;r;5s" S 3 S  rr;c$eZdZdeffd ZxZS)InvalidHashErroralgc*t|d|y)Nz"Invalid hash algorithm specified: r&)r)rBr*s rr(zInvalidHashError.__init__?s =cUCDrr?r.s@rrArA>sECEErrAc eZdZy)InvalidMigrationFilenameN)rrrrrrrErECsrrEcJeZdZUdZeed<deddffd Zee de fdZ e de e fdZe dd Ze defd Ze d e de efd Ze d ededdfdZddZedej2ddZedej2ddZxZS) MigratableDBaSimple base class for databases which support basic migrations. Migrations are SQL files stored as package resources and accessed via importlib_resources. All migrations in the same directory are assumed to be dependent on previous migrations in the same directory, where "previous" is defined on lexographical ordering of filenames. Migrations have a ascending numeric version number and a hash of the file contents. When migrations are applied, the hashes of previous migrations are checked to ensure that the database is consistent with the source repository. If they are not, an error is thrown and no migrations will be applied. Migration files must follow the naming convention: ...sql, where is a 5-digit zero-padded integer, is a short textual description, and is a short string identifying the database implementation. _settingssystemr,Ncz|j|_|jt|_t ||y)N)settingsrHrequirer _opentelemetry_clientr'r()r)rIr*s rr(zMigratableDB.__init__^s-%+^^4G%H"  rcy)zFThe database implementation to use for migrations (e.g, sqlite, pgsql)Nrrrrmigration_scopezMigratableDB.migration_scopec rcy)zYDirectories containing the migration sequences that should be applied to this DB.Nrr)s rmigration_dirszMigratableDB.migration_dirsirPrcy)z)Idempotently creates the migrations tableNrrRs rsetup_migrationszMigratableDB.setup_migrationso rcy)z*Return true if the migrations table existsNrrRs rmigrations_initializedz#MigratableDB.migrations_initializedtrVrrcy)z~Return a list of all migrations already applied to this database, from the given source directory, in ascending order.Nr)r)rs r db_migrationszMigratableDB.db_migrationsyrPrcur migrationcy)z(Apply a single migration to the databaseNr)r)r[r\s rapply_migrationzMigratableDB.apply_migrationrVrc|jjd}|dk(r|j|dk(r|jyy)z!Initialize migrations for this DB migrationsvalidateapplyN)rHrLvalidate_migrationsapply_migrations)r)migrates rinitialize_migrationsz"MigratableDB.initialize_migrationssC..((6 j  $ $ & g   ! ! # rz MigratableDB.validate_migrationsc^|js t|jD]}|j|}t ||j |j jd}t||}t|dkDsc|dd}t|j|y)zpValidate all migrations and throw an exception if there are any unapplied migrations in the source repo.migrations_hash_algorithmrr)rrN) rXr$rSrZfind_migrationsrOrHrLverify_migration_sequencelenr0name)r)rrZsource_migrationsunapplied_migrationsrs rrcz MigratableDB.validate_migrationss**,.0 0&&(C ..s3M /$$&&&'BC!  $=0$ '(1,.q1)<.388WMM)rzMigratableDB.apply_migrationscn|j|jD]}|j|}t||j |j j d}t||}|j5}|D]}|j|| dddy#1swYxYw)z5Validate existing migrations, and apply all new ones.rhN) rUrSrZrirOrHrLrjtxr^)r)rrZrmrnr[r\s rrdzMigratableDB.apply_migrationss &&(C ..s3M /$$&&&'BC!  $=0$ c!5I((i8"6)s B++B4 r+)rrr__doc__r rr r( staticmethodr rrOrrrSrUboolrXr rZrr^rfrr ALLrcrdr-r.s@rrGrGGs4(!v!$!  S    5         )1D   6 i D  $46N6R6RSNTN&13K3O3OP9Q9rrGz(\d+)-(.+)\.(.+)\.sqlrrrr,ctj|}|td|z|j\}}}|||t ||dS)z6Parse a migration filename into a MigrationFile objectzInvalid migration filename: )rrrrr)filename_regexmatchrEgroupsr)rrrrwr_rs r_parse_migration_filenamerzsY   *E }&'E'PQQ GQw<  rrZrmct||D]R\}}|d|dk7rt|d|d|d|d|dk7s4t|ddz|dz|d|d|t|dS) aGiven a list of migrations already applied to a database, and a list of migrations from the source code, validate that the applied migrations are correct and match the expected migrations. Throws an exception if any migrations are missing, out of order, or if the source hash does not match. Returns a list of all unapplied migrations, or an empty list if all migrations are applied and the database is up to date.rr)rr5r6r!/r)rr<r=N)zipr4r;rk)rZrm db_migrationsource_migrations rrjrjs+.m=N*O& &  "&6y&A A* '' 2/ :   #3F#; ;'!%(3.j1II$V,,V4 +P S/1 22rrhash_algcF|jDcgc]>}|jjdr!t|j|j|@}}t t fd|}t |d}|Dcgc]}t||c}Scc}wcc}w)zgReturn a list of all migration present in the given directory, in ascending order. Filter by scope.z.sqlc|dk(S)Nrr)frs rz!find_migrations..s!G*"5rc |dS)Nrr)rs rrz!find_migrations..s) r)key)iterdirrlendswithrzlistfiltersorted_read_migration_file)rrrtfilesrs ` rriris A 66??6 " "#((AFFA6   5u= >E 54 5E7< =u! H -u ==  >s ABBfilec Ld|vs|djs#td|dd|dd|dd|d |dj}|d k(rztjd k\r4t j |jd d jn1t j |jd j}nD|dk(r3t j|jd j}n t||||d|d|d |ddS)zRead a migration filerz No migration file found for dir rz with filename rz and scope rz at version rmd5) zutf-8F)usedforsecuritysha256)rB)r!r"rrrr) is_fileFileNotFoundError read_textsys version_infohashlibrencode hexdigestrrA)rrr"r!s rrrsK Tf!5!5!7.tE{m?4PZK[J\\ghlmthugvwCDHIRDSCT U   v, "C56) KK 7+U C M M OSZZ01;;= X ~~cjj12<<>8,,E{$ ?g  r)r)'rtypingrtyping_extensionsrrimportlib_resources.abcrrerchromadb.db.baserrabcr chromadb.configr r chromadb.telemetry.opentelemetryr r rrr Exceptionr$r0r4r;rArErGcompilervrrzrjrirrrrrsM 4/ *,I  A9A  y  y  I EyE  y k95k9`45 #."3I&3 *3i3B38 >  >  >,/ > i >} r