8gIddlmZejZejZejZej Zej ZejZejZejZ ejZ ejZ ejZ ejZ ejZejZej ZeeeedZdedefdZy)) normalizers)nfcnfdnfkcnfkd normalizerreturnc|tvr-tdj|tjt|S)Nz6{} is not a known unicode normalizer. Available are {}) NORMALIZERS ValueErrorformatkeys)rs T/var/www/openai/venv/lib/python3.12/site-packages/tokenizers/normalizers/__init__.pyunicode_normalizer_from_strrsA$ D K KJXcXhXhXj k   z " $$N)r NormalizerBertNormalizerNFDNFKDNFCNFKCSequence LowercasePrependStrip StripAccentsNmt PrecompiledReplace ByteLevelr strrrrr$s # # ++oooo     ! !   '' oo%%     ! ! #tTB %C%J%r