g B d dl Z d dlmZ G d de j Zy) N)padded_everygram_pipelinec e Zd Zd Zy)TestPreprocessingc g dg}g d}t dg dg \ }}| j |D cg c]
}t | c}| | j t | | y c c}w )N) ))r a)r )r b)r )r c)r
)r
)r )r r r r
r )r r r
)r assertEquallist)selfexpected_trainexpected_vocab
train_data
vocab_datasents Y/var/www/openai/venv/lib/python3.12/site-packages/nltk/test/unit/lm/test_preprocessing.py test_padded_everygram_pipelinez0TestPreprocessing.test_padded_everygram_pipeline
sf
8!:1>O!P
J <$t*: =s A!N)__name__
__module__ __qualname__r r r r s ;r r )unittestnltk.lm.preprocessingr TestCaser r r r r s ;;)) ;r