g BddlZddlmZGddejZy)N)AnnotationTaskc.eZdZdZdZdZdZdZdZy)TestDisagreementzN Class containing unit tests for nltk.metrics.agreement.Disagreement. cbgd}t|}|j|jdy)z} Simple test, based on https://github.com/foolswood/krippendorffs_alpha/raw/master/krippendorff.pdf. )coder1dress1YEScoder2r NOcoder3r r rdress2r r rr )rdress3r 燼1UUտNrassertAlmostEqualalphaselfdataannotation_tasks U/var/www/openai/venv/lib/python3.12/site-packages/nltk/test/unit/test_disagreement.py test_easyzTestDisagreement.test_easy s.  ). 446 Ccbgd}t|}|j|jdy)z Same simple test with 1 rating removed. Removal of that rating should not matter: K-Apha ignores items with only 1 rating. )rr rrrrNrrs r test_easy2zTestDisagreement.test_easy2s.  ). 446 Crcgd}t|}|j|jdgd}t|}|j|jdy)zD If expected disagreement is 0, K-Apha should be 1. )r1r r#r$r2)r r'r(g?)r"r%r&Nrrs r test_easy3zTestDisagreement.test_easy3+sV  ). 446<K(. 446rrrrs%D D ="1Hf1Hrr)unittestnltk.metrics.agreementrTestCaserrCrrrGs!1ZHx((ZHr