update default for the filter_both_ac parameter in IAA score calculation#18
update default for the filter_both_ac parameter in IAA score calculation#18ypislon wants to merge 4 commits into
Conversation
…r, change default in get_annotation_pairs
|
While working through the demo notebook again, I understood a use case for the tl;dr: we cannot see mismatches in two collections when we filter both collections by the same tag. imo the default being |
This updates the default value for the parameter
filter_both_acin the calculation of IAA scores (Scotts Pi and Cohens Kappa).Now, the functions
get_iaa,calculate_scotts_piandcalculate_cohens_kappawould filter both annotation collections by the given tag. This can still be overridden by settingfilter_both_acmanually.This behavior reflects the defaults in the underlying tag filter function (
filter_ac_by_tag).