Merge pull request #2 from Toloka/autosync

Autosync

Author: tulinev

.devexp.json

@@ -0,0 +1,13 @@
+{
+    "strict": true,
+    "notification": "email",
+    "static_members": [
+        "losev",
+        "sinosov",
+        "tulinev",
+        "vlad-mois",
+        "alexdrydew"
+    ],
+    "approve_count": 1,
+    "total_reviewers": 1
+}

CHANGELOG.md

@@ -1,3 +1,10 @@
+0.0.6
+-------------------
+* Added realization of inter-annotator agreement coefficient (Krippendorff 1980):
+  * `alpha_krippendorff`
+* Added usage examples.
+
+ 
 0.0.5
 -------------------
 * Added aggregations for image segmentation problem:

README.md

@@ -60,24 +60,24 @@ aggregated_labels = DawidSkene(n_iter=100).fit_predict(df)
 |[M-MSR](https://proceedings.neurips.cc/paper/2020/hash/f86890095c957e9b949d11d15f0d0cd5-Abstract.html)|✅|
 |Wawa|✅|
 |Zero-Based Skill|✅|
-|[GLAD](https://papers.nips.cc/paper/3644-whose-vote-should-count-more-optimal-integration-of-labels-from-labelers-of-unknown-expertise.pdf)|❌|
-|BCC|❌|
+|[GLAD](https://papers.nips.cc/paper/3644-whose-vote-should-count-more-optimal-integration-of-labels-from-labelers-of-unknown-expertise.pdf)|🟡|
+|BCC|🟡|
 
 ### Textual Responses
 
 |Method|Status|
 |-|:-:|
 |[RASA](https://doi.org/10.18653/v1/D19-5904)|✅|
 |[HRRASA](https://doi.org/10.1145/3397271.3401239)|✅|
-|[ROVER](https://ieeexplore.ieee.org/document/659110)|❌|
+|[ROVER](https://ieeexplore.ieee.org/document/659110)|🟡|
 
 ### Image Segmentation
 
 |Method|Status|
 |-|:-:|
 |Segmentation MV|✅|
-|Segmentation RASA|❌|
-|Segmentation EM|❌|
+|Segmentation RASA|🟡|
+|Segmentation EM|🟡|
 
 ### Pairwise Comparisons