参考文献:
カラスペア
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:crows_pairs/crows_pairs')
- 説明：
CrowS-Pairs, a challenge dataset for measuring the degree to which U.S. stereotypical biases present in the masked language models (MLMs).
- ライセンス: 既知のライセンスはありません
- バージョン: 1.0.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 1508年 |
- 特徴：
{
"id": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"sent_more": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"sent_less": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"stereo_antistereo": {
"num_classes": 2,
"names": [
"stereo",
"antistereo"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"bias_type": {
"num_classes": 9,
"names": [
"race-color",
"socioeconomic",
"gender",
"disability",
"nationality",
"sexual-orientation",
"physical-appearance",
"religion",
"age"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"annotations": {
"feature": {
"feature": {
"num_classes": 9,
"names": [
"race-color",
"socioeconomic",
"gender",
"disability",
"nationality",
"sexual-orientation",
"physical-appearance",
"religion",
"age"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"anon_writer": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"anon_annotators": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}