مراجع:
تامیل
برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:
ds = tfds.load('huggingface:offenseval_dravidian/tamil')
- توضیحات :
Offensive language identification in dravidian lanaguages dataset. The goal of this task is to identify offensive language content of the code-mixed dataset of comments/posts in Dravidian Languages ( (Tamil-English, Malayalam-English, and Kannada-English)) collected from social media.
- مجوز : مجوز بین المللی Creative Commons Attribution 4.0
- نسخه : 1.0.0
- تقسیم ها :
تقسیم کنید | نمونه ها |
---|---|
'train' | 35139 |
'validation' | 4388 |
- ویژگی ها :
{
"text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 6,
"names": [
"Not_offensive",
"Offensive_Untargetede",
"Offensive_Targeted_Insult_Individual",
"Offensive_Targeted_Insult_Group",
"Offensive_Targeted_Insult_Other",
"not-Tamil"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
}
}
مالایالام
برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:
ds = tfds.load('huggingface:offenseval_dravidian/malayalam')
- توضیحات :
Offensive language identification in dravidian lanaguages dataset. The goal of this task is to identify offensive language content of the code-mixed dataset of comments/posts in Dravidian Languages ( (Tamil-English, Malayalam-English, and Kannada-English)) collected from social media.
- مجوز : مجوز بین المللی Creative Commons Attribution 4.0
- نسخه : 1.0.0
- تقسیم ها :
تقسیم کنید | نمونه ها |
---|---|
'train' | 16010 |
'validation' | 1999 |
- ویژگی ها :
{
"text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 6,
"names": [
"Not_offensive",
"Offensive_Untargetede",
"Offensive_Targeted_Insult_Individual",
"Offensive_Targeted_Insult_Group",
"Offensive_Targeted_Insult_Other",
"not-malayalam"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
}
}
کانادا
برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:
ds = tfds.load('huggingface:offenseval_dravidian/kannada')
- توضیحات :
Offensive language identification in dravidian lanaguages dataset. The goal of this task is to identify offensive language content of the code-mixed dataset of comments/posts in Dravidian Languages ( (Tamil-English, Malayalam-English, and Kannada-English)) collected from social media.
- مجوز : مجوز بین المللی Creative Commons Attribution 4.0
- نسخه : 1.0.0
- تقسیم ها :
تقسیم کنید | نمونه ها |
---|---|
'train' | 6217 |
'validation' | 777 |
- ویژگی ها :
{
"text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"label": {
"num_classes": 6,
"names": [
"Not_offensive",
"Offensive_Untargetede",
"Offensive_Targeted_Insult_Individual",
"Offensive_Targeted_Insult_Group",
"Offensive_Targeted_Insult_Other",
"not-Kannada"
],
"names_file": null,
"id": null,
"_type": "ClassLabel"
}
}