হেট ব্যাখ্যা

তথ্যসূত্র:

প্লেইন_টেক্সট

TFDS এ এই ডেটাসেট লোড করতে নিম্নলিখিত কমান্ডটি ব্যবহার করুন:

ds = tfds.load('huggingface:hatexplain/plain_text')
  • বর্ণনা :
Hatexplain is the first benchmark hate speech dataset covering multiple aspects of the issue. Each post in the dataset is annotated from three different perspectives: the basic, commonly used 3-class classification (i.e., hate, offensive or normal), the target community (i.e., the community that has been the victim of hate speech/offensive speech in the post), and the rationales, i.e., the portions of the post on which their labelling decision (as hate, offensive or normal) is based.
  • লাইসেন্স : cc-by-4.0
  • সংস্করণ : 1.0.0
  • বিভাজন :
বিভক্ত উদাহরণ
'test' 1924
'train' 15383
'validation' 1922
  • বৈশিষ্ট্য :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "annotators": {
        "feature": {
            "label": {
                "num_classes": 3,
                "names": [
                    "hatespeech",
                    "normal",
                    "offensive"
                ],
                "names_file": null,
                "id": null,
                "_type": "ClassLabel"
            },
            "annotator_id": {
                "dtype": "int32",
                "id": null,
                "_type": "Value"
            },
            "target": {
                "feature": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "length": -1,
                "id": null,
                "_type": "Sequence"
            }
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "rationales": {
        "feature": {
            "feature": {
                "dtype": "int32",
                "id": null,
                "_type": "Value"
            },
            "length": -1,
            "id": null,
            "_type": "Sequence"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "post_tokens": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}