ヘイトスピーチ18

参考文献:

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hate_speech18')
  • 説明： 
These files contain text extracted from Stormfront, a white supremacist forum. A random set of 
forums posts have been sampled from several subforums and split into sentences. Those sentences 
have been manually labelled as containing hate speech or not, according to certain annotation guidelines.
  • ライセンス: 既知のライセンスはありません
  • バージョン: 0.0.0
  • 分割:
スプリット例
'train' 10944
  • 特徴： 
{
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "user_id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "subforum_id": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "num_contexts": {
        "dtype": "int64",
        "id": null,
        "_type": "Value"
    },
    "label": {
        "num_classes": 4,
        "names": [
            "noHate",
            "hate",
            "idk/skip",
            "relation"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}