杉

参考文献:

主要

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:cedr/main')
  • 説明： 
This new dataset is designed to solve emotion recognition task for text data in Russian. The Corpus for Emotions Detecting in
Russian-language text sentences of different social sources (CEDR) contains 9410 sentences in Russian labeled for 5 emotion
categories. The data collected from different sources: posts of the LiveJournal social network, texts of the online news
agency Lenta.ru, and Twitter microblog posts. There are two variants of the corpus: main and enriched. The enriched variant
is include tokenization and lemmatization. Dataset with predefined train/test splits.
スプリット例
'test' 1882年
'train' 7528
  • 特徴： 
{
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "labels": {
        "feature": {
            "num_classes": 5,
            "names": [
                "joy",
                "sadness",
                "surprise",
                "fear",
                "anger"
            ],
            "names_file": null,
            "id": null,
            "_type": "ClassLabel"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "source": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

豊かな

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:cedr/enriched')
  • 説明： 
This new dataset is designed to solve emotion recognition task for text data in Russian. The Corpus for Emotions Detecting in
Russian-language text sentences of different social sources (CEDR) contains 9410 sentences in Russian labeled for 5 emotion
categories. The data collected from different sources: posts of the LiveJournal social network, texts of the online news
agency Lenta.ru, and Twitter microblog posts. There are two variants of the corpus: main and enriched. The enriched variant
is include tokenization and lemmatization. Dataset with predefined train/test splits.
スプリット例
'test' 1882年
'train' 7528
  • 特徴： 
{
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "labels": {
        "feature": {
            "num_classes": 5,
            "names": [
                "joy",
                "sadness",
                "surprise",
                "fear",
                "anger"
            ],
            "names_file": null,
            "id": null,
            "_type": "ClassLabel"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "source": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "sentences": [
        [
            {
                "forma": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                },
                "lemma": {
                    "dtype": "string",
                    "id": null,
                    "_type": "Value"
                }
            }
        ]
    ]
}