persian_ner

مراجع:

fold1

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:persian_ner/fold1')
  • توضیحات :
The dataset includes 250,015 tokens and 7,682 Persian sentences in total. It is available in 3 folds to be used in turn as training and test sets. The NER tags are in IOB format.
  • مجوز : مجوز بین المللی Creative Commons Attribution 4.0
  • نسخه : 1.1.0
  • تقسیم ها :
تقسیم کنید نمونه ها
'test' 2560
'train' 5121
  • ویژگی ها :
{
    "tokens": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "ner_tags": {
        "feature": {
            "num_classes": 13,
            "names": [
                "O",
                "I-event",
                "I-fac",
                "I-loc",
                "I-org",
                "I-pers",
                "I-pro",
                "B-event",
                "B-fac",
                "B-loc",
                "B-org",
                "B-pers",
                "B-pro"
            ],
            "names_file": null,
            "id": null,
            "_type": "ClassLabel"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

fold2

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:persian_ner/fold2')
  • توضیحات :
The dataset includes 250,015 tokens and 7,682 Persian sentences in total. It is available in 3 folds to be used in turn as training and test sets. The NER tags are in IOB format.
  • مجوز : مجوز بین المللی Creative Commons Attribution 4.0
  • نسخه : 1.1.0
  • تقسیم ها :
تقسیم کنید نمونه ها
'test' 2561
'train' 5120
  • ویژگی ها :
{
    "tokens": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "ner_tags": {
        "feature": {
            "num_classes": 13,
            "names": [
                "O",
                "I-event",
                "I-fac",
                "I-loc",
                "I-org",
                "I-pers",
                "I-pro",
                "B-event",
                "B-fac",
                "B-loc",
                "B-org",
                "B-pers",
                "B-pro"
            ],
            "names_file": null,
            "id": null,
            "_type": "ClassLabel"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

fold3

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:persian_ner/fold3')
  • توضیحات :
The dataset includes 250,015 tokens and 7,682 Persian sentences in total. It is available in 3 folds to be used in turn as training and test sets. The NER tags are in IOB format.
  • مجوز : مجوز بین المللی Creative Commons Attribution 4.0
  • نسخه : 1.1.0
  • تقسیم ها :
تقسیم کنید نمونه ها
'test' 2560
'train' 5121
  • ویژگی ها :
{
    "tokens": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "ner_tags": {
        "feature": {
            "num_classes": 13,
            "names": [
                "O",
                "I-event",
                "I-fac",
                "I-loc",
                "I-org",
                "I-pers",
                "I-pro",
                "B-event",
                "B-fac",
                "B-loc",
                "B-org",
                "B-pers",
                "B-pro"
            ],
            "names_file": null,
            "id": null,
            "_type": "ClassLabel"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}