스마트데이터

참고자료:

smartdata-v3_20200302

TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.

ds = tfds.load('huggingface:smartdata/smartdata-v3_20200302')
  • 설명 :
DFKI SmartData Corpus is a dataset of 2598 German-language documents
which has been annotated with fine-grained geo-entities, such as streets,
stops and routes, as well as standard named entity types. It has also
been annotated with a set of 15 traffic- and industry-related n-ary
relations and events, such as Accidents, Traffic jams, Acquisitions,
and Strikes. The corpus consists of newswire texts, Twitter messages,
and traffic reports from radio stations, police and railway companies.
It allows for training and evaluating both named entity recognition
algorithms that aim for fine-grained typing of geo-entities, as well
as n-ary relation extraction systems.
  • 라이센스 : CC-BY 4.0
  • 버전 : 1.1.0
  • 분할 :
나뉘다
'test' 230
'train' 1861년
'validation' 228
  • 특징 :
{
    "id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "tokens": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "ner_tags": {
        "feature": {
            "num_classes": 33,
            "names": [
                "O",
                "B-DATE",
                "I-DATE",
                "B-DISASTER_TYPE",
                "I-DISASTER_TYPE",
                "B-DISTANCE",
                "I-DISTANCE",
                "B-DURATION",
                "I-DURATION",
                "B-LOCATION",
                "I-LOCATION",
                "B-LOCATION_CITY",
                "I-LOCATION_CITY",
                "B-LOCATION_ROUTE",
                "I-LOCATION_ROUTE",
                "B-LOCATION_STOP",
                "I-LOCATION_STOP",
                "B-LOCATION_STREET",
                "I-LOCATION_STREET",
                "B-NUMBER",
                "I-NUMBER",
                "B-ORGANIZATION",
                "I-ORGANIZATION",
                "B-ORGANIZATION_COMPANY",
                "I-ORGANIZATION_COMPANY",
                "B-ORG_POSITION",
                "I-ORG_POSITION",
                "B-PERSON",
                "I-PERSON",
                "B-TIME",
                "I-TIME",
                "B-TRIGGER",
                "I-TRIGGER"
            ],
            "names_file": null,
            "id": null,
            "_type": "ClassLabel"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}