msr_text_compression

مراجع:

برای بارگذاری این مجموعه داده در TFDS از دستور زیر استفاده کنید:

ds = tfds.load('huggingface:msr_text_compression')
  • توضیحات :
This dataset contains sentences and short paragraphs with corresponding shorter (compressed) versions. There are up to five compressions for each input text, together with quality judgements of their meaning preservation and grammaticality. The dataset is derived using source texts from the Open American National Corpus (ww.anc.org) and crowd-sourcing.
  • مجوز : قرارداد مجوز داده های تحقیقاتی مایکروسافت
  • نسخه : 1.1.0
  • تقسیم ها :
تقسیم کنید نمونه ها
'test' 785
'train' 4936
'validation' 447
  • ویژگی ها :
{
    "source_id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "domain": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "source_text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "targets": {
        "feature": {
            "compressed_text": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "judge_id": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            },
            "num_ratings": {
                "dtype": "int64",
                "id": null,
                "_type": "Value"
            },
            "ratings": {
                "feature": {
                    "dtype": "int64",
                    "id": null,
                    "_type": "Value"
                },
                "length": -1,
                "id": null,
                "_type": "Sequence"
            }
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}