discofuse

References:

discofuse-sport

Use the following command to load this dataset in TFDS:

ds = tfds.load('huggingface:discofuse/discofuse-sport')
  • Description:
DISCOFUSE is a large scale dataset for discourse-based sentence fusion.
  • License: No known license
  • Version: 1.0.0
  • Splits:
Split Examples
'test' 445521
'train' 43291020
'validation' 440902
  • Features:
{
    "connective_string": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "discourse_type": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "coherent_second_sentence": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "has_coref_type_pronoun": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    },
    "incoherent_first_sentence": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "incoherent_second_sentence": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "has_coref_type_nominal": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    },
    "coherent_first_sentence": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}

discofuse-wikipedia

Use the following command to load this dataset in TFDS:

ds = tfds.load('huggingface:discofuse/discofuse-wikipedia')
  • Description:
DISCOFUSE is a large scale dataset for discourse-based sentence fusion.
  • License: No known license
  • Version: 1.0.0
  • Splits:
Split Examples
'test' 163657
'train' 16310585
'validation' 168081
  • Features:
{
    "connective_string": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "discourse_type": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "coherent_second_sentence": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "has_coref_type_pronoun": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    },
    "incoherent_first_sentence": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "incoherent_second_sentence": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "has_coref_type_nominal": {
        "dtype": "float32",
        "id": null,
        "_type": "Value"
    },
    "coherent_first_sentence": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}