MDD

Références :

tâche1_qa

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:mdd/task1_qa')
  • Description :
The Movie Dialog dataset (MDD) is designed to measure how well
models can perform at goal and non-goal orientated dialog
centered around the topic of movies (question answering,
recommendation and discussion).
  • Licence : Licence Creative Commons Attribution 3.0
  • Version : 1.1.0
  • Divisions :
Diviser Exemples
'test' 9952
'train' 96185
'validation' 9968
  • Caractéristiques : 
{
    "dialogue_turns": {
        "feature": {
            "speaker": {
                "dtype": "int32",
                "id": null,
                "_type": "Value"
            },
            "utterance": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

tâche2_recs

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:mdd/task2_recs')
  • Description :
The Movie Dialog dataset (MDD) is designed to measure how well
models can perform at goal and non-goal orientated dialog
centered around the topic of movies (question answering,
recommendation and discussion).
  • Licence : Licence Creative Commons Attribution 3.0
  • Version : 1.1.0
  • Divisions :
Diviser Exemples
'test' 10000
'train' 1000000
'validation' 10000
  • Caractéristiques : 
{
    "dialogue_turns": {
        "feature": {
            "speaker": {
                "dtype": "int32",
                "id": null,
                "_type": "Value"
            },
            "utterance": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

task3_qarecs

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:mdd/task3_qarecs')
  • Description :
The Movie Dialog dataset (MDD) is designed to measure how well
models can perform at goal and non-goal orientated dialog
centered around the topic of movies (question answering,
recommendation and discussion).
  • Licence : Licence Creative Commons Attribution 3.0
  • Version : 1.1.0
  • Divisions :
Diviser Exemples
'test' 4915
'train' 952125
'validation' 5052
  • Caractéristiques : 
{
    "dialogue_turns": {
        "feature": {
            "speaker": {
                "dtype": "int32",
                "id": null,
                "_type": "Value"
            },
            "utterance": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

tâche4_reddit

Utilisez la commande suivante pour charger cet ensemble de données dans TFDS :

ds = tfds.load('huggingface:mdd/task4_reddit')
  • Description :
The Movie Dialog dataset (MDD) is designed to measure how well
models can perform at goal and non-goal orientated dialog
centered around the topic of movies (question answering,
recommendation and discussion).
  • Licence : Licence Creative Commons Attribution 3.0
  • Version : 1.1.0
  • Divisions :
Diviser Exemples
'cand_test' 10000
'cand_valid' 10000
'test' 10000
'train' 945198
'validation' 10000
  • Caractéristiques :
{
    "dialogue_turns": {
        "feature": {
            "speaker": {
                "dtype": "int32",
                "id": null,
                "_type": "Value"
            },
            "utterance": {
                "dtype": "string",
                "id": null,
                "_type": "Value"
            }
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}