Referências:
one_person_dialogs
Use o seguinte comando para carregar este conjunto de dados no TFDS:
ds = tfds.load('huggingface:taskmaster1/one_person_dialogs')
- Descrição :
Taskmaster-1:Toward a Realistic and Diverse Dialog Dataset) is an evaluation set for commonsense question-answering in the sentence completion style of SWAG. As opposed to other automatically generated NLI datasets, CODAH is adversarially constructed by humans who can view feedback from a pre-trained model and use this information to design challenging commonsense questions. Our experimental results show that CODAH questions present a complementary extension to the SWAG dataset, testing additional modes of common sense.
- Licença : Nenhuma licença conhecida
- Versão : 1.0.0
- Divisões :
| Dividir | Exemplos |
|---|---|
'test' | 770 |
'train' | 6168 |
'validation' | 770 |
- Características :
{
"conversation_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"instruction_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"utterances": [
{
"index": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"speaker": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"segments": [
{
"start_index": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"end_index": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"annotations": [
{
"name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
]
}
]
}
]
}
woz_dialogs
Use o seguinte comando para carregar este conjunto de dados no TFDS:
ds = tfds.load('huggingface:taskmaster1/woz_dialogs')
- Descrição :
Taskmaster-1:Toward a Realistic and Diverse Dialog Dataset) is an evaluation set for commonsense question-answering in the sentence completion style of SWAG. As opposed to other automatically generated NLI datasets, CODAH is adversarially constructed by humans who can view feedback from a pre-trained model and use this information to design challenging commonsense questions. Our experimental results show that CODAH questions present a complementary extension to the SWAG dataset, testing additional modes of common sense.
- Licença : Nenhuma licença conhecida
- Versão : 1.0.0
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 5507 |
- Características :
{
"conversation_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"instruction_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"utterances": [
{
"index": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"speaker": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"segments": [
{
"start_index": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"end_index": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"annotations": [
{
"name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
]
}
]
}
]
}