Referanslar:
birleştirilmiş-csv
Bu veri kümesini TFDS'ye yüklemek için aşağıdaki komutu kullanın:
ds = tfds.load('huggingface:newsqa/combined-csv')
- Tanım :
NewsQA is a challenging machine comprehension dataset of over 100,000 human-generated question-answer pairs. Crowdworkers supply questions and answers based on a set of over 10,000 news articles from CNN, with answers consisting of spans of text from the corresponding articles.
- Lisans : NewsQA CodeTelif Hakkı (c) Microsoft Corporation Tüm hakları saklıdır. MİT Lisansı
- Sürüm : 1.0.0
- Bölünmeler :
| Bölmek | Örnekler |
|---|---|
'train' | 119633 |
- Özellikler :
{
"story_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"story_text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"answer_char_ranges": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
birleştirilmiş-json
Bu veri kümesini TFDS'ye yüklemek için aşağıdaki komutu kullanın:
ds = tfds.load('huggingface:newsqa/combined-json')
- Tanım :
NewsQA is a challenging machine comprehension dataset of over 100,000 human-generated question-answer pairs. Crowdworkers supply questions and answers based on a set of over 10,000 news articles from CNN, with answers consisting of spans of text from the corresponding articles.
- Lisans : NewsQA CodeTelif Hakkı (c) Microsoft Corporation Tüm hakları saklıdır. MİT Lisansı
- Sürüm : 1.0.0
- Bölünmeler :
| Bölmek | Örnekler |
|---|---|
'train' | 12744 |
- Özellikler :
{
"storyId": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"type": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"questions": {
"feature": {
"q": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"isAnswerAbsent": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"isQuestionBad": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"consensus": {
"s": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"e": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"badQuestion": {
"dtype": "bool",
"id": null,
"_type": "Value"
},
"noAnswer": {
"dtype": "bool",
"id": null,
"_type": "Value"
}
},
"answers": {
"feature": {
"sourcerAnswers": {
"feature": {
"s": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"e": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"badQuestion": {
"dtype": "bool",
"id": null,
"_type": "Value"
},
"noAnswer": {
"dtype": "bool",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"validated_answers": {
"feature": {
"s": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"e": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"badQuestion": {
"dtype": "bool",
"id": null,
"_type": "Value"
},
"noAnswer": {
"dtype": "bool",
"id": null,
"_type": "Value"
},
"count": {
"dtype": "int32",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
bölmek
Bu veri kümesini TFDS'ye yüklemek için aşağıdaki komutu kullanın:
ds = tfds.load('huggingface:newsqa/split')
- Tanım :
NewsQA is a challenging machine comprehension dataset of over 100,000 human-generated question-answer pairs. Crowdworkers supply questions and answers based on a set of over 10,000 news articles from CNN, with answers consisting of spans of text from the corresponding articles.
- Lisans : NewsQA CodeTelif Hakkı (c) Microsoft Corporation Tüm hakları saklıdır. MİT Lisansı
- Sürüm : 1.0.0
- Bölünmeler :
| Bölmek | Örnekler |
|---|---|
'test' | 5126 |
'train' | 92549 |
'validation' | 5166 |
- Özellikler :
{
"story_id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"story_text": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"answer_token_ranges": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}