com_qa

참고자료:

TFDS에 이 데이터세트를 로드하려면 다음 명령어를 사용하세요.

ds = tfds.load('huggingface:com_qa')
  • 설명 :
ComQA is a dataset of 11,214 questions, which were collected from WikiAnswers, a community question answering website. 
By collecting questions from such a site we ensure that the information needs are ones of interest to actual users. 
Moreover, questions posed there are often cannot be answered by commercial search engines or QA technology, making them 
more interesting for driving future research compared to those collected from an engine's query log. The dataset contains 
questions with various challenging phenomena such as the need for temporal reasoning, comparison (e.g., comparatives, 
superlatives, ordinals), compositionality (multiple, possibly nested, subquestions with multiple entities), and 
unanswerable questions (e.g., Who was the first human being on Mars?). Through a large crowdsourcing effort, questions 
in ComQA are grouped into 4,834 paraphrase clusters that express the same information need. Each cluster is annotated 
with its answer(s). ComQA answers come in the form of Wikipedia entities wherever possible. Wherever the answers are 
temporal or measurable quantities, TIMEX3 and the International System of Units (SI) are used for normalization.
  • 라이센스 : 알려진 라이센스 없음
  • 버전 : 0.1.0
  • 분할 :
나뉘다
'test' 2243
'train' 3966
'validation' 966
  • 특징 :
{
    "cluster_id": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "questions": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answers": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}