mlqa

  • Description:

MLQA (Multilingual Question Answering Dataset) is a benchmark dataset for evaluating multilingual question answering performance. The dataset consists of 7 languages: Arabic, German, Spanish, English, Hindi, Vietnamese, Chinese.

FeaturesDict({
    'answers': Sequence({
        'answer_start': int32,
        'text': Text(shape=(), dtype=string),
    }),
    'context': Text(shape=(), dtype=string),
    'id': string,
    'question': Text(shape=(), dtype=string),
    'title': Text(shape=(), dtype=string),
})
  • Feature documentation:
Feature Class Shape Dtype Description
FeaturesDict
answers Sequence
answers/answer_start Tensor int32
answers/text Text string
context Text string
id Tensor string
question Text string
title Text string
@article{lewis2019mlqa,
  title={MLQA: Evaluating Cross-lingual Extractive Question Answering},
  author={Lewis, Patrick and Ouguz, Barlas and Rinott, Ruty and Riedel,   Sebastian and Schwenk, Holger},
  journal={arXiv preprint arXiv:1910.07475},
  year={2019}
}

mlqa/ar (default config)

  • Config description: MLQA 'ar' dev and test splits.

  • Dataset size: 9.28 MiB

  • Splits:

Split Examples
'test' 5,335
'validation' 517

mlqa/de

  • Config description: MLQA 'de' dev and test splits.

  • Dataset size: 5.06 MiB

  • Splits:

Split Examples
'test' 4,517
'validation' 512

mlqa/en

  • Config description: MLQA 'en' dev and test splits.

  • Dataset size: 15.72 MiB

  • Splits:

Split Examples
'test' 11,590
'validation' 1,148

mlqa/es

  • Config description: MLQA 'es' dev and test splits.

  • Dataset size: 5.09 MiB

  • Splits:

Split Examples
'test' 5,253
'validation' 500

mlqa/hi

  • Config description: MLQA 'hi' dev and test splits.

  • Dataset size: 12.83 MiB

  • Splits:

Split Examples
'test' 4,918
'validation' 507

mlqa/vi

  • Config description: MLQA 'vi' dev and test splits.

  • Dataset size: 8.77 MiB

  • Splits:

Split Examples
'test' 5,495
'validation' 511

mlqa/zh

  • Config description: MLQA 'zh' dev and test splits.

  • Dataset size: 5.13 MiB

  • Splits:

Split Examples
'test' 5,137
'validation' 504