参考文献:
アラビア語
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/arabic')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 9995 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
中国人
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/chinese')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 6541 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
チェコ語
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/czech')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 2520 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
オランダ人
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/dutch')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 10862 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
英語
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/english')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 57945 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
フランス語
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/french')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 21690 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
ドイツ人
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/german')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 20103 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
ヒンディー語
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/hindi')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 3402 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
インドネシア人
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/indonesian')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 16308 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
イタリア語
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/italian')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 17673 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
日本語
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/japanese')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 4372 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
韓国人
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/korean')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 4111 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
ポルトガル語
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/portuguese')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 28143 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
ロシア
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/russian')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 18143 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
スペイン語
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/spanish')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 38795 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
タイ人
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/thai')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 5093 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
トルコ語
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/turkish')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 1512 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
ベトナム語
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:wiki_lingua/vietnamese')
- 説明：
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- ライセンス: CC BY-NC-SA 3.0
- バージョン: 1.1.1
- 分割:
| スプリット | 例 |
|---|---|
'train' | 6616 |
- 特徴：
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}