Referências:
árabe
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/arabic')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 9995 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
chinês
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/chinese')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 6541 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
tcheco
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/czech')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 2520 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
holandês
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/dutch')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 10862 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
inglês
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/english')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 57945 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
francês
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/french')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 21690 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
alemão
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/german')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 20103 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
hindi
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/hindi')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 3402 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
indonésio
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/indonesian')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 16308 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
italiano
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/italian')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 17673 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
japonês
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/japanese')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 4372 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
coreano
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/korean')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 4111 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
Português
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/portuguese')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 28143 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
russo
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/russian')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 18143 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
espanhol
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/spanish')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 38795 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
tailandês
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/thai')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 5093 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
turco
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/turkish')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 1512 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
vietnamita
Use o seguinte comando para carregar esse conjunto de dados no TFDS:
ds = tfds.load('huggingface:wiki_lingua/vietnamese')
- Descrição :
WikiLingua is a large-scale multilingual dataset for the evaluation of
crosslingual abstractive summarization systems. The dataset includes ~770k
article and summary pairs in 18 languages from WikiHow. The gold-standard
article-summary alignments across languages was done by aligning the images
that are used to describe each how-to step in an article.
- Licença : CC BY-NC-SA 3.0
- Versão : 1.1.1
- Divisões :
| Dividir | Exemplos |
|---|---|
'train' | 6616 |
- Características :
{
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"article": {
"feature": {
"section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"document": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"summary": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"english_section_name": {
"dtype": "string",
"id": null,
"_type": "Value"
}
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}