Referencias:
bg-el
Utilice el siguiente comando para cargar este conjunto de datos en TFDS:
ds = tfds.load('huggingface:emea/bg-el')
- Descripción :
This is a parallel corpus made out of PDF documents from the European Medicines Agency. All files are automatically converted from PDF to plain text using pdftotext with the command line arguments -layout -nopgbrk -eol unix. There are some known problems with tables and multi-column layouts - some of them are fixed in the current version.
source: http://www.emea.europa.eu/
22 languages, 231 bitexts
total number of files: 41,957
total number of tokens: 311.65M
total number of sentence fragments: 26.51M
- Licencia : Sin licencia conocida
- Versión : 3.0.0
- Divisiones :
Separar | Ejemplos |
---|---|
'train' | 1044065 |
- Características :
{
"id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"translation": {
"languages": [
"bg",
"el"
],
"id": null,
"_type": "Translation"
}
}
cs-et
Utilice el siguiente comando para cargar este conjunto de datos en TFDS:
ds = tfds.load('huggingface:emea/cs-et')
- Descripción :
This is a parallel corpus made out of PDF documents from the European Medicines Agency. All files are automatically converted from PDF to plain text using pdftotext with the command line arguments -layout -nopgbrk -eol unix. There are some known problems with tables and multi-column layouts - some of them are fixed in the current version.
source: http://www.emea.europa.eu/
22 languages, 231 bitexts
total number of files: 41,957
total number of tokens: 311.65M
total number of sentence fragments: 26.51M
- Licencia : Sin licencia conocida
- Versión : 3.0.0
- Divisiones :
Separar | Ejemplos |
---|---|
'train' | 1053164 |
- Características :
{
"id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"translation": {
"languages": [
"cs",
"et"
],
"id": null,
"_type": "Translation"
}
}
de-mt
Utilice el siguiente comando para cargar este conjunto de datos en TFDS:
ds = tfds.load('huggingface:emea/de-mt')
- Descripción :
This is a parallel corpus made out of PDF documents from the European Medicines Agency. All files are automatically converted from PDF to plain text using pdftotext with the command line arguments -layout -nopgbrk -eol unix. There are some known problems with tables and multi-column layouts - some of them are fixed in the current version.
source: http://www.emea.europa.eu/
22 languages, 231 bitexts
total number of files: 41,957
total number of tokens: 311.65M
total number of sentence fragments: 26.51M
- Licencia : Sin licencia conocida
- Versión : 3.0.0
- Divisiones :
Separar | Ejemplos |
---|---|
'train' | 1000532 |
- Características :
{
"id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"translation": {
"languages": [
"de",
"mt"
],
"id": null,
"_type": "Translation"
}
}
fr-sk
Utilice el siguiente comando para cargar este conjunto de datos en TFDS:
ds = tfds.load('huggingface:emea/fr-sk')
- Descripción :
This is a parallel corpus made out of PDF documents from the European Medicines Agency. All files are automatically converted from PDF to plain text using pdftotext with the command line arguments -layout -nopgbrk -eol unix. There are some known problems with tables and multi-column layouts - some of them are fixed in the current version.
source: http://www.emea.europa.eu/
22 languages, 231 bitexts
total number of files: 41,957
total number of tokens: 311.65M
total number of sentence fragments: 26.51M
- Licencia : Sin licencia conocida
- Versión : 3.0.0
- Divisiones :
Separar | Ejemplos |
---|---|
'train' | 1062753 |
- Características :
{
"id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"translation": {
"languages": [
"fr",
"sk"
],
"id": null,
"_type": "Translation"
}
}
es-lt
Utilice el siguiente comando para cargar este conjunto de datos en TFDS:
ds = tfds.load('huggingface:emea/es-lt')
- Descripción :
This is a parallel corpus made out of PDF documents from the European Medicines Agency. All files are automatically converted from PDF to plain text using pdftotext with the command line arguments -layout -nopgbrk -eol unix. There are some known problems with tables and multi-column layouts - some of them are fixed in the current version.
source: http://www.emea.europa.eu/
22 languages, 231 bitexts
total number of files: 41,957
total number of tokens: 311.65M
total number of sentence fragments: 26.51M
- Licencia : Sin licencia conocida
- Versión : 3.0.0
- Divisiones :
Separar | Ejemplos |
---|---|
'train' | 1051370 |
- Características :
{
"id": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"translation": {
"languages": [
"es",
"lt"
],
"id": null,
"_type": "Translation"
}
}