indonlu

Referências:

• Código
• Abraço

emote

Use o seguinte comando para carregar esse conjunto de dados no TFDS:

ds = tfds.load('huggingface:indonlu/emot')

• Descrição :

An emotion classification dataset collected from the social media
platform Twitter (Saputri et al., 2018). The dataset consists of
around 4000 Indonesian colloquial language tweets, covering five
different emotion labels: sadness, anger, love, fear, and happy.

• Licença : Nenhuma licença conhecida
• Versão : 1.0.0
• Divisões :

• Características :

{
    "tweet": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "label": {
        "num_classes": 5,
        "names": [
            "sadness",
            "anger",
            "love",
            "fear",
            "happy"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

SMS

Use o seguinte comando para carregar esse conjunto de dados no TFDS:

ds = tfds.load('huggingface:indonlu/smsa')

• Descrição :

This sentence-level sentiment analysis dataset (Purwarianti and Crisdayanti, 2019)
is a collection of comments and reviews in Indonesian obtained from multiple online
platforms. The text was crawled and then annotated by several Indonesian linguists
to construct this dataset. There are three possible sentiments on the SmSA
dataset: positive, negative, and neutral.

• Licença : Nenhuma licença conhecida
• Versão : 1.0.0
• Divisões :

• Características :

{
    "text": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "label": {
        "num_classes": 3,
        "names": [
            "positive",
            "neutral",
            "negative"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

casa

Use o seguinte comando para carregar esse conjunto de dados no TFDS:

ds = tfds.load('huggingface:indonlu/casa')

• Descrição :

An aspect-based sentiment analysis dataset consisting of around a thousand car reviews collected
from multiple Indonesian online automobile platforms (Ilmania et al., 2018). The dataset covers
six aspects of car quality. We define the task to be a multi-label classification task, where
each label represents a sentiment for a single aspect with three possible values: positive,
negative, and neutral.

• Licença : Nenhuma licença conhecida
• Versão : 1.0.0
• Divisões :

• Características :

{
    "sentence": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "fuel": {
        "num_classes": 3,
        "names": [
            "negative",
            "neutral",
            "positive"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "machine": {
        "num_classes": 3,
        "names": [
            "negative",
            "neutral",
            "positive"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "others": {
        "num_classes": 3,
        "names": [
            "negative",
            "neutral",
            "positive"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "part": {
        "num_classes": 3,
        "names": [
            "negative",
            "neutral",
            "positive"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "price": {
        "num_classes": 3,
        "names": [
            "negative",
            "neutral",
            "positive"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "service": {
        "num_classes": 3,
        "names": [
            "negative",
            "neutral",
            "positive"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

hoasa

Use o seguinte comando para carregar esse conjunto de dados no TFDS:

ds = tfds.load('huggingface:indonlu/hoasa')

• Descrição :

An aspect-based sentiment analysis dataset consisting of hotel reviews collected from the hotel
aggregator platform, AiryRooms (Azhar et al., 2019). The dataset covers ten different aspects of
hotel quality. Each review is labeled with a single sentiment label for each aspect. There are
four possible sentiment classes for each sentiment label: positive, negative, neutral, and
positive-negative. The positivenegative label is given to a review that contains multiple sentiments
of the same aspect but for different objects (e.g., cleanliness of bed and toilet).

• Licença : Nenhuma licença conhecida
• Versão : 1.0.0
• Divisões :

• Características :

{
    "sentence": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "ac": {
        "num_classes": 4,
        "names": [
            "neg",
            "neut",
            "pos",
            "neg_pos"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "air_panas": {
        "num_classes": 4,
        "names": [
            "neg",
            "neut",
            "pos",
            "neg_pos"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "bau": {
        "num_classes": 4,
        "names": [
            "neg",
            "neut",
            "pos",
            "neg_pos"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "general": {
        "num_classes": 4,
        "names": [
            "neg",
            "neut",
            "pos",
            "neg_pos"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "kebersihan": {
        "num_classes": 4,
        "names": [
            "neg",
            "neut",
            "pos",
            "neg_pos"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "linen": {
        "num_classes": 4,
        "names": [
            "neg",
            "neut",
            "pos",
            "neg_pos"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "service": {
        "num_classes": 4,
        "names": [
            "neg",
            "neut",
            "pos",
            "neg_pos"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "sunrise_meal": {
        "num_classes": 4,
        "names": [
            "neg",
            "neut",
            "pos",
            "neg_pos"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "tv": {
        "num_classes": 4,
        "names": [
            "neg",
            "neut",
            "pos",
            "neg_pos"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    },
    "wifi": {
        "num_classes": 4,
        "names": [
            "neg",
            "neut",
            "pos",
            "neg_pos"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

escreveu

Use o seguinte comando para carregar esse conjunto de dados no TFDS:

ds = tfds.load('huggingface:indonlu/wrete')

• Descrição :

The Wiki Revision Edits Textual Entailment dataset (Setya and Mahendra, 2018) consists of 450 sentence pairs
constructed from Wikipedia revision history. The dataset contains pairs of sentences and binary semantic
relations between the pairs. The data are labeled as entailed when the meaning of the second sentence can be
derived from the first one, and not entailed otherwise.

• Licença : Nenhuma licença conhecida
• Versão : 1.0.0
• Divisões :

• Características :

{
    "premise": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "hypothesis": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "category": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "label": {
        "num_classes": 2,
        "names": [
            "NotEntail",
            "Entail_or_Paraphrase"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

correio

Use o seguinte comando para carregar esse conjunto de dados no TFDS:

ds = tfds.load('huggingface:indonlu/posp')

• Descrição :

This Indonesian part-of-speech tagging (POS) dataset (Hoesen and Purwarianti, 2018) is collected from Indonesian
news websites. The dataset consists of around 8000 sentences with 26 POS tags. The POS tag labels follow the
Indonesian Association of Computational Linguistics (INACL) POS Tagging Convention.

• Licença : Nenhuma licença conhecida
• Versão : 1.0.0
• Divisões :

• Características :

{
    "tokens": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "pos_tags": {
        "feature": {
            "num_classes": 26,
            "names": [
                "B-PPO",
                "B-KUA",
                "B-ADV",
                "B-PRN",
                "B-VBI",
                "B-PAR",
                "B-VBP",
                "B-NNP",
                "B-UNS",
                "B-VBT",
                "B-VBL",
                "B-NNO",
                "B-ADJ",
                "B-PRR",
                "B-PRK",
                "B-CCN",
                "B-$$$",
                "B-ADK",
                "B-ART",
                "B-CSN",
                "B-NUM",
                "B-SYM",
                "B-INT",
                "B-NEG",
                "B-PRI",
                "B-VBE"
            ],
            "names_file": null,
            "id": null,
            "_type": "ClassLabel"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

bapos

Use o seguinte comando para carregar esse conjunto de dados no TFDS:

ds = tfds.load('huggingface:indonlu/bapos')

• Descrição :

This POS tagging dataset (Dinakaramani et al., 2014) contains about 1000 sentences, collected from the PAN Localization
Project. In this dataset, each word is tagged by one of 23 POS tag classes. Data splitting used in this benchmark follows
the experimental setting used by Kurniawan and Aji (2018)

• Licença : Nenhuma licença conhecida
• Versão : 1.0.0
• Divisões :

• Características :

{
    "tokens": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "pos_tags": {
        "feature": {
            "num_classes": 41,
            "names": [
                "B-PR",
                "B-CD",
                "I-PR",
                "B-SYM",
                "B-JJ",
                "B-DT",
                "I-UH",
                "I-NND",
                "B-SC",
                "I-WH",
                "I-IN",
                "I-NNP",
                "I-VB",
                "B-IN",
                "B-NND",
                "I-CD",
                "I-JJ",
                "I-X",
                "B-OD",
                "B-RP",
                "B-RB",
                "B-NNP",
                "I-RB",
                "I-Z",
                "B-CC",
                "B-NEG",
                "B-VB",
                "B-NN",
                "B-MD",
                "B-UH",
                "I-NN",
                "B-PRP",
                "I-SC",
                "B-Z",
                "I-PRP",
                "I-OD",
                "I-SYM",
                "B-WH",
                "B-FW",
                "I-CC",
                "B-X"
            ],
            "names_file": null,
            "id": null,
            "_type": "ClassLabel"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

terma

Use o seguinte comando para carregar esse conjunto de dados no TFDS:

ds = tfds.load('huggingface:indonlu/terma')

• Descrição :

This span-extraction dataset is collected from the hotel aggregator platform, AiryRooms (Septiandri and Sutiono, 2019;
Fernando et al., 2019). The dataset consists of thousands of hotel reviews, which each contain a span label for aspect
and sentiment words representing the opinion of the reviewer on the corresponding aspect. The labels use
Inside-Outside-Beginning (IOB) tagging representation with two kinds of tags, aspect and sentiment.

• Licença : Nenhuma licença conhecida
• Versão : 1.0.0
• Divisões :

• Características :

{
    "tokens": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "seq_label": {
        "feature": {
            "num_classes": 5,
            "names": [
                "I-SENTIMENT",
                "O",
                "I-ASPECT",
                "B-SENTIMENT",
                "B-ASPECT"
            ],
            "names_file": null,
            "id": null,
            "_type": "ClassLabel"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

mantém

Use o seguinte comando para carregar esse conjunto de dados no TFDS:

ds = tfds.load('huggingface:indonlu/keps')

• Descrição :

This keyphrase extraction dataset (Mahfuzh et al., 2019) consists of text from Twitter discussing
banking products and services and is written in the Indonesian language. A phrase containing
important information is considered a keyphrase. Text may contain one or more keyphrases since
important phrases can be located at different positions. The dataset follows the IOB chunking format,
which represents the position of the keyphrase.

• Licença : Nenhuma licença conhecida
• Versão : 1.0.0
• Divisões :

• Características :

{
    "tokens": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "seq_label": {
        "feature": {
            "num_classes": 3,
            "names": [
                "O",
                "B",
                "I"
            ],
            "names_file": null,
            "id": null,
            "_type": "ClassLabel"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

nergrit

Use o seguinte comando para carregar esse conjunto de dados no TFDS:

ds = tfds.load('huggingface:indonlu/nergrit')

• Descrição :

This NER dataset is taken from the Grit-ID repository, and the labels are spans in IOB chunking representation.
The dataset consists of three kinds of named entity tags, PERSON (name of person), PLACE (name of location), and
ORGANIZATION (name of organization).

• Licença : Nenhuma licença conhecida
• Versão : 1.0.0
• Divisões :

• Características :

{
    "tokens": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "ner_tags": {
        "feature": {
            "num_classes": 7,
            "names": [
                "I-PERSON",
                "B-ORGANISATION",
                "I-ORGANISATION",
                "B-PLACE",
                "I-PLACE",
                "O",
                "B-PERSON"
            ],
            "names_file": null,
            "id": null,
            "_type": "ClassLabel"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

nerp

Use o seguinte comando para carregar esse conjunto de dados no TFDS:

ds = tfds.load('huggingface:indonlu/nerp')

• Descrição :

This NER dataset (Hoesen and Purwarianti, 2018) contains texts collected from several Indonesian news websites.
There are five labels available in this dataset, PER (name of person), LOC (name of location), IND (name of product or brand),
EVT (name of the event), and FNB (name of food and beverage). The NERP dataset uses the IOB chunking format.

• Licença : Nenhuma licença conhecida
• Versão : 1.0.0
• Divisões :

• Características :

{
    "tokens": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "ner_tags": {
        "feature": {
            "num_classes": 11,
            "names": [
                "I-PPL",
                "B-EVT",
                "B-PLC",
                "I-IND",
                "B-IND",
                "B-FNB",
                "I-EVT",
                "B-PPL",
                "I-PLC",
                "O",
                "I-FNB"
            ],
            "names_file": null,
            "id": null,
            "_type": "ClassLabel"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

facqa

Use o seguinte comando para carregar esse conjunto de dados no TFDS:

ds = tfds.load('huggingface:indonlu/facqa')

• Descrição :

The goal of the FacQA dataset is to find the answer to a question from a provided short passage from
a news article (Purwarianti et al., 2007). Each row in the FacQA dataset consists of a question,
a short passage, and a label phrase, which can be found inside the corresponding short passage.
There are six categories of questions: date, location, name, organization, person, and quantitative.

• Licença : Nenhuma licença conhecida
• Versão : 1.0.0
• Divisões :

• Características :

{
    "question": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "passage": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "seq_label": {
        "feature": {
            "num_classes": 3,
            "names": [
                "O",
                "B",
                "I"
            ],
            "names_file": null,
            "id": null,
            "_type": "ClassLabel"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}