hrwac

Tài liệu tham khảo:

hwac

Sử dụng lệnh sau để tải tập dữ liệu này trong TFDS:

ds = tfds.load('huggingface:hrwac/hrwac')
  • Sự miêu tả : 
The Croatian web corpus hrWaC was built by crawling the .hr top-level domain in 2011 and again in 2014. The corpus was near-deduplicated on paragraph level, normalised via diacritic restoration, morphosyntactically annotated and lemmatised. The corpus is shuffled by paragraphs. Each paragraph contains metadata on the URL, domain and language identification (Croatian vs. Serbian).

Version 2.0 of this corpus is described in http://www.aclweb.org/anthology/W14-0405. Version 2.1 contains newer and better linguistic annotations.
  • Giấy phép : CC BY-SA 4.0
  • Phiên bản : 2.1.0
  • Chia tách :
Tách ra Ví dụ
'train' 1736944727
  • Đặc trưng : 
{
    "sentence": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}