bswac

参考文献:

バスワック

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:bswac/bswac')
  • 説明： 
The Bosnian web corpus bsWaC was built by crawling the .ba top-level domain in 2014. The corpus was near-deduplicated on paragraph level, normalised via diacritic restoration, morphosyntactically annotated and lemmatised. The corpus is shuffled by paragraphs. Each paragraph contains metadata on the URL, domain and language identification (Bosnian vs. Croatian vs. Serbian).

Version 1.0 of this corpus is described in http://www.aclweb.org/anthology/W14-0405. Version 1.1 contains newer and better linguistic annotations.
  • ライセンス: CC BY-SA 4.0
  • バージョン: 1.1.0
  • 分割:
スプリット例
'train' 354581267
  • 特徴： 
{
    "sentence": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    }
}