irc_disentangle

তথ্যসূত্র:

উবুন্টু

TFDS এ এই ডেটাসেট লোড করতে নিম্নলিখিত কমান্ডটি ব্যবহার করুন:

ds = tfds.load('huggingface:irc_disentangle/ubuntu')
  • বর্ণনা :
Disentangling conversations mixed together in a single stream of messages is
a difficult task, made harder by the lack of large manually annotated
datasets. This new dataset of 77,563 messages manually annotated with
reply-structure graphs that both disentangle conversations and define
internal conversation structure. The dataset is 16 times larger than all
previously released datasets combined, the first to include adjudication of
annotation disagreements, and the first to include context.
  • লাইসেন্স : ক্রিয়েটিভ কমন্স অ্যাট্রিবিউশন 4.0 আন্তর্জাতিক পাবলিক লাইসেন্স
  • সংস্করণ : 1.0.0
  • বিভাজন :
বিভক্ত উদাহরণ
'test' 15010
'train' 220616
'validation' 12510
  • বৈশিষ্ট্য :
{
    "id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    },
    "raw": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "ascii": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "tokenized": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "date": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "connections": {
        "feature": {
            "dtype": "int32",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}

চ্যানেল_টু

TFDS এ এই ডেটাসেট লোড করতে নিম্নলিখিত কমান্ডটি ব্যবহার করুন:

ds = tfds.load('huggingface:irc_disentangle/channel_two')
  • বর্ণনা :
Disentangling conversations mixed together in a single stream of messages is
a difficult task, made harder by the lack of large manually annotated
datasets. This new dataset of 77,563 messages manually annotated with
reply-structure graphs that both disentangle conversations and define
internal conversation structure. The dataset is 16 times larger than all
previously released datasets combined, the first to include adjudication of
annotation disagreements, and the first to include context.
  • লাইসেন্স : ক্রিয়েটিভ কমন্স অ্যাট্রিবিউশন 4.0 আন্তর্জাতিক পাবলিক লাইসেন্স
  • সংস্করণ : 1.0.0
  • বিভাজন :
বিভক্ত উদাহরণ
'all_' 2602
'dev' 1001
'pilot' 501
'pilot_dev' 1501
'test' 1001
  • বৈশিষ্ট্য :
{
    "id": {
        "dtype": "int32",
        "id": null,
        "_type": "Value"
    },
    "raw": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "ascii": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "tokenized": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "connections": {
        "feature": {
            "dtype": "int32",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    }
}