TFDS はCroissant 🥐 形式をサポートするようになりました。詳細については、ドキュメントをお読みください。

このページは Cloud Translation API によって翻訳されました。

ヘンドリックステスト

参考文献:

抽象代数

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/abstract_algebra')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	100
`'validation'`	11

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

解剖学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/anatomy')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	135
`'validation'`	14

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

天文学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/astronomy')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	152
`'validation'`	16

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

ビジネス倫理

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/business_ethics')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	100
`'validation'`	11

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

臨床知識

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/clinical_knowledge')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	265
`'validation'`	29

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

大学生物学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/college_biology')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	144
`'validation'`	16

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

大学化学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/college_chemistry')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	100
`'validation'`	8

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

大学コンピュータ科学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/college_computer_science')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	100
`'validation'`	11

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

大学_数学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/college_mathematics')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	100
`'validation'`	11

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

大学_医学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/college_medicine')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	173
`'validation'`	22

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

大学物理学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/college_physics')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	102
`'validation'`	11

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

コンピューターのセキュリティ

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/computer_security')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	100
`'validation'`	11

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

概念的物理学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/conceptual_physics')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	235
`'validation'`	26

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

計量経済学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/econometrics')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	114
`'validation'`	12

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

電気工学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/electrical_engineering')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	145
`'validation'`	16

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

初等数学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/elementary_mathematics')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	378
`'validation'`	41

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

フォーマルロジック

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/formal_logic')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	126
`'validation'`	14

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

グローバルファクト

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/global_facts')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	100
`'validation'`	10

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校生物学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_biology')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	310
`'validation'`	32

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校の化学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_chemistry')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	203
`'validation'`	22

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校_コンピューター_サイエンス

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_computer_science')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	100
`'validation'`	9

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校ヨーロッパの歴史

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_european_history')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	165
`'validation'`	18

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校地理

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_geography')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	198
`'validation'`	22

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校と政府と政治

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_government_and_politics')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	193
`'validation'`	21

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校マクロ経済学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_macroeconomics')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	390
`'validation'`	43

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校数学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_mathematics')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	270
`'validation'`	29

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校_ミクロ経済学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_microeconomics')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	238
`'validation'`	26

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校物理

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_physics')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	151
`'validation'`	17

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校心理学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_psychology')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	545
`'validation'`	60

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校統計

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_statistics')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	216
`'validation'`	23

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校の歴史

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_us_history')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	204
`'validation'`	22

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

高校世界史

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/high_school_world_history')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	237
`'validation'`	26

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

人間の老化

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/human_aging')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	223
`'validation'`	23

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

人間のセクシュアリティ

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/human_sexuality')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	131
`'validation'`	12

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

国際法

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/international_law')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	121
`'validation'`	13

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

法学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/jurisprudence')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	108
`'validation'`	11

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

論理的誤り

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/logical_fallacies')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	163
`'validation'`	18

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

機械学習

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/machine_learning')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	112
`'validation'`	11

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

管理

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/management')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	103
`'validation'`	11

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

マーケティング

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/marketing')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	234
`'validation'`	25

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

医療遺伝学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/medical_genetics')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	100
`'validation'`	11

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

その他

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/miscellaneous')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	783
`'validation'`	86

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

道徳的紛争

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/moral_disputes')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	346
`'validation'`	38

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

道徳シナリオ

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/moral_scenarios')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	895
`'validation'`	100

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

栄養

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/nutrition')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	306
`'validation'`	33

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

哲学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/philosophy')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	311
`'validation'`	34

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

先史時代

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/prehistory')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	324
`'validation'`	35

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

プロフェッショナル_会計

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/professional_accounting')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	282
`'validation'`	31

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

専門法

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/professional_law')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	1534年
`'validation'`	170

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

専門_医学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/professional_medicine')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	272
`'validation'`	31

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

専門心理学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/professional_psychology')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	612
`'validation'`	69

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

広報

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/public_relations')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	110
`'validation'`	12

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

セキュリティ研究

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/security_studies')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	245
`'validation'`	27

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

社会学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/sociology')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	201
`'validation'`	22

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

us_foreign_policy

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/us_foreign_policy')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	100
`'validation'`	11

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

ウイルス学

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/virology')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	166
`'validation'`	18

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}

世界の宗教

次のコマンドを使用して、このデータセットを TFDS にロードします。

ds = tfds.load('huggingface:hendrycks_test/world_religions')

説明：

This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge, covering 57 tasks including elementary mathematics, US history, computer science, law, and more.

ライセンス: 不明なライセンス
バージョン: 1.0.0
分割:

スプリット	例
`'auxiliary_train'`	99842
`'dev'`	5
`'test'`	171
`'validation'`	19

特徴：

{
    "question": {
        "dtype": "string",
        "id": null,
        "_type": "Value"
    },
    "choices": {
        "feature": {
            "dtype": "string",
            "id": null,
            "_type": "Value"
        },
        "length": -1,
        "id": null,
        "_type": "Sequence"
    },
    "answer": {
        "num_classes": 4,
        "names": [
            "A",
            "B",
            "C",
            "D"
        ],
        "names_file": null,
        "id": null,
        "_type": "ClassLabel"
    }
}