参考文献:
評価データセット
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:neural_code_search/evaluation_dataset')
- 説明：
Neural-Code-Search-Evaluation-Dataset presents an evaluation dataset consisting of natural language query and code snippet pairs and a search corpus consisting of code snippets collected from the most popular Android repositories on GitHub.
- ライセンス: CC-BY-NC 4.0 (非営利目的)
- バージョン: 1.1.0
- 分割:
| スプリット | 例 |
|---|---|
'train' | 287 |
- 特徴：
{
"stackoverflow_id": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"question": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_author": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"question_author_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"answer": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"answer_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"answer_author": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"answer_author_url": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"examples": {
"feature": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"examples_url": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
}
}
検索コーパス
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:neural_code_search/search_corpus')
- 説明：
Neural-Code-Search-Evaluation-Dataset presents an evaluation dataset consisting of natural language query and code snippet pairs and a search corpus consisting of code snippets collected from the most popular Android repositories on GitHub.
- ライセンス: CC-BY-NC 4.0 (非営利目的)
- バージョン: 1.1.0
- 分割:
| スプリット | 例 |
|---|---|
'train' | 4716814 |
- 特徴：
{
"id": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"filepath": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"method_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"start_line": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"end_line": {
"dtype": "int32",
"id": null,
"_type": "Value"
},
"url": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}