参考文献:
全て
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:code_search_net/all')
- 説明：
CodeSearchNet corpus contains about 6 million functions from open-source code spanning six programming languages (Go, Java, JavaScript, PHP, Python, and Ruby). The CodeSearchNet Corpus also contains automatically generated query-like natural language for 2 million functions, obtained from mechanically scraping and preprocessing associated function documentation.
- ライセンス: 各種
- バージョン: 1.0.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 100529 |
'train' | 1880853 |
'validation' | 89154 |
- 特徴：
{
"repository_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_path_in_repository": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"whole_func_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"language": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"func_documentation_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_documentation_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"split_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_url": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
ジャワ
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:code_search_net/java')
- 説明：
CodeSearchNet corpus contains about 6 million functions from open-source code spanning six programming languages (Go, Java, JavaScript, PHP, Python, and Ruby). The CodeSearchNet Corpus also contains automatically generated query-like natural language for 2 million functions, obtained from mechanically scraping and preprocessing associated function documentation.
- ライセンス: 各種
- バージョン: 1.0.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 26909 |
'train' | 454451 |
'validation' | 15328 |
- 特徴：
{
"repository_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_path_in_repository": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"whole_func_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"language": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"func_documentation_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_documentation_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"split_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_url": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
行く
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:code_search_net/go')
- 説明：
CodeSearchNet corpus contains about 6 million functions from open-source code spanning six programming languages (Go, Java, JavaScript, PHP, Python, and Ruby). The CodeSearchNet Corpus also contains automatically generated query-like natural language for 2 million functions, obtained from mechanically scraping and preprocessing associated function documentation.
- ライセンス: 各種
- バージョン: 1.0.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 14291 |
'train' | 317832 |
'validation' | 14242 |
- 特徴：
{
"repository_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_path_in_repository": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"whole_func_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"language": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"func_documentation_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_documentation_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"split_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_url": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
パイソン
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:code_search_net/python')
- 説明：
CodeSearchNet corpus contains about 6 million functions from open-source code spanning six programming languages (Go, Java, JavaScript, PHP, Python, and Ruby). The CodeSearchNet Corpus also contains automatically generated query-like natural language for 2 million functions, obtained from mechanically scraping and preprocessing associated function documentation.
- ライセンス: 各種
- バージョン: 1.0.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 22176 |
'train' | 412178 |
'validation' | 23107 |
- 特徴：
{
"repository_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_path_in_repository": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"whole_func_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"language": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"func_documentation_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_documentation_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"split_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_url": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
JavaScript
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:code_search_net/javascript')
- 説明：
CodeSearchNet corpus contains about 6 million functions from open-source code spanning six programming languages (Go, Java, JavaScript, PHP, Python, and Ruby). The CodeSearchNet Corpus also contains automatically generated query-like natural language for 2 million functions, obtained from mechanically scraping and preprocessing associated function documentation.
- ライセンス: 各種
- バージョン: 1.0.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 6483 |
'train' | 123889 |
'validation' | 8253 |
- 特徴：
{
"repository_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_path_in_repository": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"whole_func_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"language": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"func_documentation_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_documentation_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"split_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_url": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
ルビー
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:code_search_net/ruby')
- 説明：
CodeSearchNet corpus contains about 6 million functions from open-source code spanning six programming languages (Go, Java, JavaScript, PHP, Python, and Ruby). The CodeSearchNet Corpus also contains automatically generated query-like natural language for 2 million functions, obtained from mechanically scraping and preprocessing associated function documentation.
- ライセンス: 各種
- バージョン: 1.0.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 2279 |
'train' | 48791 |
'validation' | 2209 |
- 特徴：
{
"repository_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_path_in_repository": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"whole_func_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"language": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"func_documentation_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_documentation_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"split_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_url": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}
php
次のコマンドを使用して、このデータセットを TFDS にロードします。
ds = tfds.load('huggingface:code_search_net/php')
- 説明：
CodeSearchNet corpus contains about 6 million functions from open-source code spanning six programming languages (Go, Java, JavaScript, PHP, Python, and Ruby). The CodeSearchNet Corpus also contains automatically generated query-like natural language for 2 million functions, obtained from mechanically scraping and preprocessing associated function documentation.
- ライセンス: 各種
- バージョン: 1.0.0
- 分割:
| スプリット | 例 |
|---|---|
'test' | 28391 |
'train' | 523712 |
'validation' | 26015 |
- 特徴：
{
"repository_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_path_in_repository": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"whole_func_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"language": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"func_documentation_string": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_documentation_tokens": {
"feature": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"length": -1,
"id": null,
"_type": "Sequence"
},
"split_name": {
"dtype": "string",
"id": null,
"_type": "Value"
},
"func_code_url": {
"dtype": "string",
"id": null,
"_type": "Value"
}
}