tf.keras.preprocessing.text.one_hot
Stay organized with collections
Save and categorize content based on your preferences.
One-hot encodes a text into a list of word indexes of size n
.
tf . keras . preprocessing . text . one_hot (
input_text ,
n ,
filters =& #x27;!"#$%&()*+,-./:;<=>?@[\\]^_`{|}~\t\n',
lower = True ,
split =& #x27; ',
analyzer = None
)
Deprecated: tf.keras.text.preprocessing.one_hot
does not operate on
tensors and is not recommended for new code. Prefer
tf.keras.layers.Hashing
with output_mode='one_hot'
which provides
equivalent functionality through a layer which accepts tf.Tensor
input.
See the preprocessing layer guide for an
overview of preprocessing layers.
This function receives as input a string of text and returns a
list of encoded integers each corresponding to a word (or token)
in the given input string.
Args
input_text
Input text (string).
n
int. Size of vocabulary.
filters
list (or concatenation) of characters to filter out, such as
punctuation. Default:
'!"#$%&()*+,-./:;<=>?@[\]^_`{|}~\t\n
,
includes basic punctuation, tabs, and newlines.
lower
boolean. Whether to set the text to lowercase.
split
str. Separator for word splitting.
analyzer
function. Custom analyzer to split the text
Returns
List of integers in [1, n]
. Each integer encodes a word
(unicity non-guaranteed).
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License , and code samples are licensed under the Apache 2.0 License . For details, see the Google Developers Site Policies . Java is a registered trademark of Oracle and/or its affiliates. Some content is licensed under the numpy license .
Last updated 2024-01-23 UTC.
[{
"type": "thumb-down",
"id": "missingTheInformationINeed",
"label":"Missing the information I need"
},{
"type": "thumb-down",
"id": "tooComplicatedTooManySteps",
"label":"Too complicated / too many steps"
},{
"type": "thumb-down",
"id": "outOfDate",
"label":"Out of date"
},{
"type": "thumb-down",
"id": "samplesCodeIssue",
"label":"Samples / code issue"
},{
"type": "thumb-down",
"id": "otherDown",
"label":"Other"
}]
[{
"type": "thumb-up",
"id": "easyToUnderstand",
"label":"Easy to understand"
},{
"type": "thumb-up",
"id": "solvedMyProblem",
"label":"Solved my problem"
},{
"type": "thumb-up",
"id": "otherUp",
"label":"Other"
}]
{"lastModified": "Last updated 2024-01-23 UTC."}
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Missing the information I need","missingTheInformationINeed","thumb-down"],["Too complicated / too many steps","tooComplicatedTooManySteps","thumb-down"],["Out of date","outOfDate","thumb-down"],["Samples / code issue","samplesCodeIssue","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2024-01-23 UTC."],[],[]]