tokenize
gb/tˈoʊkənˌaɪz/ us/tˈoʊkənˌaɪz/
C1
Английский
Значения
0 значений
Глагол
technical
C1
action
1
split data into tokens
To break text or data into small pieces that a computer can work with.
Модель употребления:
tokenize [text/data/code] into [tokens/words/units]
Частая ошибка:
Do not use tokenize for simply summarizing or translating text; it specifically means breaking it into units.
Синонимы
split (More general and less technical; does not imply tokens specifically.)
|
segment (Often used for dividing something into meaningful parts; slightly broader.)
|
parse (Can include analyzing structure, not just dividing into tokens.)
Антонимы
detokenize (Recombines tokens into normal text or data.)
|
combine (General opposite meaning: put separate parts together.)
Коллокации
tokenize text
|tokenize a sentence
|tokenize input
|tokenize data
|tokenize code
|tokenize a document
|tokenize into words
|tokenize into subwords
|tokenize speech
|tokenize a corpus
Темы
computing
|language
|data_processing
|artificial_intelligence
Примеры
- The software tokenizes each sentence before sending it to the language model.
- Search engines tokenize a query so they can match individual words and phrases.
- The compiler first tokenizes the source code into keywords, names, and symbols.
Примеры для изучающих
- The program tokenizes the sentence into words.
- We need to tokenize the text before analysis.
Глагол
technical
C1
action
2
replace sensitive data with tokens
To hide private data by replacing it with a safe substitute code.
Модель употребления:
tokenize [sensitive data/card details/payment information]
Частая ошибка:
Do not confuse this with encrypting data; tokenized data is replaced by a token, while encrypted data is transformed with a key.
Синонимы
mask (Usually means hiding part of the data visually, not necessarily replacing it with a usable token.)
|
anonymize (Means removing or changing identifying information; broader than tokenizing.)
|
substitute (General word for replacing one thing with another; less technical.)
Антонимы
detokenize (Converts a token back to the original sensitive data in an authorized system.)
|
expose (Opposite in effect: makes sensitive data visible or available.)
Коллокации
tokenize card data
|tokenize a credit card number
|tokenize payment information
|tokenize sensitive data
|tokenize customer data
|tokenize account details
|tokenize personal information
|tokenize credentials
Темы
cybersecurity
|payments
|data_privacy
|business
Примеры
- The payment gateway tokenizes card numbers before storing transaction records.
- The company tokenizes sensitive customer data to reduce the risk of a data breach.
- Once the card is tokenized, the merchant can process repeat payments without storing the actual card number.
Примеры для изучающих
- The app tokenizes my card number for safety.
- Banks often tokenize payment data.
Глагол
technical
C1
action
3
turn assets into digital tokens
To turn an asset or ownership right into digital tokens that can be bought, sold, or transferred.
Модель употребления:
tokenize [an asset/property/shares/rights]
Частая ошибка:
Do not use this meaning for ordinary digitization; tokenizing an asset usually means creating tradable digital tokens that represent rights or ownership.
Синонимы
digitize (Broader; means converting something into digital form, not necessarily into tradable tokens.)
|
securitize (Financial term for turning assets into securities; may overlap but is not specifically blockchain-based.)
|
represent (More general; lacks the technical sense of creating tokens.)
Антонимы
untokenize (Rare; would mean to remove or reverse token representation.)
|
redeem (In some financial contexts, means exchanging a token for the underlying asset or value.)
Коллокации
tokenize assets
|tokenize real estate
|tokenize property
|tokenize shares
|tokenize securities
|tokenize ownership
|tokenize rights
|tokenize art
|tokenize commodities
Темы
finance
|blockchain
|crypto
|business
|technology
Примеры
- The startup wants to tokenize real estate so small investors can buy fractional shares.
- Some platforms allow artists to tokenize digital works and sell ownership rights online.
- Regulators are still deciding how to treat companies that tokenize securities on a blockchain.
Примеры для изучающих
- The company plans to tokenize property.
- Investors can buy tokenized assets online.
Грамматика
Словарная форма
tokenize
IPA
GB/tˈoʊkənˌaɪz/
US/tˈoʊkənˌaɪz/
Слоги и ударение
token - ize (2 слога)
Stress on 1st syllable (token)
Формы слова
Verb
- Base: tokenize
- 3rd Person Singular: tokenizes
- Present Participle: tokenizing
- Past: tokenized
- Past Participle: tokenized
Выражения
Пока для этой статьи нет связанных выражений.