## Tokenizer.tokenize() method [​](/content/docs/sdk/core.tokenizer.tokenize#tokenizertokenize-method "Direct link to Tokenizer.tokenize(/index.html) method")

**Signature:**

```typescript
tokenize(): Token[];
```

**Returns:**

[Token](/content/docs/sdk/core.token)

- [Tokenizer.tokenize() method](/content/docs/sdk/core.tokenizer.tokenize#tokenizertokenize-method/index.html)