## Tokenizer.(constructor)

Constructs a new instance of the `Tokenizer` class

**Signature:**

```typescript
constructor(str: string, keywords: string[], operators: string[], options?: TokenizerOptions);
```

## Parameters

| Parameter  | Type                 | Description |
|------------|----------------------|-------------|
| str        | string               |             |
| keywords   | string[]             |             |
| operators  | string[]             |             |
| options    | [TokenizerOptions](/content/docs/sdk/core.tokenizeroptions) | _(Optional)_ |