## TokenizerOptions interface

**Signature:**

```typescript
export interface TokenizerOptions
```

## Properties

| Property | Modifiers | Type | Description |
| --- | --- | --- | --- |
| [dateTimeLiterals?](/content/docs/sdk/core.tokenizeroptions.datetimeliterals) |  | boolean | _(Optional)_ |
| [symbolRegex?](/content/docs/sdk/core.tokenizeroptions.symbolregex) |  | RegExp | _(Optional)_ |