Tokenizer (DatenbankExplorer API)

java.lang.Object
- com.github.vertical_blank.sqlformatter.core.Tokenizer

```
public class Tokenizer
extends Object
```

- Constructor Summary
  
  Constructors
  Constructor Description
  
  Tokenizer(DialectConfig cfg)
- Method Summary
  - Methods inherited from class java.lang.Object
    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

- Constructor Detail
  - Tokenizer
```
public Tokenizer(DialectConfig cfg)
```
    Parameters:
    
    cfg - {String[]} cfg.reservedWords Reserved words in SQL {String[]} cfg.reservedToplevelWords Words that are set to new line separately {String[]} cfg.reservedNewlineWords Words that are set to newline {String[]} cfg.stringTypes String types to enable: "", '', ``, [], N'' {String[]} cfg.openParens Opening parentheses to enable, like (, [ {String[]} cfg.closeParens Closing parentheses to enable, like ), ] {String[]} cfg.indexedPlaceholderTypes Prefixes for indexed placeholders, like ? {String[]} cfg.namedPlaceholderTypes Prefixes for named placeholders, like @ and : {String[]} cfg.lineCommentTypes Line comments to enable, like # and -- {String[]} cfg.specialWordChars Special chars that can be found inside of words, like @ and #