Syntax
EXTRACT_WORDS(<text>)
Description
Converts text to a list of words using a preconfigured maximum entropy tokenizer. Punctuation is removed.
Examples
EXTRACT_WORDS(#Text_Column)
...
| Text | Result |
|---|---|
| The baseball cost $50. | [The, baseball cost, $, 50] |
| The importance of #bigdata | [The importance, of, #, bigdata] |
...