class_docstr: Tokenizes raw text into word pieces, tokens. Identifies tokens with
  tokenization open standards. A few rules will help customizing it if
  defaults do not fit user needs.
  
  This class represents an already fitted :class:`.Tokenizer`.
  
  See the main class Tokenizer for more examples of usage.
  
  ======================  ======================
  Input Annotation types  Output Annotation type
  ======================  ======================
  ``DOCUMENT``            ``TOKEN``
  ======================  ======================
  
  Parameters
  ----------
  splitPattern
      Character list used to separate from the inside of tokens
  splitChars
      Character list used to separate from the inside of tokens
class_docstr_tok: ["Tokenizes","raw","text","into","word","pieces",",","tokens",".","Identifies","tokens","with","tokenization","open","standards",".","A","few","rules","will","help","customizing","it","if","defaults","do","not","fit","user","needs",".","This","class","represents","an","already","fitted",":","class",":","`",".Tokenizer","`",".","See","the","main","class","Tokenizer","for","more","examples","of","usage",".","======================","======================","Input","Annotation","types","Output","Annotation","type","======================","======================","``","DOCUMENT","``","``","TOKEN","``","======================","======================","Parameters","--","--","--","--","--","splitPattern","Character","list","used","to","separate","from","the","inside","of","tokens","splitChars","Character","list","used","to","separate","from","the","inside","of","tokens"]
code: def __init__(
      self,
      classname="com.johnsnowlabs.nlp.annotators.TokenizerModel",
      java_model=None,
  ):
      super(TokenizerModel, self).__init__(
          classname=classname, java_model=java_model
      )
      self._setDefault(
          targetPattern="\\S+", caseSensitiveExceptions=True
      )
  
imports: from sparknlp.common import *
label_desc: Use image node_id 1 to create a new TokenizerModel object from inherited base classes: AnnotatorModel with example: obj = TokenizerModel(classname, java_model)