MadLib.\_internal.tokenizer.tokenizer.Tokenizer
===============================================

.. currentmodule:: MadLib._internal.tokenizer.tokenizer

.. autoclass:: Tokenizer

   
   .. automethod:: __init__

   
   .. rubric:: Methods

   .. autosummary::
   
      ~Tokenizer.__init__
      ~Tokenizer.out_col_name
      ~Tokenizer.tokenize
      ~Tokenizer.tokenize_set
      ~Tokenizer.tokenize_spark