get_token_distribution

lexnlp.nlp.en.transforms.tokens.get_token_distribution(text, lowercase=False, stopword=False)

Get token distribution of text, potentially lowercasing and stopwording first.

Parameters
  • text

  • lowercase

  • stopword

Returns