Sunday, 3 May 2020

NLP

Examples of NLP are Google assistant, Alexa, Siri, SPAM classifier

Stemming and Lemmantization
Stemming is process of reducing infected words to stem


Bag of words - Filter words -> create histogram -> Creating a matrix (Disadvantage is that no weight associated to words)

TF-IDF(Term Frequency & Inverse document frequency)
  •  TF - repetitions/#words
  • IDF - log(#sentences/#sentences containing word)