Difference between using "count" and "bag-of-words" in LSA?

3 visualizaciones (últimos 30 días)
anand samra
anand samra el 10 de Mzo. de 2021
Respondida: Tarunbir Gambhir el 15 de Mzo. de 2021
I'm just getting into NLP and dimensionality reduction and am working with LSA. As per the documentation here, fitLSA can be done using a bag of words or a count matrix. I'm not sure what the difference between using a count matrix or a bag-of-words object would do is though. I've run it twice using the bag of words object for one model, and then for a second model i used the Counts property of the bag of-words object. I then compared the component weights and found no difference. So, whats the difference between using a bag object or just a term-frequency matrix?

Respuestas (1)

Tarunbir Gambhir
Tarunbir Gambhir el 15 de Mzo. de 2021
The two approaches to use fitLSA function will provide the same results if the inherent data being used is the same. Note that bag-of-words and count matrix are just ways to represent the input data so that it can be interpreted by the algorithm. Two different approaches provide flexibility for the user trying to work with this function.
In this case, bag-of-words and count matrix both give the count of the words in the documents but in different formats. One uses a bagOfWords object, whereas the other uses a matrix of nonnegative integers to represent this information.

Categorías

Más información sobre Get Started with Statistics and Machine Learning Toolbox en Help Center y File Exchange.

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by