Difference between using "count" and "bag-of-words" in LSA?
3 visualizaciones (últimos 30 días)
Mostrar comentarios más antiguos
I'm just getting into NLP and dimensionality reduction and am working with LSA. As per the documentation here, fitLSA can be done using a bag of words or a count matrix. I'm not sure what the difference between using a count matrix or a bag-of-words object would do is though. I've run it twice using the bag of words object for one model, and then for a second model i used the Counts property of the bag of-words object. I then compared the component weights and found no difference. So, whats the difference between using a bag object or just a term-frequency matrix?
0 comentarios
Respuestas (1)
Tarunbir Gambhir
el 15 de Mzo. de 2021
The two approaches to use fitLSA function will provide the same results if the inherent data being used is the same. Note that bag-of-words and count matrix are just ways to represent the input data so that it can be interpreted by the algorithm. Two different approaches provide flexibility for the user trying to work with this function.
In this case, bag-of-words and count matrix both give the count of the words in the documents but in different formats. One uses a bagOfWords object, whereas the other uses a matrix of nonnegative integers to represent this information.
0 comentarios
Ver también
Categorías
Más información sobre Get Started with Statistics and Machine Learning Toolbox en Help Center y File Exchange.
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!