What are some good ways of estimating 'approximate' semantic similarity between sentences?

后端 未结 2 473
我在风中等你
我在风中等你 2020-12-23 10:42

I have been looking at the nlp tag on SO for the past couple of hours and am confident I did not miss anything but if I did, please do point me to the question.

In

相关标签:
2条回答
  • 2020-12-23 11:15

    I suggest you try a topic modelling framework such as Latent Dirichlet Allocation (LDA). The idea there is that documents (in your case sentences, which might prove to be a problem) are generated from a set of latent (hidden) topics; LDA retrieves those topics, representing them by word clusters.

    An implementation of LDA in Python is available as part of the free Gensim package. You could try to apply it to your sentences, then run k-means on its output.

    0 讨论(0)
  • 2020-12-23 11:27

    Latent Semantic Modeling could be useful. It's basically just yet another application of the Singular Value Decomposition. The SVDLIBC is a pretty nice C implementation of this approach, which is an oldie but a goodie, and there are even python binding in the form of sparsesvd.

    0 讨论(0)
提交回复
热议问题