An iterative approach for the global estimation of sentence similarity

PLoS One. 2017 Sep 12;12(9):e0180885. doi: 10.1371/journal.pone.0180885. eCollection 2017.

Abstract

Measuring the similarity between two sentences is often difficult due to their small lexical overlap. Instead of focusing on the sets of features in two given sentences between which we must measure similarity, we propose a sentence similarity method that considers two types of constraints that must be satisfied by all pairs of sentences in a given corpus. Namely, (a) if two sentences share many features in common, then it is likely that the remaining features in each sentence are also related, and (b) if two sentences contain many related features, then those two sentences are themselves similar. The two constraints are utilized in an iterative bootstrapping procedure that simultaneously updates both word and sentence similarity scores. Experimental results on SemEval 2015 Task 2 dataset show that the proposed iterative approach for measuring sentence semantic similarity is significantly better than the non-iterative counterparts.

MeSH terms

  • Algorithms
  • Humans
  • Language*
  • Models, Theoretical*
  • Semantics*

Grants and funding

The authors received no specific funding for this work.