Authors - Mumthaz Beegum M, Raseena Beevi, Aji S Abstract - Short-text similarity is a vital research area in NLP with significant implications for use cases like search recommendations and question-answer systems. Traditional models often focus solely on semantic similarity, overlooking syntactic factors. Our approach uses the AnglE (Angle Embedding) method for semantic similarity, which transforms text into high-dimensional vectors to capture the nuanced meanings and relationships between words and phrases. The cosine similarity measure is then employed to calculate the similarity score from these vectors. We apply the weighted Tree Edit Distance (TED) method for syntactic similarity, which measures structural differences between parse trees by calculating the minimum cost required to convert one tree into another through a series of edit operations. By integrating these two complementary similarity measures, our approach aims to deliver a more thorough and accurate evaluation of text similarity. This methodology introduces an advanced technique that combines semantic and structural information to enhance the assessment of short-text similarity. The integrated methodology introduces a sophisticated framework that not only enhances the precision of similarity evaluations but also bridges the gap between semantic and syntactic analyses, thereby offering a more comprehensive evaluation of text similarity.
Open Zoom
