HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

Sentence Similarity Learning by Lexical Decomposition and Composition

Zhiguo Wang; Haitao Mi; Abraham Ittycheriah

Sentence Similarity Learning by Lexical Decomposition and Composition

Abstract

Most conventional sentence similarity methods only focus on similar parts of two input sentences, and simply ignore the dissimilar parts, which usually give us some clues and semantic meanings about the sentences. In this work, we propose a model to take into account both the similarities and dissimilarities by decomposing and composing lexical semantics over sentences. The model represents each word as a vector, and calculates a semantic matching vector for each word based on all words in the other sentence. Then, each word vector is decomposed into a similar component and a dissimilar component based on the semantic matching vector. After this, a two-channel CNN model is employed to capture features by composing the similar and dissimilar components. Finally, a similarity score is estimated over the composed feature vectors. Experimental results show that our model gets the state-of-the-art performance on the answer sentence selection task, and achieves a comparable result on the paraphrase identification task.

Code Repositories

Leputa/CIKM-AnalytiCup-2018
tf
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
question-answering-on-wikiqaLDC
MAP: 0.7058
MRR: 0.7226

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Sentence Similarity Learning by Lexical Decomposition and Composition | Papers | HyperAI