HyperAIHyperAI

Command Palette

Search for a command to run...

4 months ago

DR-BiLSTM: Dependent Reading Bidirectional LSTM for Natural Language Inference

Reza Ghaeini; Sadid A. Hasan; Vivek Datla; Joey Liu; Kathy Lee; Ashequl Qadir; Yuan Ling; Aaditya Prakash; Xiaoli Z. Fern; Oladimeji Farri

DR-BiLSTM: Dependent Reading Bidirectional LSTM for Natural Language Inference

Abstract

We present a novel deep learning architecture to address the natural language inference (NLI) task. Existing approaches mostly rely on simple reading mechanisms for independent encoding of the premise and hypothesis. Instead, we propose a novel dependent reading bidirectional LSTM network (DR-BiLSTM) to efficiently model the relationship between a premise and a hypothesis during encoding and inference. We also introduce a sophisticated ensemble strategy to combine our proposed models, which noticeably improves final predictions. Finally, we demonstrate how the results can be improved further with an additional preprocessing step. Our evaluation shows that DR-BiLSTM obtains the best single model and ensemble model results achieving the new state-of-the-art scores on the Stanford NLI dataset.

Benchmarks

BenchmarkMethodologyMetrics
natural-language-inference-on-snli450D DR-BiLSTM
% Test Accuracy: 88.5
% Train Accuracy: 94.1
Parameters: 7.5m
natural-language-inference-on-snli450D DR-BiLSTM Ensemble
% Test Accuracy: 89.3
% Train Accuracy: 94.8
Parameters: 45m

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
DR-BiLSTM: Dependent Reading Bidirectional LSTM for Natural Language Inference | Papers | HyperAI