Command Palette
Search for a command to run...
On the Benefit of Combining Neural, Statistical and External Features for Fake News Identification
Gaurav Bhatt; Aman Sharma; Shivam Sharma; Ankush Nagpal; Balasubramanian Raman; Ankush Mittal

Abstract
Identifying the veracity of a news article is an interesting problem while automating this process can be a challenging task. Detection of a news article as fake is still an open question as it is contingent on many factors which the current state-of-the-art models fail to incorporate. In this paper, we explore a subtask to fake news identification, and that is stance detection. Given a news article, the task is to determine the relevance of the body and its claim. We present a novel idea that combines the neural, statistical and external features to provide an efficient solution to this problem. We compute the neural embedding from the deep recurrent model, statistical features from the weighted n-gram bag-of-words model and handcrafted external features with the help of feature engineering heuristics. Finally, using deep neural layer all the features are combined, thereby classifying the headline-body news pair as agree, disagree, discuss, or unrelated. We compare our proposed technique with the current state-of-the-art models on the fake news challenge dataset. Through extensive experiments, we find that the proposed model outperforms all the state-of-the-art techniques including the submissions to the fake news challenge.
Code Repositories
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| fake-news-detection-on-fnc-1 | Baseline based on skip-thought embeddings (Bhatt et al., 2017) | Per-class Accuracy (Agree): 31.80 Per-class Accuracy (Disagree): 0.00 Per-class Accuracy (Discuss): 81.20 Per-class Accuracy (Unrelated): 91.18 Weighted Accuracy: 76.18 |
| fake-news-detection-on-fnc-1 | Neural baseline based on bi-directional LSTMs (Bhatt et al., 2017) | Per-class Accuracy (Agree): 38.04 Per-class Accuracy (Disagree): 4.59 Per-class Accuracy (Discuss): 58.132 Per-class Accuracy (Unrelated): 78.27 Weighted Accuracy: 63.11 |
| fake-news-detection-on-fnc-1 | Baseline based on word2vec + hand-crafted features (Bhatt et al., 2017) | Per-class Accuracy (Agree): 50.70 Per-class Accuracy (Disagree): 9.61 Per-class Accuracy (Discuss): 53.38 Per-class Accuracy (Unrelated): 96.05 Weighted Accuracy: 72.78 |
| fake-news-detection-on-fnc-1 | Bhatt et al. | Per-class Accuracy (Agree): 43.82 Per-class Accuracy (Disagree): 6.31 Per-class Accuracy (Discuss): 85.68 Per-class Accuracy (Unrelated): 98.04 Weighted Accuracy: 83.08 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.