Command Palette
Search for a command to run...
3 months ago
Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition
{Yufan Jiang Tong Xiao Chunliang Zhang Chi Hu Jingbo Zhu}

Abstract
In this paper, we study differentiable neural architecture search (NAS) methods for natural language processing. In particular, we improve differentiable architecture search by removing the softmax-local constraint. Also, we apply differentiable NAS to named entity recognition (NER). It is the first time that differentiable NAS methods are adopted in NLP tasks other than language modeling. On both the PTB language modeling and CoNLL-2003 English NER data, our method outperforms strong baselines. It achieves a new state-of-the-art on the NER task.
Benchmarks
| Benchmark | Methodology | Metrics |
|---|---|---|
| language-modelling-on-ptb | I-DARTS | PPL: 56.0 |
| named-entity-recognition-ner-on-conll-2003 | I-DARTS + Flair | F1: 93.47 |
Build AI with AI
From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.
AI Co-coding
Ready-to-use GPUs
Best Pricing
Hyper Newsletters
Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp