HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

Improving Knowledge Tracing via Pre-training Question Embeddings

Yunfei Liu Yang Yang Xianyu Chen Jian Shen Haifeng Zhang Yong Yu

Improving Knowledge Tracing via Pre-training Question Embeddings

Abstract

Knowledge tracing (KT) defines the task of predicting whether students can correctly answer questions based on their historical response. Although much research has been devoted to exploiting the question information, plentiful advanced information among questions and skills hasn't been well extracted, making it challenging for previous work to perform adequately. In this paper, we demonstrate that large gains on KT can be realized by pre-training embeddings for each question on abundant side information, followed by training deep KT models on the obtained embeddings. To be specific, the side information includes question difficulty and three kinds of relations contained in a bipartite graph between questions and skills. To pre-train the question embeddings, we propose to use product-based neural networks to recover the side information. As a result, adopting the pre-trained embeddings in existing deep KT models significantly outperforms state-of-the-art baselines on three common KT datasets.

Code Repositories

lyf-1/PEBG
Official
tf

Benchmarks

BenchmarkMethodologyMetrics
knowledge-tracing-on-ednetPEBG+DKVMN
AUC: 0.7757
knowledge-tracing-on-ednetPEBG+DKT
AUC: 0.7765

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
Improving Knowledge Tracing via Pre-training Question Embeddings | Papers | HyperAI