HyperAIHyperAI

Command Palette

Search for a command to run...

3 months ago

StackMix and Blot Augmentations for Handwritten Text Recognition

Alex Shonenkov Denis Karachev Maxim Novopoltsev Mark Potanin Denis Dimitrov

StackMix and Blot Augmentations for Handwritten Text Recognition

Abstract

This paper proposes a handwritten text recognition(HTR) system that outperforms current state-of-the-artmethods. The comparison was carried out on three of themost frequently used in HTR task datasets, namely Ben-tham, IAM, and Saint Gall. In addition, the results on tworecently presented datasets, Peter the Greats manuscriptsand HKR Dataset, are provided.The paper describes the architecture of the neural net-work and two ways of increasing the volume of train-ing data: augmentation that simulates strikethrough text(HandWritten Blots) and a new text generation method(StackMix), which proved to be very effective in HTR tasks.StackMix can also be applied to the standalone task of gen-erating handwritten text based on printed text.

Code Repositories

sberbank-ai/StackMix-OCR
Official
pytorch
Mentioned in GitHub

Benchmarks

BenchmarkMethodologyMetrics
handwritten-text-recognition-on-benthamStackMix+Blots
CER: 1.73
handwritten-text-recognition-on-digital-peterStackMix+Blots
CER: 2.5
handwritten-text-recognition-on-hkrStackMix+Blots
CER: 3.49
handwritten-text-recognition-on-iam-bStackMix+Blots
CER: 3.77
handwritten-text-recognition-on-iam-dStackMix+Blots
CER: 3.01
handwritten-text-recognition-on-saint-gallStackMix+Blots
CER: 3.65

Build AI with AI

From idea to launch — accelerate your AI development with free AI co-coding, out-of-the-box environment and best price of GPUs.

AI Co-coding
Ready-to-use GPUs
Best Pricing
Get Started

Hyper Newsletters

Subscribe to our latest updates
We will deliver the latest updates of the week to your inbox at nine o'clock every Monday morning
Powered by MailChimp
StackMix and Blot Augmentations for Handwritten Text Recognition | Papers | HyperAI