method: CNN based method 52017-07-01

Authors: Yash Patel, Michal Bušta, Lukáš Neumann, Jiri Matas

Description: Our method uses a CNN based approach for script-identification in cropped work images. We employ the use of convolutional layers from VGG-16 architecture along with a Global-Average-Pooling and two fully connected layers. Objective of our method is to preserve the aspect ratio of input images. Thus, for both training and testing we resize the images into fixed-height (64) and variable-width ((image width*64)/image height) tensors. For training, we initialize the convolutional layers with ImageNet weights. We make use of categorical-cross-entropy loss function and update all the layers (both convolutional and fully connected) during back-propagation.

Confusion Matrix

Detection
ArabicLatinChineseJapaneseKoreanBanglaSymbolsMixedNone
GTArabic4725323182921141200
Latin1995854948959545510914100
Chinese152373874532808400
Japanese50203015873964444572500
Korean352396724528924456900
Bangla31984222222257100
Symbols6610621728269228800
Mixed000000000
None000000000