method: CNN based method 22017-06-30

Authors: Yash Patel, Michal Bušta, Lukáš Neumann, Jiri Matas

Description: Our method uses a CNN based approach for script-identification in cropped work images. We employ the use of convolutional layers from VGG-16 architecture along with a Global-Average-Pooling and two fully connected layers. Objective of our method is to preserve the aspect ratio of input images. Thus, for both training and testing we resize the images into fixed-height (64) and variable-width ((image width*64)/image height) tensors. For training, we initialize the convolutional layers with ImageNet weights. We make use of categorical-cross-entropy loss function and update all the layers (both convolutional and fully connected) during back-propagation.

Confusion Matrix

Detection
ArabicLatinChineseJapaneseKoreanBanglaSymbolsMixedNone
GTArabic4683341255016121500
Latin18558064549102142312417100
Chinese72083733727627600
Japanese44177213344640313312300
Korean3923248469238756921200
Bangla52063235192246200
Symbols469142167199242000
Mixed000000000
None000000000