Robust ReadingCompetition
Challenges

method: CLOVA-AI / PAPAGO2018-06-07

Authors: Youngmin Baek, Bado Lee, Hwalsuk Lee

Description: Character-level text detection based on weakly-supervised learning. Single-scale experiment result. CLOVA-AI team, Naver Corp.  (Paper in preparation)

method: Ali-Amap-xlab-v42018-04-17

Authors: Xinran Liu, Pei Zhang, Xingyue Chen, Ce Qi, Zhihui Hao

Description: Amap Vision Lab, AutoNavi, Alibaba Group. Instance-segmentation based method.

method: TencentAILab2017-11-21

Authors: Jingchao Zhou, Yitong Wang, Xing Ji, Zhifeng Li

Description: An FCN architecture with U-Net as the backbone for extracting multi-scale low level feature maps.

Ranking Table

Description Paper Source Code
DateMethodRecallPrecisionHmean
2018-06-07CLOVA-AI / PAPAGO91.23%96.98%94.02%
2018-04-17Ali-Amap-xlab-v491.67%94.99%93.30%
2017-11-21TencentAILab94.65%91.87%93.24%
2018-01-22FOTS90.47%94.63%92.50%
2017-08-10SRC-B-MachineLearningLab-v489.77%93.73%91.71%
2017-06-25FEN89.26%94.09%91.61%
2017-02-17NLPR-CASIA88.55%94.59%91.47%
2016-12-16RRPN-487.85%94.91%91.25%
2017-12-15TDN_SJTU_V389.02%93.17%91.05%
2018-03-05HappyCCL88.13%92.09%90.06%
2017-03-16Ali-Amap-xlab-v287.40%91.80%89.54%
2018-05-06cvmt_allStepNoLkTree88.64%90.16%89.39%
2017-03-23RTN85.08%93.85%89.25%
2018-05-06CVMT_frm6287.67%89.73%88.69%
2016-12-04Ali-Amap-xlab86.16%90.89%88.46%
2016-06-23Baidu IDL84.51%92.68%88.41%
2017-11-15Sensetime line-level detection81.52%96.48%88.37%
2017-01-22SRC-B-MachineLearningLab83.20%93.06%87.85%
2017-03-22MCLAB_TextBoxes_v284.38%91.21%87.67%
2018-01-04crpn83.80%91.90%87.66%
2017-07-04FPTD86.94%88.35%87.64%
2017-05-02TsinghuaOCR84.37%89.75%86.98%
2016-01-27SenseTime85.22%88.77%86.96%
2016-07-18SCUT-HCII82.59%90.40%86.32%
2017-04-04xmu40382.83%89.95%86.24%
2017-02-21STDN-278.81%95.07%86.18%
2016-12-21MSRA_v179.87%93.32%86.08%
2017-02-28Tencent Youtu79.47%93.87%86.07%
2017-11-09kb537s81.39%90.87%85.87%
2017-02-07CAS_HotEye78.63%93.69%85.50%
2017-02-27CTDN-3-PN77.46%94.85%85.28%
2017-08-15MultDet83.80%86.42%85.09%
2016-08-31MCLAB_TextBoxes82.59%87.73%85.08%
2016-06-23SRC-B-TextProcessingLab80.18%90.50%85.03%
2016-04-10SCUT-HCII82.79%87.17%84.93%
2017-02-25CTDN276.11%95.20%84.59%
2018-05-06cvmt_frm5986.45%82.19%84.27%
2015-04-03StradVision78.85%90.21%84.15%
2017-05-27BUPT_NIRC_multi79.07%89.34%83.89%
2016-03-16TextConv+WordGraph75.85%93.30%83.68%
2017-05-27BUPT_NIRC_multi77.94%90.23%83.63%
2015-04-02VGGMaxNet_02579.58%88.04%83.59%
2015-03-26VGGMaxNet_cmb77.57%90.47%83.53%
2015-11-04MSER_Binary_CNN78.67%88.79%83.42%
2016-03-16TextConv+WordGraph75.23%93.28%83.29%
2015-03-23VGGMaxNet_01376.49%91.36%83.27%
2015-11-28CASIA_USTB-Cascaded77.63%89.50%83.14%
2017-03-05WeText76.40%91.16%83.13%
2015-03-23VGGMaxNet_1.675.71%91.85%83.00%
2017-03-24(๑•̀ㅂ•́)و✧82.34%83.54%82.94%
2015-10-21MCLAB_FCN77.81%88.14%82.65%
2016-11-08CTPN73.72%92.77%82.15%
2017-03-01STDN78.90%85.64%82.14%
2016-01-18Text-CNN72.89%92.79%81.65%
2017-04-01ConnLink74.16%90.14%81.37%
2017-04-06ConnLink_pre71.98%92.26%80.87%
2017-07-24Jack's TD73.99%89.06%80.83%
2017-05-29ssd pretrain on synthtext and scut 79.51%81.85%80.66%
2017-05-29FCN based network for Text Detection74.94%87.16%80.59%
2017-09-05P-SSD.v180.47%80.68%80.58%
2014-11-12HUST_MCLAB74.28%87.68%80.43%
2016-11-13RRPN-371.89%90.22%80.02%
2016-07-13mser+rtree74.39%85.34%79.49%
2015-01-01BUCT_YST72.84%84.43%78.21%
2017-06-09MPT+Jar68.16%89.25%77.29%
2018-07-03ACI70.59%84.76%77.03%
2014-06-10IWRR201470.01%85.61%77.03%
2014-05-13SWT73.15%80.83%76.80%
2017-08-25bupt67.96%88.24%76.79%
2018-07-170.956_600_100069.30%85.73%76.64%
2018-07-170.956_1280_96067.27%88.88%76.58%
2018-07-17123_0.927_1280_96070.72%82.87%76.31%
2013-04-07USTB_TexStar66.45%88.47%75.89%
2017-04-26Cascade Filtering and Grouping69.06%82.96%75.38%
2013-04-05TextSpotter64.84%87.51%74.49%
2013-08-29UMD_IntegratedDisrimination62.26%89.17%73.33%
2013-04-08CASIA_NLPR68.24%78.89%73.18%
2015-07-22ZText63.51%84.73%72.60%
2013-12-23BayesText63.51%84.30%72.44%
2013-04-08Text_detector_CASIA62.85%84.70%72.16%
2013-04-09I2R_NUS_FAR69.00%75.08%71.91%
2017-10-12TextFCN V275.53%67.75%71.43%
2017-08-13P-SSD.v165.52%77.51%71.01%
2014-08-18DetectText66.05%75.82%70.60%
2015-03-23VGGMaxNet_1054.87%97.35%70.18%
2013-04-08I2R_NUS66.17%72.54%69.21%
2013-04-08TH-TextLoc65.19%69.96%67.49%
2017-04-02CNN_Text65.68%59.93%62.67%
2015-12-17TEST1752.46%77.05%62.42%
2013-04-06Text Detection53.42%74.15%62.10%
2017-03-24CNN64.91%57.86%61.18%
2015-08-18MSER with LocalSWT45.37%65.05%53.46%
2014-09-16MSERs51.78%52.48%52.13%
2015-08-18MSER44.62%53.31%48.58%
2013-04-25Baseline34.74%60.76%44.21%
2013-04-10Inkam35.27%31.20%33.11%

Ranking Graphic