method: SenseTime2016-01-27

Authors: wei wu, junjie yan

Description: A combination of FCN and RPN.

method: TextFuseNet2020-07-31

Authors: Jian Ye, Zhe Chen, Juhua Liu and Bo Du

Affiliation: Wuhan University, The University of Sydney

Email: liujuhua@whu.edu.cn

Description: Arbitrary shape text detection in natural scenes is an extremely challenging task. Unlike existing text detection approaches that only perceive texts based on limited feature representations, we propose a novel framework, namely TextFuseNet, to exploit the use of richer features fused for text detection. More specifically, we propose to perceive texts from three levels of feature representations, i.e., character-, word- and global-level, and then introduce a novel text representation fusion technique to help achieve robust arbitrary text detection. The multi-level feature representation can adequately describe texts by dissecting them into individual characters while still maintaining their general semantics. TextFuseNet then collects and merges the texts’ features from different levels using a multi-path fusion architecture which can effectively align and fuse different representations. In practice, our proposed TextFuseNet can learn a more adequate description of arbitrary shapes texts, suppressing false positives and producing more accurate detection results. Our proposed framework can also be trained with weak supervision for those datasets that lack character-level annotations. Experiments on several datasets show that the proposed TextFuseNet achieves state-of-the-art performance. Specifically, we achieve an F-measure of 94.3% on ICDAR2013, 92.1% on ICDAR2015,87.1% on Total-Text and 86.6% on CTW-1500, respectively.

method: TencentAILab2017-11-21

Authors: Jingchao Zhou, Yitong Wang, Xing Ji, Zhifeng Li

Description: An FCN architecture with U-Net as the backbone for extracting multi-scale low level feature maps.

Ranking Table

Description Paper Source Code
DateMethodRecallPrecisionHmean
2016-01-27SenseTime91.87%95.45%93.62%
2020-07-31TextFuseNet90.78%95.58%93.11%
2017-11-21TencentAILab94.79%91.37%93.05%
2020-12-15VARCO89.86%93.63%91.71%
2020-05-13HIT89.22%93.85%91.48%
2018-11-07CRAFT89.04%93.93%91.42%
2020-01-20VARCO90.50%92.01%91.25%
2021-01-21NCU_MSP88.86%93.02%90.89%
2017-06-25FEN88.49%93.35%90.86%
2018-01-22FOTS89.68%91.43%90.55%
2019-05-29crpn.v288.58%92.56%90.53%
2017-08-15MultDet89.68%91.09%90.38%
2019-05-03Mask Textspotter87.40%93.55%90.37%
2018-12-03SPCNet_TongJi & UESTC (single scale)88.68%91.86%90.24%
2019-07-23CM-CV&AR89.32%90.72%90.01%
2018-03-05HappyCCL88.40%91.67%90.00%
2019-07-12stela88.13%91.38%89.73%
2017-02-17NLPR-CASIA86.76%92.23%89.41%
2018-04-17Ali-Amap-xlab-v487.49%90.98%89.20%
2017-08-10SRC-B-MachineLearningLab-v487.49%90.81%89.12%
2017-12-15EPTN-SJTU87.31%90.62%88.93%
2020-05-19Craft++86.67%91.07%88.82%
2020-01-21ChinaUnicom-AI86.58%88.68%87.62%
2021-01-09FENET79.27%97.31%87.37%
2020-11-10Hancom Vision81.74%92.94%86.98%
2022-08-26HBLAB-OCR83.29%90.12%86.57%
2020-01-06NCU_MSP85.75%87.35%86.54%
2017-03-22MCLAB_TextBoxes_v283.29%89.94%86.49%
2017-04-04xmu40383.11%90.10%86.46%
2016-12-16RRPN-483.56%89.53%86.44%
2017-07-04FPTD86.03%86.74%86.38%
2018-05-06cvmt_allStepNoLkTree85.30%86.96%86.12%
2018-01-04crpn82.28%89.65%85.81%
2019-02-12NCSOFT VISION AI LAB88.04%83.46%85.69%
2017-05-27BUPT_NIRC_multi80.55%90.93%85.42%
2018-12-08Unicamp-SRBR-v280.82%90.49%85.38%
2018-05-06CVMT_frm6284.38%86.03%85.20%
2016-08-31MCLAB_TextBoxes82.28%87.82%84.96%
2017-05-27BUPT_NIRC_multi79.09%91.74%84.94%
2019-04-19CenterText(Single-scale)82.47%86.74%84.55%
2018-07-03ACI76.89%92.32%83.91%
2015-03-26VGGMaxNet_cmb78.08%90.09%83.66%
2015-04-02VGGMaxNet_02579.82%87.58%83.52%
2018-12-08Unicamp-SRBR-v375.62%92.62%83.26%
2015-03-23VGGMaxNet_01376.53%90.50%82.93%
2015-03-23VGGMaxNet_1.675.89%91.32%82.89%
2019-03-23SSP-RPNs with Pytorch83.65%80.70%82.15%
2017-06-09MPT+Jar71.96%93.92%81.49%
2017-05-29ssd pretrain on synthtext and scut 80.64%81.53%81.08%
2017-09-05P-SSD.v181.64%80.40%81.01%
2017-05-02TsinghuaOCR77.63%84.33%80.84%
2018-05-06cvmt_frm5984.66%77.06%80.68%
2016-04-10SCUT-HCII78.63%82.31%80.43%
2016-07-18SCUT-HCII75.71%84.51%79.87%
2020-03-26RRPN R-50 model_final 2020032776.07%83.80%79.75%
2019-01-31ssprpns72.51%87.64%79.36%
2019-06-26std(single-scale)76.99%80.98%78.93%
2016-11-13RRPN-370.50%88.23%78.38%
2015-01-01BUCT_YST72.15%83.60%77.45%
2016-03-16TextConv+WordGraph68.22%89.35%77.37%
2016-03-16TextConv+WordGraph67.67%89.49%77.07%
2015-10-21MCLAB_FCN70.59%83.93%76.69%
2016-06-23Baidu IDL70.23%82.07%75.69%
2014-11-12HUST_MCLAB68.49%83.33%75.19%
2014-05-13SWT72.69%76.69%74.64%
2018-12-08Unicamp-SRBR-v163.20%88.04%73.58%
2015-04-03StradVision66.03%80.87%72.70%
2017-08-13P-SSD.v168.86%76.24%72.36%
2017-03-23RTN65.21%80.77%72.16%
2022-05-081111177.72%66.59%71.72%
2013-04-09I2R_NUS_FAR68.95%74.46%71.60%
2013-04-07USTB_TexStar61.46%84.76%71.25%
2017-03-16Ali-Amap-xlab-v266.03%76.35%70.81%
2016-06-23SRC-B-TextProcessingLab64.02%79.03%70.74%
2017-10-12TextFCN V274.52%66.61%70.34%
2013-04-08CASIA_NLPR66.12%74.64%70.12%
2017-03-24(๑•̀ㅂ•́)و✧66.67%73.74%70.02%
2016-12-04Ali-Amap-xlab64.93%75.96%70.01%
2013-04-05TextSpotter61.19%81.61%69.94%
2015-03-23VGGMaxNet_1054.70%96.61%69.85%
2015-07-22ZText60.00%82.95%69.63%
2013-12-23BayesText60.00%82.54%69.49%
2015-11-04MSER_Binary_CNN63.29%76.49%69.27%
2017-11-15Sensetime line-level detection59.54%81.81%68.92%
2016-01-18Text-CNN59.09%81.59%68.54%
2013-04-08I2R_NUS65.30%72.08%68.52%
2017-01-22SRC-B-MachineLearningLab60.46%79.00%68.49%
2018-12-29fast_ret_sh_0258.81%76.76%66.60%
2014-08-18DetectText59.82%71.58%65.17%
2013-04-08Text_detector_CASIA54.70%80.19%65.04%
2017-04-26Cascade Filtering and Grouping56.71%75.27%64.69%
2013-08-29UMD_IntegratedDisrimination52.69%81.61%64.04%
2017-02-28Tencent Youtu53.79%76.30%63.10%
2017-02-21STDN-251.51%75.60%61.27%
2017-02-07CAS_HotEye51.51%75.10%61.11%
2017-02-27CTDN-3-PN50.87%76.09%60.97%
2017-02-25CTDN250.14%76.46%60.56%
2017-04-02CNN_Text61.19%56.40%58.69%
2017-03-24CNN62.01%54.85%58.21%
2013-04-08TH-TextLoc50.78%59.66%54.86%
2015-08-18MSER with LocalSWT38.90%60.43%47.33%
2016-12-21MSRA_v135.71%61.09%45.07%
2013-04-06Text Detection34.25%60.29%43.68%
2017-03-01STDN36.07%54.86%43.53%
2013-04-25Baseline34.52%57.62%43.18%
2017-05-29FCN based network for Text Detection32.60%60.51%42.37%
2019-07-17AFCTPN31.96%60.55%41.84%
2014-06-10IWRR201432.24%56.12%40.95%
2017-03-05WeText31.23%56.16%40.14%
2015-11-28CASIA_USTB-Cascaded31.51%55.20%40.12%
2017-04-06ConnLink_pre30.05%58.02%39.59%
2017-04-01ConnLink30.32%56.18%39.38%
2017-08-25bupt29.59%55.48%38.59%
2017-07-24Jack's TD29.77%54.61%38.53%
2016-11-08CTPN28.40%54.85%37.42%
2015-12-17TEST1726.39%58.27%36.33%
2018-07-17123_0.927_1280_96028.22%50.08%36.10%
2018-07-170.956_1280_96026.03%52.78%34.86%
2019-02-16[BKU K15]27.40%43.48%33.61%
2018-12-18test25.94%47.73%33.61%
2018-07-170.956_600_100024.47%46.53%32.08%
2013-04-10Inkam28.04%29.10%28.56%
2015-08-18MSER20.18%34.97%25.59%
2014-09-16MSERs19.63%34.57%25.04%

Ranking Graphic