TY - GEN
T1 - An End-to-End Deep Neural Architecture for Optical Character Verification and Recognition in Retail Food Packaging
AU - De Sousa Ribeiro, Fabio
AU - Gong, Liyun
AU - Caliva, Francesco
AU - Swainson, Mark
AU - Gudmundsson, Kjartan
AU - Yu, Miao
AU - Leontidis, Georgios
AU - Ye, Xujiong
AU - Kollias, Stefanos
PY - 2018/8/29
Y1 - 2018/8/29
N2 - There exist various types of information in retail food packages, including food product name, ingredients list and use by date. The correct recognition and coding of use by dates is especially critical in ensuring proper distribution of the product to the market and eliminating potential health risks caused by erroneous mislabelling. The latter can have a major negative effect on the health of consumers and consequently raise legal issues for suppliers. In this work, an end-to-end architecture, composed of a dual deep neural network based system is proposed for automatic recognition of use by dates in food package photos. The system includes: a Global level convolutional neural network (CNN) for high-level food package image quality evaluation (blurry/clear/missing use by date statistics); a Local level fully convolutional network (FCN) for use by date ROI localisation. Post ROI extraction, the date characters are then segmented and recognised. The proposed framework is the first to employ deep neural networks for end-to-end automatic use by date recognition in retail packaging photos. It is capable of achieving very good levels of performance on all the aforementioned tasks, despite the varied textual/pictorial content complexity found in food packaging design.
AB - There exist various types of information in retail food packages, including food product name, ingredients list and use by date. The correct recognition and coding of use by dates is especially critical in ensuring proper distribution of the product to the market and eliminating potential health risks caused by erroneous mislabelling. The latter can have a major negative effect on the health of consumers and consequently raise legal issues for suppliers. In this work, an end-to-end architecture, composed of a dual deep neural network based system is proposed for automatic recognition of use by dates in food package photos. The system includes: a Global level convolutional neural network (CNN) for high-level food package image quality evaluation (blurry/clear/missing use by date statistics); a Local level fully convolutional network (FCN) for use by date ROI localisation. Post ROI extraction, the date characters are then segmented and recognised. The proposed framework is the first to employ deep neural networks for end-to-end automatic use by date recognition in retail packaging photos. It is capable of achieving very good levels of performance on all the aforementioned tasks, despite the varied textual/pictorial content complexity found in food packaging design.
KW - Adaptation
KW - Deep learning
KW - Maximally stable extremal regions
KW - Optical character verification
KW - Transfer learning
UR - http://www.scopus.com/inward/record.url?scp=85062782289&partnerID=8YFLogxK
U2 - 10.1109/ICIP.2018.8451555
DO - 10.1109/ICIP.2018.8451555
M3 - Published conference contribution
AN - SCOPUS:85062782289
T3 - Proceedings - International Conference on Image Processing, ICIP
SP - 2376
EP - 2380
BT - 2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings
PB - IEEE Computer Society
T2 - 25th IEEE International Conference on Image Processing, ICIP 2018
Y2 - 7 October 2018 through 10 October 2018
ER -