Identifying veraison process of colored wine grapes in field conditions combining deep learning and image analysis

Lei Shen, Shan Chen, Zhiwen Mi, Jinya Su, Rong Huang, Yuyang Song, Yulin Fang, Baofeng Su*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

8 Citations (Scopus)


Accurate identification of the veraison process is essential for improving wine quality, which is challenging due to the variability of veraison among berries of the same cluster in algorihtm design, and also the subjective and labor-intensive issues in mannual identification. Therefore, this study proposed a method combining deep learning and image analysis to identify veraison in colored
wine grapes under natural field growing conditions. The removal of irrelevant background was first achieved by semantic segmentation model, and then Mask R-CNN instance segmentation pipeline was constructed with anchor parameters optimization. In particular, three kinds of backbone networks were analyzed and compared in Mask R-CNN, and the overall performance of ResNet50-FPN was the best, with the testset Average Precision reaching 81.53% and the inference time being only 45.70ms/frame. Then, a method for characterizing berry veraison by H component of HSV color space was proposed and the invariance of the H component of three colored wine grape berries under different light conditions was verified and discussed. An algorithm was developed to identify
veraison progress by calculating the percentage of the number of berries of different grades in the total number of berries of the whole grape bunches. The test accuracy reached 92.50%, 91.25% and 91.88% for three wine grapes including Cabernet Sauvignon, Matheran and Syrah respectively. The proposed method is able to provide vital reference for automated monitoring and intelligent management decisions of grape growth.
Original languageEnglish
Article number107268
Number of pages15
JournalComputers and Electronics in Agriculture
Early online date6 Aug 2022
Publication statusPublished - Sept 2022

Bibliographical note

This work was supported by the National Key R&D Program Project of China (Grant No. 2019YFD1002500) and Guangxi Key R&D Program Project (Grant No. Gui Ke AB21076001) The authors would like to thank the anonymous reviewers for their helpful comments and suggestions.

Data Availability Statement

Data will be made available on request.


  • Grape veraison
  • Mask R-CNN
  • Segmentation
  • H component


Dive into the research topics of 'Identifying veraison process of colored wine grapes in field conditions combining deep learning and image analysis'. Together they form a unique fingerprint.

Cite this