Abstract
Accurate identification of the veraison process is essential for improving wine quality, which is challenging due to the variability of veraison among berries of the same cluster in algorihtm design, and also the subjective and labor-intensive issues in mannual identification. Therefore, this study proposed a method combining deep learning and image analysis to identify veraison in colored
wine grapes under natural field growing conditions. The removal of irrelevant background was first achieved by semantic segmentation model, and then Mask R-CNN instance segmentation pipeline was constructed with anchor parameters optimization. In particular, three kinds of backbone networks were analyzed and compared in Mask R-CNN, and the overall performance of ResNet50-FPN was the best, with the testset Average Precision reaching 81.53% and the inference time being only 45.70ms/frame. Then, a method for characterizing berry veraison by H component of HSV color space was proposed and the invariance of the H component of three colored wine grape berries under different light conditions was verified and discussed. An algorithm was developed to identify
veraison progress by calculating the percentage of the number of berries of different grades in the total number of berries of the whole grape bunches. The test accuracy reached 92.50%, 91.25% and 91.88% for three wine grapes including Cabernet Sauvignon, Matheran and Syrah respectively. The proposed method is able to provide vital reference for automated monitoring and intelligent management decisions of grape growth.
wine grapes under natural field growing conditions. The removal of irrelevant background was first achieved by semantic segmentation model, and then Mask R-CNN instance segmentation pipeline was constructed with anchor parameters optimization. In particular, three kinds of backbone networks were analyzed and compared in Mask R-CNN, and the overall performance of ResNet50-FPN was the best, with the testset Average Precision reaching 81.53% and the inference time being only 45.70ms/frame. Then, a method for characterizing berry veraison by H component of HSV color space was proposed and the invariance of the H component of three colored wine grape berries under different light conditions was verified and discussed. An algorithm was developed to identify
veraison progress by calculating the percentage of the number of berries of different grades in the total number of berries of the whole grape bunches. The test accuracy reached 92.50%, 91.25% and 91.88% for three wine grapes including Cabernet Sauvignon, Matheran and Syrah respectively. The proposed method is able to provide vital reference for automated monitoring and intelligent management decisions of grape growth.
Original language | English |
---|---|
Article number | 107268 |
Number of pages | 15 |
Journal | Computers and Electronics in Agriculture |
Volume | 200 |
Early online date | 6 Aug 2022 |
DOIs | |
Publication status | Published - Sept 2022 |
Bibliographical note
AcknowledgmentsThis work was supported by the National Key R&D Program Project of China (Grant No. 2019YFD1002500) and Guangxi Key R&D Program Project (Grant No. Gui Ke AB21076001) The authors would like to thank the anonymous reviewers for their helpful comments and suggestions.
Data Availability Statement
Data will be made available on request.Keywords
- Grape veraison
- Mask R-CNN
- Segmentation
- H component