16. Fine-tuning and testing of a deep learning algorithm for pruning regions detection in spur-pruned grapevines

In: Precision agriculture '21
Authors:
P. Guadagna Università Cattolica del Sacro Cuore, Via E. Parmense 84, 29122 Piacenza, Italy.

Search for other papers by P. Guadagna in
Current site
Google Scholar
PubMed
Close
,
T. Frioni Università Cattolica del Sacro Cuore, Via E. Parmense 84, 29122 Piacenza, Italy.

Search for other papers by T. Frioni in
Current site
Google Scholar
PubMed
Close
,
F. Chen Istituto Italiano di Tecnologia, Via Morego 30, 16163 Genova, Italy.

Search for other papers by F. Chen in
Current site
Google Scholar
PubMed
Close
,
A. Incerti Delmonte Istituto Italiano di Tecnologia, Via Morego 30, 16163 Genova, Italy.

Search for other papers by A. Incerti Delmonte in
Current site
Google Scholar
PubMed
Close
,
T. Teng Università Cattolica del Sacro Cuore, Via E. Parmense 84, 29122 Piacenza, Italy.
Istituto Italiano di Tecnologia, Via Morego 30, 16163 Genova, Italy.

Search for other papers by T. Teng in
Current site
Google Scholar
PubMed
Close
,
M. Fernandes Istituto Italiano di Tecnologia, Via Morego 30, 16163 Genova, Italy.

Search for other papers by M. Fernandes in
Current site
Google Scholar
PubMed
Close
,
A. Scaldaferri Istituto Italiano di Tecnologia, Via Morego 30, 16163 Genova, Italy.

Search for other papers by A. Scaldaferri in
Current site
Google Scholar
PubMed
Close
,
C. Semini Istituto Italiano di Tecnologia, Via Morego 30, 16163 Genova, Italy.

Search for other papers by C. Semini in
Current site
Google Scholar
PubMed
Close
,
S. Poni Università Cattolica del Sacro Cuore, Via E. Parmense 84, 29122 Piacenza, Italy.

Search for other papers by S. Poni in
Current site
Google Scholar
PubMed
Close
, and
M. Gatti Università Cattolica del Sacro Cuore, Via E. Parmense 84, 29122 Piacenza, Italy.

Search for other papers by M. Gatti in
Current site
Google Scholar
PubMed
Close

Purchase instant access (PDF download and unlimited online access):

$40.00

Vineyard management cost is significantly affected by selective operations such as winter pruning. This study aimed to fine-tune and test a deep neural network (DNN) based algorithm for detecting pruning regions. Focusing on spur-pruned grapevines, in order to fine tune the DNN, around 1000 RGB images were acquired and pruning target regions ground-truthed. The DNN was tested on 5 vines, 232 frames were acquired and processed in real-time for identifying the regions of interest as potential pruning regions (PPRs). PPRs were then classified depending on wood type, orientation and visibility. True positives (TPs), false positives (FPs) and false negatives (FNs) were identified in each frame. Best detection performance was obtained for visible coplanar simple spurs (recall = 98%) while the recall index was generally lower than 60% when pruning regions (PRs) were not clearly visible. FPs were more frequently associated with old cuts located on permanent organs such as trunks and cordons.

  • Collapse
  • Expand
  • Bargoti, S. and Underwood, J.P. (2017). Image segmentation for fruit detection and yield estimation in apple orchards. Journal of Field Robotics 34(6) 1039-1060.

  • Botterill, T., Paulin, S., Green, R., Williams, S., Lin, J., Saxton, V. et al. (2017). A robot system for pruning grape vines. Journal of Field Robotics 34(6) 1100-1122.

  • Dias, P.A., Tabb, A. and Medeiros, H. (2018). Apple flower detection using deep convolutional networks. Computers in Industry 99 17-28.

  • Díaz, C.A., Pérez, D.S., Miatello, H. and Bromberg, F. (2018). Grapevine buds detection and localization in 3D space based on Structure from Motion and 2D image classification. Computers in Industry 99 303-312.

  • Fathallah, F.A. (2010). Musculoskeletal disorders in labor-intensive agriculture. Applied Ergonomics 41(6) 738-743.

  • He, L. and Schupp, J. (2018). Sensing and automation in pruning of apple trees: A review. Agronomy 8(10) 211.

  • Intrieri, C. and Poni, S. (1995). Integrated evolution of trellis training systems and machines to improve grape quality and vintage quality of mechanized Italian vineyards. American Journal of Enology and Viticulture 46(1) 116-127.

  • Poni, S., Tombesi, S., Palliotti, A., Ughini, V. and Gatti, M. (2016). Mechanical winter pruning of grapevine: physiological bases and applications. Scientia Horticulturae 204 88-98.

  • Ren, S., He, K., Girshick, R. and Sun, J. (2017). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 39(6) 1137-1149.

  • Rudolph, R., Herzog, K., Töpfer, R., and Steinhage, V. (2018). Efficient identification, localization and quantification of grapevine inflorescences in unprepared field images using fully convolutional networks. Vitis 58(3) 95-104.

  • Shorten, C. and Khoshgoftaar, T.M. (2019). A survey on Image Data Augmentation for Deep Learning. Journal of Big Data 6 60.

  • Vougioukas, S.G. (2019). Agricultural Robotics. Annual Review of Control, Robotics, and Autonomous Systems 2 365-392.

  • Williams, H., Nejati, M., Hussein, S., Penhall, N., Lim, J.Y., Jones, M.H. et al. (2020). Autonomous pollination of individual kiwifruit flowers: Toward a robotic kiwifruit pollinator. Journal of Field Robotics 37(2) 246-262.

  • You, A., Sukkar, F., Fitch, R., Karkee, M. and Davidson, J.R. (2020). An Efficient Planning and Control Framework for Pruning Fruit Trees. In: Proceedings of IEEE International Conference on Robotics and Automation 9197551 pp. 3930-3936.

Metrics

All Time Past 365 days Past 30 Days
Abstract Views 38 31 12
Full Text Views 3 3 0
PDF Views & Downloads 5 4 0