Stereo vision with Equal Baseline Multiple Camera Set (EBMCS) for obtaining depth maps of plants

Adam Kaczmarek

doi:10.1016/j.compag.2016.11.022

Stereo vision with Equal Baseline Multiple Camera Set (EBMCS) for obtaining depth maps of plants

Abstract

This paper presents a method of improving the estimation of distances between an autonomous harvesting robot and plants with ripe fruits by using the vision system based on five cameras. The system is called Equal Baseline Multiple Camera Set (EBMCS). EBMCS has some features of a camera matrix and a camera array. EBMCS is regarded as a set of stereo cameras for estimating distances by obtaining disparity maps and depth maps. This paper introduces Exceptions Excluding Merging Method (EEMM) which makes it possible to improve the quality of disparity maps by integrating maps acquired from individual stereo cameras included in EBMCS. The method was tested with eight different stereo matching algorithms including Efficient Large-scale Stereo Matching (ELAS), algorithms implemented in the OpenCV library and algorithms available in Middlebury Stereo Vision Page. Experiments were performed on input data sets which contained images of strawberry plants, cherry trees and redcurrant plants. The bad matching pixels (BMP) metric was used for measuring the error rate in disparity maps used in the distance estimation. The results of experiments showed that, on average, the EEMM merging method used with EBMCS consisting of five cameras reduces the error rate of the distance estimation by 26.55% in comparison to results obtained from stereoscopy based on a single stereo camera. The best results were acquired by using with five cameras a stereo matching algorithm based on a graph cut.

Citations

2 5

CrossRef
0

Web of Science
2 7

Scopus

Author (1)

Adam Kaczmarek dr inż.

Cite as

Full text

full text is not available in portal

full content of the article see on external site open in new tab

Keywords

Details

Category:: Articles
Type:: artykuł w czasopiśmie wyróżnionym w JCR
Published in:: COMPUTERS AND ELECTRONICS IN AGRICULTURE no. 135, pages 23 - 37,
ISSN: 0168-1699
Language:: English
Publication year:: 2017
Bibliographic description:: Kaczmarek A.: Stereo vision with Equal Baseline Multiple Camera Set (EBMCS) for obtaining depth maps of plants// COMPUTERS AND ELECTRONICS IN AGRICULTURE. -Vol. 135, (2017), s.23-37
DOI:: Digital Object Identifier (open in new tab) 10.1016/j.compag.2016.11.022
Verified by:: Gdańsk University of Technology