Adaptive Image Thresholding of Yellow Peppers for a Harvesting Robot
AbstractThe presented work is part of the H2020 project SWEEPER with the overall goal to develop a sweet pepper harvesting robot for use in greenhouses. As part of the solution, visual servoing is used to direct the manipulator towards the fruit. This requires accurate and stable fruit detection based on video images. To segment an image into background and foreground, thresholding techniques are commonly used. The varying illumination conditions in the unstructured greenhouse environment often cause shadows and overexposure. Furthermore, the color of the fruits to be harvested varies over the season. All this makes it sub-optimal to use fixed pre-selected thresholds. In this paper we suggest an adaptive image-dependent thresholding method. A variant of reinforcement learning (RL) is used with a reward function that computes the similarity between the segmented image and the labeled image to give feedback for action selection. The RL-based approach requires less computational resources than exhaustive search, which is used as a benchmark, and results in higher performance compared to a Lipschitzian based optimization approach. The proposed method also requires fewer labeled images compared to other methods. Several exploration-exploitation strategies are compared, and the results indicate that the Decaying Epsilon-Greedy algorithm gives highest performance for this task. The highest performance with the Epsilon-Greedy algorithm (
Share & Cite This Article
Ostovar, A.; Ringdahl, O.; Hellström, T. Adaptive Image Thresholding of Yellow Peppers for a Harvesting Robot. Robotics 2018, 7, 11.
Ostovar A, Ringdahl O, Hellström T. Adaptive Image Thresholding of Yellow Peppers for a Harvesting Robot. Robotics. 2018; 7(1):11.Chicago/Turabian Style
Ostovar, Ahmad; Ringdahl, Ola; Hellström, Thomas. 2018. "Adaptive Image Thresholding of Yellow Peppers for a Harvesting Robot." Robotics 7, no. 1: 11.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.