Skip to Content
You are currently on the new version of our website. Access the old version .
SensorsSensors
  • Article
  • Open Access

11 September 2021

15 Pages

Automatic Inside Point Localization with Deep Reinforcement Learning for Interactive Object Segmentation

,
and
1
College of Physical Science and Technology, Central China Normal University, NO. 152 Luoyu Road, Wuhan 430079, China
2
Key Laboratory of Quark and Lepton Physics (MOE) and College of Physics Science and Technology, Central China Normal University, NO. 152 Luoyu Road, Wuhan 430079, China
3
School of Big Data and Computer Science, Guizhou Normal University, The University Town, Guian New Area, Guiyang 550025, China
4
Center for RFID and WSN Engineering, Department of Education, Guizhou Normal University, The University Town, Guian New Area, Guiyang 550025, China
This article belongs to the Topic Artificial Intelligence in Sensors

Abstract

In the task of interactive image segmentation, the Inside-Outside Guidance (IOG) algorithm has demonstrated superior segmentation performance leveraging Inside-Outside Guidance information. Nevertheless, we observe that the inconsistent input between training and testing when selecting the inside point will result in significant performance degradation. In this paper, a deep reinforcement learning framework, named Inside Point Localization Network (IPL-Net), is proposed to infer the suitable position for the inside point to help the IOG algorithm. Concretely, when a user first clicks two outside points at the symmetrical corner locations of the target object, our proposed system automatically generates the sequence of movement to localize the inside point. We then perform the IOG interactive segmentation method for precisely segmenting the target object of interest. The inside point localization problem is difficult to define as a supervised learning framework because it is expensive to collect image and their corresponding inside points. Therefore, we formulate this problem as Markov Decision Process (MDP) and then optimize it with Dueling Double Deep Q-Network (D3QN). We train our network on the PASCAL dataset and demonstrate that the network achieves excellent performance.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.