Next Article in Journal
Factors That Affect Liquefaction-Induced Lateral Spreading in Large Subduction Earthquakes
Previous Article in Journal
Modeling the Slump-Type Landslide Tsunamis Part I: Developing a Three-Dimensional Bingham-Type Landslide Model
Open AccessArticle

Instance Segmentation Method of User Interface Component of Games

by 1 and 2,*
1
School of Games, Hongik University, Sejong 30016, Korea
2
Department of Digital Media Design and Applications, Seoul Women’s University, Seoul 01797, Korea
*
Author to whom correspondence should be addressed.
Appl. Sci. 2020, 10(18), 6502; https://doi.org/10.3390/app10186502
Received: 22 August 2020 / Revised: 10 September 2020 / Accepted: 14 September 2020 / Published: 17 September 2020
(This article belongs to the Section Computing and Artificial Intelligence)
On the game screen, the UI interface provides key information for game play. A vision deep learning network exploits pure pixel information in the screen. Apart from this, if we separately extract the information provided by the UI interface and use it as an additional input value, we can enhance the learning efficiency of deep learning networks. To this end, by effectively segmenting UI interface components such as buttons, image icons, and gauge bars on the game screen, we should be able to separately analyze only the relevant images. In this paper, we propose a methodology that segments UI components in a game by using synthetic game images created on a game engine. We developed a tool that approximately detected the UI areas of an image in games on the game screen and generated a large amount of synthetic labeling data through this. By training this data on a Pix2Pix, we applied UI segmentation. The network trained in this way can segment the UI areas of the target game regardless of the position of the corresponding UI components. Our methodology can help analyze the game screen without applying data augmentation to the game screen. It can also help vision researchers who should extract semantic information from game image data. View Full-Text
Keywords: instance segmentation; UI segmentation; game user interface instance segmentation; UI segmentation; game user interface
Show Figures

Figure 1

MDPI and ACS Style

Kang, S.; Choi, J.-i. Instance Segmentation Method of User Interface Component of Games. Appl. Sci. 2020, 10, 6502. https://doi.org/10.3390/app10186502

AMA Style

Kang S, Choi J-i. Instance Segmentation Method of User Interface Component of Games. Applied Sciences. 2020; 10(18):6502. https://doi.org/10.3390/app10186502

Chicago/Turabian Style

Kang, Shinjin; Choi, Jong-in. 2020. "Instance Segmentation Method of User Interface Component of Games" Appl. Sci. 10, no. 18: 6502. https://doi.org/10.3390/app10186502

Find Other Styles
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Access Map by Country/Region

1
Search more from Scilit
 
Search
Back to TopTop