Next Article in Journal
Gait Classification Using Mahalanobis–Taguchi System for Health Monitoring Systems Following Anterior Cruciate Ligament Reconstruction
Next Article in Special Issue
Novel Hand Gesture Alert System
Previous Article in Journal
Analysis of Heat and Smoke Propagation and Oscillatory Flow through Ceiling Vents in a Large-Scale Compartment Fire
Previous Article in Special Issue
TF-YOLO: An Improved Incremental Network for Real-Time Object Detection
Open AccessArticle

Fast Continuous Structural Similarity Patch Based Arbitrary Style Transfer

1
Shanghai Film Academy, Shanghai University, Shanghai 200072, China
2
School of Literature and Media, Taishan University, Tai’an 271021, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2019, 9(16), 3304; https://doi.org/10.3390/app9163304
Received: 17 July 2019 / Revised: 30 July 2019 / Accepted: 8 August 2019 / Published: 12 August 2019
(This article belongs to the Special Issue Advanced Intelligent Imaging Technology)
  |  
PDF [7725 KB, uploaded 12 August 2019]
  |  

Abstract

Style transfer is using a pair of content and style images to synthesize a stylized image which has both the structure of the content image and the style of style image. Existing optimization-based methods are limited in their performance. Some works using a feed-forward network allow arbitrary style transfer but cannot reflect the style. In this paper, we present a fast continuous structural similarity patch based arbitrary style transfer. Firstly, we introduce the structural similarity index (SSIM) to compute the similarity between all of the content and style patches for obtaining their similarity. Then a local style patch choosing procedure is applied to maximize the utilization of all style patches and make the swapped style patch continuous matching with respect to the spatial location of style at the same time. Finally, we apply an efficient trained feed-forward inverse network to obtain the final stylized image. We use more than 80,000 natural images and 120,000 style images to train that feed-forward inverse network. The results show that our method is able to transfer arbitrary style with consistency, and the result comparison stage is made to show the effectiveness and high-quality of our stylized images. View Full-Text
Keywords: style transfer; similarity structure patch; continuity of local style patch; feed-forward network style transfer; similarity structure patch; continuity of local style patch; feed-forward network
Figures

Figure 1

This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).
SciFeed

Share & Cite This Article

MDPI and ACS Style

Wu, B.; Ding, Y.; Dong, Q. Fast Continuous Structural Similarity Patch Based Arbitrary Style Transfer. Appl. Sci. 2019, 9, 3304.

Show more citation formats Show less citations formats

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Related Articles

Article Metrics

Article Access Statistics

1

Comments

[Return to top]
Appl. Sci. EISSN 2076-3417 Published by MDPI AG, Basel, Switzerland RSS E-Mail Table of Contents Alert
Back to Top