Image-based facial sketch-to-photo synthesis via online coupled dictionary learning

Authors:
Mingli Song;Chun Chen;Jiajun Bu;Teng Sha
Affiliations:
College of Computer Science, Zhejiang University, Hangzhou 310027, China;College of Computer Science, Zhejiang University, Hangzhou 310027, China;College of Computer Science, Zhejiang University, Hangzhou 310027, China;College of Computer Science, Zhejiang University, Hangzhou 310027, China
Venue:
Information Sciences: an International Journal
Year:
2012

Citing 18
Cited 4

A multiresolution spline with application to image mosaics

ACM Transactions on Graphics (TOG)
A Nonlinear Approach for Face Sketch Synthesis and Recognition

CVPR '05 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Volume 1 - Volume 01
Geometry-Driven Photorealistic Facial Expression Synthesis

IEEE Transactions on Visualization and Computer Graphics
Learning Sparse Overcomplete Codes for Images

Journal of VLSI Signal Processing Systems
A method of illumination compensation for human face image based on quotient image

Information Sciences: an International Journal
Geometric Mean for Subspace Selection

IEEE Transactions on Pattern Analysis and Machine Intelligence
A new approach for face recognition by sketches in photos

Signal Processing
Patch Alignment for Dimensionality Reduction

IEEE Transactions on Knowledge and Data Engineering
Face/Off: live facial puppetry

Proceedings of the 2009 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
Bayesian tensor inference for sketch-based facial photo hallucination

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Face Photo-Sketch Synthesis and Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Photo-sketch synthesis and recognition based on subspace learning

Neurocomputing
A driver fatigue recognition model based on information fusion and dynamic Bayesian network

Information Sciences: an International Journal
Adaptive nonlinear manifolds and their applications to pattern recognition

Information Sciences: an International Journal
Digital image authentication and recovery: Employing integer transform based information embedding and extraction

Information Sciences: an International Journal
Manifold elastic net: a unified framework for sparse dimension reduction

Data Mining and Knowledge Discovery
An effective method for detecting facial features and face in human-robot interaction

Information Sciences: an International Journal
Face sketch recognition

IEEE Transactions on Circuits and Systems for Video Technology

Recognizing architecture styles by hierarchical sparse coding of blocklets

Information Sciences: an International Journal
Facial-feature detection and localization based on a hierarchical scheme

Information Sciences: an International Journal
Sparse Discriminative Information Preservation for Chinese character font categorization

Neurocomputing
Colorization for Gray Scale Facial Image by Locality-Constrained Linear Coding

Journal of Signal Processing Systems

Quantified Score

Hi-index	0.07

Visualization

Abstract

Image-based sketch-to-photo synthesis has received intense attention in recent years because of its potential applications in digital entertainment and law enforcement. In order to achieve successful hallucinating synthesis of a realistic face photo, a coupled dictionary is first learned from a set of training photo-sketch pairs for modeling the relationship between patches from sketches and photos. Then, a series of overlapped photo patches can be synthesized on the basis of the learned coupled dictionary. Afterwards, these overlapped photo patches are further selected by the proposed global energy minimization framework based on a Markov network. Finally, a multi-band blending process is carried out to synthesize a realistic face photo. The experimental results convincingly validate the effectiveness of the proposed approach in comparison with the existing techniques.