ICME 2006 Toronto

T1.3 Digital Inpainting

Sunday, July 9, 2006 (09:00 - 12:00, Thomson)

Instructor

Professor Timothy K. Shih, Tamkang University, Taiwan

Abstract

Digital inpainting is an interesting new research topic in multimedia computing and image processing since 2000. This tutorial will cover the most recent contributions in digital image inpainting / image completion, video inpainting, and 3-D surface completion. In the literature, the first intention of image inpainting was to remove damages portions of an aged photo, by completing the area with surrounding or global information. The techniques used include the analysis and usage of pixel properties in spatial and frequency domains. Furthermore, image inpainting techniques were used in object removal (or image completion) in photos. Several strategic algorithms were developed based on confidence values and priorities of using pixels. The techniques used in still images were then extended to video inpainting, which need to consider temporal properties such as motion vectors. With a reasonable combination of object tracking and image completion, objects in video can be removed and possibly replaced. On the other hand, aged films contain two types of defects: spikes and lone vertical lines. These defects need to be precisely detected and removed to restore the original film. In addition, based on image completion techniques, incompleteness of scanning results of a 3-D scanner due to improper location or other reasons of a scanner can be solved. This tutorial will discuss the above techniques founded in more than 30 top papers. In addition to an overview, the tutorial will be divided into 4 sections: image inpainting, video inpainting, 3-D surface inpainting, and a section to discuss inpainting projects developed by the presenter. Demonstrations will be included. In addition, the tutorial presenter will distribute a CD ROM to the audience. The CD ROM will include several interesting computer programs for testing inpainting results.

Course Outline

  1. Overview of This Tutorial
    1. Topics, papers, and demo tools
  2. Image Inpainting
    1. Survey of 10 top papers
    2. Interpolation using spatial property
    3. Synthesis in frequency domain
    4. Hierarchical and progressive issues
    5. Object removal
    6. Demonstration of image inpainting
  3. Video Inpainting
    1. Survey of 10 top papers
    2. Detection of video noises
    3. Detection of logos
    4. Detection of spike defects on aged movies
    5. Detection of vertical line defects on aged movies
    6. Object removal and replacement
    7. Demonstration of video inpainting examples
  4. 3-D Surface Inpainting
    1. Survey of top papers
    2. Demonstration of 3-D surface inpainting
  5. Interesting Projects
    1. Multi-resolution and Multi-layer Image Inpainting
    2. Defect Detection on Photos
    3. Defect Detection and Restoration on Aged Films
    4. Object Removal and Replacement on Movies
  6. Summary, References, and Future Directions

Speaker Biography

Timothy Shih is a Professor of the Department of Computer Science and Information Engineering at Tamkang University, Taiwan. He is a member of ACM. As a senior member of IEEE, Dr. Shih joins the Educational Activities Board of the Computer Society. His current research interests include Multimedia Computing and Distance Learning. He was a faculty of the Computer Engineering Department at Tamkang University in 1986. In 1993 and 1994, he was a part time faculty of the Computer Engineering Department at Santa Clara University, USA. He was also a visiting professor at the University of Aizu, Japan in summer 1999, a visiting researcher at the Academia Sinica, Taiwan in summer 2001, and an adjunct faculty member of Xidian University, China. Dr. Shih has edited many books and published over 340 papers and book chapters, as well as participated in many international academic activities, including the organization of more than 40 international conferences (including ICME 2004 and MMM 2003). He is the founder and co-editor-in-chief of the International Journal of Distance Education Technologies, published by Idea Group Publishing, USA. He is also the associate editor of IEEE Transactions on Multimedia and ACM Transactions on Internet Technology. Dr. Shih has received many research awards, including research awards from National Science Council of Taiwan, IIAS research award of Germany, the 2005 Brandon Hall Excellence in Learning Awards of USA and several best paper awards from international conferences. He also received many funded research grants from both domestic and international agencies. Dr. Shih has been invited to give more than 10 keynote speeches and plenary talks in international conferences (including DMS 2005, ICWL 2005, ICITA 2005, CIT 2004, and ICITA 2004), and presented more than 10 tutorials (including MMM 2004, ACM Multimedia 2002, IEEE ICME 2001, MMM 2001, and PCM 2001).


©2008 Conference Management Services, Inc. -||- email: webmaster@icme2006.org -||- Last updated Friday, June 23, 2006