Paper: ACM NPAR (2003) “Image and video based painterly animation”

James Hays and Irfan Essa (2004) “Image and video based painterly animation” In Proceedings of the 3rd international symposium on Non-photorealistic animation and rendering (NPAR 2004), Annecy, France, June 7-9, 2004, pages, 113 – 120, ISBN:1-58113-887-3, 2004 (DOI|PDF|Project Web Site).

• J. Hays and I. Essa (2004), “Image and video based painterly animation,” in Proceedings of ACM Conference on Non-photorealistic animation and rendering (NPAR), New York, NY, USA, 2004, pp. 113-120. [BIBTEX]

  @inproceedings{2004-Hays-IVBPA,
    Address = {New York, NY, USA},
    Author = {J. Hays and I. Essa},
    Booktitle = {Proceedings of ACM Conference on Non-photorealistic animation and rendering (NPAR)},
    Date-Modified = {2011-12-08 21:27:48 +0000},
    Pages = {113--120},
    Publisher = {ACM Press},
    Title = {Image and video based painterly animation},
    Year = {2004}}

ABSTRACT

We present techniques for transforming images and videos into painterly animations depicting different artistic styles. Our techniques rely on image and video analysis to compute appearance and motion properties. We also determine and apply motion information from different (user-specified) sources to static and moving images. These properties that encode spatio-temporal variations are then used to render (or paint) effects of selected styles to generate images and videos with a painted look. Painterly animations are generated using a mesh of brush stroke objects with dynamic spatio-temporal properties. Styles govern the behavior of these brush strokes as well as their rendering to a virtual canvas. We present methods for modifying the properties of these brush strokes according to the input images, videos, or motions. Brush stroke color, length, orientation, opacity, and motion are determined and the brush strokes are regenerated to fill the canvas as the video changes. All brush stroke properties are temporally constrained to guarantee temporally coherent non-photorealistic animations.