Synthesis and Rendering of Seamless and Non-Repetitive 4D Texture Variations for Measured Optical Material Properties

Martin Ritz, Simon Breitfelder, Pedro Santos, Arjan Kuijper, Dieter W. Fellner

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

We have lifted the one weakness of an existing fully automatic acquisition system for spatially varying optical material behavior of real object surfaces. While its expression of spatially varying material behavior with spherical dependence on incoming light as 4D texture (ABTF material model) allows flexible mapping on arbitrary 3D geometries, photo-realistic rendering and interaction in real-time, this very method of texture-like representation exposed it to common problems of texturing, striking in two levels. First, non-seamless textures create visible border artifacts. Second, even a perfectly seamless texture causes repetition artifacts due to side-by-side distribution in large numbers over the 3D surface. We solved both problems through our novel texture synthesis that generates a set of seamless texture variations randomly distributed on the surface at shading time. When compared to regular 2D textures, the inter-dimensional coherence of the 4D ABTF material model poses entirely new challenges to texture synthesis, which includes maintaining the consistency of material behavior throughout the space spanned by the spatial image domain and the angular illumination hemisphere. In addition, we tackle the increased memory consumption caused by the numerous variations through a fitting scheme specifically designed to reconstruct the most prominent effects captured in the material model.
Original languageEnglish
Title of host publicationSA '18 SIGGRAPH Asia 2018 Technical Briefs
PublisherACM SIGGRAPH
ISBN (Electronic)978-1-4503-6062-3
ISBN (Print)1450360629
DOIs
Publication statusPublished - 2018

Keywords

  • Texturing
  • Physically based simulation
  • Perception
  • Texture synthesis
  • Guiding Theme: Digitized Work
  • Guiding Theme: Visual Computing as a Service
  • Research Area: Computer graphics (CG)
  • Research Area: Computer vision (CV)
  • Research Area: (Interactive) simulation (SIM)
  • Research Area: Modeling (MOD)

Cite this

Ritz, M., Breitfelder, S., Santos, P., Kuijper, A., & Fellner, D. W. (2018). Synthesis and Rendering of Seamless and Non-Repetitive 4D Texture Variations for Measured Optical Material Properties. In SA '18 SIGGRAPH Asia 2018 Technical Briefs [32] ACM SIGGRAPH. https://doi.org/10.1145/3283254.3283284

Synthesis and Rendering of Seamless and Non-Repetitive 4D Texture Variations for Measured Optical Material Properties. / Ritz, Martin ; Breitfelder, Simon ; Santos, Pedro ; Kuijper, Arjan ; Fellner, Dieter W.

SA '18 SIGGRAPH Asia 2018 Technical Briefs . ACM SIGGRAPH, 2018. 32.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Ritz, M, Breitfelder, S, Santos, P, Kuijper, A & Fellner, DW 2018, Synthesis and Rendering of Seamless and Non-Repetitive 4D Texture Variations for Measured Optical Material Properties. in SA '18 SIGGRAPH Asia 2018 Technical Briefs ., 32, ACM SIGGRAPH. https://doi.org/10.1145/3283254.3283284
Ritz M, Breitfelder S, Santos P, Kuijper A, Fellner DW. Synthesis and Rendering of Seamless and Non-Repetitive 4D Texture Variations for Measured Optical Material Properties. In SA '18 SIGGRAPH Asia 2018 Technical Briefs . ACM SIGGRAPH. 2018. 32 https://doi.org/10.1145/3283254.3283284
Ritz, Martin ; Breitfelder, Simon ; Santos, Pedro ; Kuijper, Arjan ; Fellner, Dieter W. / Synthesis and Rendering of Seamless and Non-Repetitive 4D Texture Variations for Measured Optical Material Properties. SA '18 SIGGRAPH Asia 2018 Technical Briefs . ACM SIGGRAPH, 2018.
@inproceedings{a804eb675a564d6eb60da19da5a7d333,
title = "Synthesis and Rendering of Seamless and Non-Repetitive 4D Texture Variations for Measured Optical Material Properties",
abstract = "We have lifted the one weakness of an existing fully automatic acquisition system for spatially varying optical material behavior of real object surfaces. While its expression of spatially varying material behavior with spherical dependence on incoming light as 4D texture (ABTF material model) allows flexible mapping on arbitrary 3D geometries, photo-realistic rendering and interaction in real-time, this very method of texture-like representation exposed it to common problems of texturing, striking in two levels. First, non-seamless textures create visible border artifacts. Second, even a perfectly seamless texture causes repetition artifacts due to side-by-side distribution in large numbers over the 3D surface. We solved both problems through our novel texture synthesis that generates a set of seamless texture variations randomly distributed on the surface at shading time. When compared to regular 2D textures, the inter-dimensional coherence of the 4D ABTF material model poses entirely new challenges to texture synthesis, which includes maintaining the consistency of material behavior throughout the space spanned by the spatial image domain and the angular illumination hemisphere. In addition, we tackle the increased memory consumption caused by the numerous variations through a fitting scheme specifically designed to reconstruct the most prominent effects captured in the material model.",
keywords = "Texturing, Physically based simulation, Perception, Texture synthesis, Guiding Theme: Digitized Work, Guiding Theme: Visual Computing as a Service, Research Area: Computer graphics (CG), Research Area: Computer vision (CV), Research Area: (Interactive) simulation (SIM), Research Area: Modeling (MOD)",
author = "Martin Ritz and Simon Breitfelder and Pedro Santos and Arjan Kuijper and Fellner, {Dieter W.}",
year = "2018",
doi = "10.1145/3283254.3283284",
language = "English",
isbn = "1450360629",
booktitle = "SA '18 SIGGRAPH Asia 2018 Technical Briefs",
publisher = "ACM SIGGRAPH",

}

TY - GEN

T1 - Synthesis and Rendering of Seamless and Non-Repetitive 4D Texture Variations for Measured Optical Material Properties

AU - Ritz, Martin

AU - Breitfelder, Simon

AU - Santos, Pedro

AU - Kuijper, Arjan

AU - Fellner, Dieter W.

PY - 2018

Y1 - 2018

N2 - We have lifted the one weakness of an existing fully automatic acquisition system for spatially varying optical material behavior of real object surfaces. While its expression of spatially varying material behavior with spherical dependence on incoming light as 4D texture (ABTF material model) allows flexible mapping on arbitrary 3D geometries, photo-realistic rendering and interaction in real-time, this very method of texture-like representation exposed it to common problems of texturing, striking in two levels. First, non-seamless textures create visible border artifacts. Second, even a perfectly seamless texture causes repetition artifacts due to side-by-side distribution in large numbers over the 3D surface. We solved both problems through our novel texture synthesis that generates a set of seamless texture variations randomly distributed on the surface at shading time. When compared to regular 2D textures, the inter-dimensional coherence of the 4D ABTF material model poses entirely new challenges to texture synthesis, which includes maintaining the consistency of material behavior throughout the space spanned by the spatial image domain and the angular illumination hemisphere. In addition, we tackle the increased memory consumption caused by the numerous variations through a fitting scheme specifically designed to reconstruct the most prominent effects captured in the material model.

AB - We have lifted the one weakness of an existing fully automatic acquisition system for spatially varying optical material behavior of real object surfaces. While its expression of spatially varying material behavior with spherical dependence on incoming light as 4D texture (ABTF material model) allows flexible mapping on arbitrary 3D geometries, photo-realistic rendering and interaction in real-time, this very method of texture-like representation exposed it to common problems of texturing, striking in two levels. First, non-seamless textures create visible border artifacts. Second, even a perfectly seamless texture causes repetition artifacts due to side-by-side distribution in large numbers over the 3D surface. We solved both problems through our novel texture synthesis that generates a set of seamless texture variations randomly distributed on the surface at shading time. When compared to regular 2D textures, the inter-dimensional coherence of the 4D ABTF material model poses entirely new challenges to texture synthesis, which includes maintaining the consistency of material behavior throughout the space spanned by the spatial image domain and the angular illumination hemisphere. In addition, we tackle the increased memory consumption caused by the numerous variations through a fitting scheme specifically designed to reconstruct the most prominent effects captured in the material model.

KW - Texturing

KW - Physically based simulation

KW - Perception

KW - Texture synthesis

KW - Guiding Theme: Digitized Work

KW - Guiding Theme: Visual Computing as a Service

KW - Research Area: Computer graphics (CG)

KW - Research Area: Computer vision (CV)

KW - Research Area: (Interactive) simulation (SIM)

KW - Research Area: Modeling (MOD)

U2 - 10.1145/3283254.3283284

DO - 10.1145/3283254.3283284

M3 - Conference contribution

SN - 1450360629

BT - SA '18 SIGGRAPH Asia 2018 Technical Briefs

PB - ACM SIGGRAPH

ER -