Seamless and non-repetitive 4D texture variation synthesis and real-time rendering for measured optical material behavior

Martin Ritz, Simon Breitfelder, Pedro Santos, Arjan Kuijper, Dieter W. Fellner

Research output: Contribution to journalArticleResearchpeer-review

Abstract

We show how to overcome the single weakness of an existing fully automatic system for acquisition of spatially varying optical material behavior of real object surfaces. While the expression of spatially varying material behavior with spherical dependence on incoming light as a 4D texture (an ABTF material model) allows flexible mapping onto arbitrary 3D geometry, with photo-realistic rendering and interaction in real time, this very method of texture-like representation exposes it to common problems of texturing, striking in two disadvantages. Firstly, non-seamless textures create visible artifacts at boundaries. Secondly, even a perfectly seamless texture causes repetition artifacts due to their organised placement in large numbers over a 3D surface. We have solved both problems through our novel texture synthesis method that generates a set of seamless texture variations randomly distributed over the surface at shading time. When compared to regular 2D textures, the inter-dimensional coherence of the 4D ABTF material model poses entirely new challenges to texture synthesis, which includes maintaining the consistency of material behavior throughout the 4D space spanned by the spatial image domain and the angular illumination hemisphere. In addition, we tackle the increased memory consumption caused by the numerous variations through a fitting scheme specifically designed to reconstruct the most prominent effects captured in the material model.

LanguageEnglish
Pages161-170
Number of pages10
JournalComputational Visual Media
Volume5
Issue number2
DOIs
StatusPublished - 1 Jun 2019

Fingerprint

Optical materials
Textures
Texturing
Lighting
Data storage equipment
Geometry

Keywords

  • 4D texture synthesis
  • optical material behavior
  • reflectance modeling
  • texturing

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design
  • Artificial Intelligence

Fields of Expertise

  • Information, Communication & Computing

Cite this

Seamless and non-repetitive 4D texture variation synthesis and real-time rendering for measured optical material behavior. / Ritz, Martin; Breitfelder, Simon; Santos, Pedro; Kuijper, Arjan; Fellner, Dieter W.

In: Computational Visual Media, Vol. 5, No. 2, 01.06.2019, p. 161-170.

Research output: Contribution to journalArticleResearchpeer-review

@article{bfe5bab6eb8d446dbfaa6aa2dff67401,
title = "Seamless and non-repetitive 4D texture variation synthesis and real-time rendering for measured optical material behavior",
abstract = "We show how to overcome the single weakness of an existing fully automatic system for acquisition of spatially varying optical material behavior of real object surfaces. While the expression of spatially varying material behavior with spherical dependence on incoming light as a 4D texture (an ABTF material model) allows flexible mapping onto arbitrary 3D geometry, with photo-realistic rendering and interaction in real time, this very method of texture-like representation exposes it to common problems of texturing, striking in two disadvantages. Firstly, non-seamless textures create visible artifacts at boundaries. Secondly, even a perfectly seamless texture causes repetition artifacts due to their organised placement in large numbers over a 3D surface. We have solved both problems through our novel texture synthesis method that generates a set of seamless texture variations randomly distributed over the surface at shading time. When compared to regular 2D textures, the inter-dimensional coherence of the 4D ABTF material model poses entirely new challenges to texture synthesis, which includes maintaining the consistency of material behavior throughout the 4D space spanned by the spatial image domain and the angular illumination hemisphere. In addition, we tackle the increased memory consumption caused by the numerous variations through a fitting scheme specifically designed to reconstruct the most prominent effects captured in the material model.",
keywords = "4D texture synthesis, optical material behavior, reflectance modeling, texturing",
author = "Martin Ritz and Simon Breitfelder and Pedro Santos and Arjan Kuijper and Fellner, {Dieter W.}",
year = "2019",
month = "6",
day = "1",
doi = "10.1007/s41095-019-0141-4",
language = "English",
volume = "5",
pages = "161--170",
journal = "Computational Visual Media",
issn = "2096-0433",
publisher = "SpringerOpen",
number = "2",

}

TY - JOUR

T1 - Seamless and non-repetitive 4D texture variation synthesis and real-time rendering for measured optical material behavior

AU - Ritz, Martin

AU - Breitfelder, Simon

AU - Santos, Pedro

AU - Kuijper, Arjan

AU - Fellner, Dieter W.

PY - 2019/6/1

Y1 - 2019/6/1

N2 - We show how to overcome the single weakness of an existing fully automatic system for acquisition of spatially varying optical material behavior of real object surfaces. While the expression of spatially varying material behavior with spherical dependence on incoming light as a 4D texture (an ABTF material model) allows flexible mapping onto arbitrary 3D geometry, with photo-realistic rendering and interaction in real time, this very method of texture-like representation exposes it to common problems of texturing, striking in two disadvantages. Firstly, non-seamless textures create visible artifacts at boundaries. Secondly, even a perfectly seamless texture causes repetition artifacts due to their organised placement in large numbers over a 3D surface. We have solved both problems through our novel texture synthesis method that generates a set of seamless texture variations randomly distributed over the surface at shading time. When compared to regular 2D textures, the inter-dimensional coherence of the 4D ABTF material model poses entirely new challenges to texture synthesis, which includes maintaining the consistency of material behavior throughout the 4D space spanned by the spatial image domain and the angular illumination hemisphere. In addition, we tackle the increased memory consumption caused by the numerous variations through a fitting scheme specifically designed to reconstruct the most prominent effects captured in the material model.

AB - We show how to overcome the single weakness of an existing fully automatic system for acquisition of spatially varying optical material behavior of real object surfaces. While the expression of spatially varying material behavior with spherical dependence on incoming light as a 4D texture (an ABTF material model) allows flexible mapping onto arbitrary 3D geometry, with photo-realistic rendering and interaction in real time, this very method of texture-like representation exposes it to common problems of texturing, striking in two disadvantages. Firstly, non-seamless textures create visible artifacts at boundaries. Secondly, even a perfectly seamless texture causes repetition artifacts due to their organised placement in large numbers over a 3D surface. We have solved both problems through our novel texture synthesis method that generates a set of seamless texture variations randomly distributed over the surface at shading time. When compared to regular 2D textures, the inter-dimensional coherence of the 4D ABTF material model poses entirely new challenges to texture synthesis, which includes maintaining the consistency of material behavior throughout the 4D space spanned by the spatial image domain and the angular illumination hemisphere. In addition, we tackle the increased memory consumption caused by the numerous variations through a fitting scheme specifically designed to reconstruct the most prominent effects captured in the material model.

KW - 4D texture synthesis

KW - optical material behavior

KW - reflectance modeling

KW - texturing

UR - http://www.scopus.com/inward/record.url?scp=85068082714&partnerID=8YFLogxK

U2 - 10.1007/s41095-019-0141-4

DO - 10.1007/s41095-019-0141-4

M3 - Article

VL - 5

SP - 161

EP - 170

JO - Computational Visual Media

T2 - Computational Visual Media

JF - Computational Visual Media

SN - 2096-0433

IS - 2

ER -