Seamless and non-repetitive 4D texture variation synthesis and real-time rendering for measured optical material behavior

Martin Ritz, Simon Breitfelder, Pedro Santos, Arjan Kuijper, Dieter W. Fellner

Publikation: Beitrag in einer FachzeitschriftArtikelForschungBegutachtung

Abstract

We show how to overcome the single weakness of an existing fully automatic system for acquisition of spatially varying optical material behavior of real object surfaces. While the expression of spatially varying material behavior with spherical dependence on incoming light as a 4D texture (an ABTF material model) allows flexible mapping onto arbitrary 3D geometry, with photo-realistic rendering and interaction in real time, this very method of texture-like representation exposes it to common problems of texturing, striking in two disadvantages. Firstly, non-seamless textures create visible artifacts at boundaries. Secondly, even a perfectly seamless texture causes repetition artifacts due to their organised placement in large numbers over a 3D surface. We have solved both problems through our novel texture synthesis method that generates a set of seamless texture variations randomly distributed over the surface at shading time. When compared to regular 2D textures, the inter-dimensional coherence of the 4D ABTF material model poses entirely new challenges to texture synthesis, which includes maintaining the consistency of material behavior throughout the 4D space spanned by the spatial image domain and the angular illumination hemisphere. In addition, we tackle the increased memory consumption caused by the numerous variations through a fitting scheme specifically designed to reconstruct the most prominent effects captured in the material model.

Originalspracheenglisch
Seiten (von - bis)161-170
Seitenumfang10
FachzeitschriftComputational Visual Media
Jahrgang5
Ausgabenummer2
DOIs
PublikationsstatusVeröffentlicht - 1 Jun 2019

Fingerprint

Optical materials
Textures
Texturing
Lighting
Data storage equipment
Geometry

Schlagwörter

    ASJC Scopus subject areas

    • !!Computer Vision and Pattern Recognition
    • !!Computer Graphics and Computer-Aided Design
    • Artificial intelligence

    Fields of Expertise

    • Information, Communication & Computing

    Dies zitieren

    Seamless and non-repetitive 4D texture variation synthesis and real-time rendering for measured optical material behavior. / Ritz, Martin; Breitfelder, Simon; Santos, Pedro; Kuijper, Arjan; Fellner, Dieter W.

    in: Computational Visual Media, Jahrgang 5, Nr. 2, 01.06.2019, S. 161-170.

    Publikation: Beitrag in einer FachzeitschriftArtikelForschungBegutachtung

    Ritz, Martin ; Breitfelder, Simon ; Santos, Pedro ; Kuijper, Arjan ; Fellner, Dieter W. / Seamless and non-repetitive 4D texture variation synthesis and real-time rendering for measured optical material behavior. in: Computational Visual Media. 2019 ; Jahrgang 5, Nr. 2. S. 161-170.
    @article{bfe5bab6eb8d446dbfaa6aa2dff67401,
    title = "Seamless and non-repetitive 4D texture variation synthesis and real-time rendering for measured optical material behavior",
    abstract = "We show how to overcome the single weakness of an existing fully automatic system for acquisition of spatially varying optical material behavior of real object surfaces. While the expression of spatially varying material behavior with spherical dependence on incoming light as a 4D texture (an ABTF material model) allows flexible mapping onto arbitrary 3D geometry, with photo-realistic rendering and interaction in real time, this very method of texture-like representation exposes it to common problems of texturing, striking in two disadvantages. Firstly, non-seamless textures create visible artifacts at boundaries. Secondly, even a perfectly seamless texture causes repetition artifacts due to their organised placement in large numbers over a 3D surface. We have solved both problems through our novel texture synthesis method that generates a set of seamless texture variations randomly distributed over the surface at shading time. When compared to regular 2D textures, the inter-dimensional coherence of the 4D ABTF material model poses entirely new challenges to texture synthesis, which includes maintaining the consistency of material behavior throughout the 4D space spanned by the spatial image domain and the angular illumination hemisphere. In addition, we tackle the increased memory consumption caused by the numerous variations through a fitting scheme specifically designed to reconstruct the most prominent effects captured in the material model.",
    keywords = "4D texture synthesis, optical material behavior, reflectance modeling, texturing",
    author = "Martin Ritz and Simon Breitfelder and Pedro Santos and Arjan Kuijper and Fellner, {Dieter W.}",
    year = "2019",
    month = "6",
    day = "1",
    doi = "10.1007/s41095-019-0141-4",
    language = "English",
    volume = "5",
    pages = "161--170",
    journal = "Computational Visual Media",
    issn = "2096-0433",
    publisher = "SpringerOpen",
    number = "2",

    }

    TY - JOUR

    T1 - Seamless and non-repetitive 4D texture variation synthesis and real-time rendering for measured optical material behavior

    AU - Ritz, Martin

    AU - Breitfelder, Simon

    AU - Santos, Pedro

    AU - Kuijper, Arjan

    AU - Fellner, Dieter W.

    PY - 2019/6/1

    Y1 - 2019/6/1

    N2 - We show how to overcome the single weakness of an existing fully automatic system for acquisition of spatially varying optical material behavior of real object surfaces. While the expression of spatially varying material behavior with spherical dependence on incoming light as a 4D texture (an ABTF material model) allows flexible mapping onto arbitrary 3D geometry, with photo-realistic rendering and interaction in real time, this very method of texture-like representation exposes it to common problems of texturing, striking in two disadvantages. Firstly, non-seamless textures create visible artifacts at boundaries. Secondly, even a perfectly seamless texture causes repetition artifacts due to their organised placement in large numbers over a 3D surface. We have solved both problems through our novel texture synthesis method that generates a set of seamless texture variations randomly distributed over the surface at shading time. When compared to regular 2D textures, the inter-dimensional coherence of the 4D ABTF material model poses entirely new challenges to texture synthesis, which includes maintaining the consistency of material behavior throughout the 4D space spanned by the spatial image domain and the angular illumination hemisphere. In addition, we tackle the increased memory consumption caused by the numerous variations through a fitting scheme specifically designed to reconstruct the most prominent effects captured in the material model.

    AB - We show how to overcome the single weakness of an existing fully automatic system for acquisition of spatially varying optical material behavior of real object surfaces. While the expression of spatially varying material behavior with spherical dependence on incoming light as a 4D texture (an ABTF material model) allows flexible mapping onto arbitrary 3D geometry, with photo-realistic rendering and interaction in real time, this very method of texture-like representation exposes it to common problems of texturing, striking in two disadvantages. Firstly, non-seamless textures create visible artifacts at boundaries. Secondly, even a perfectly seamless texture causes repetition artifacts due to their organised placement in large numbers over a 3D surface. We have solved both problems through our novel texture synthesis method that generates a set of seamless texture variations randomly distributed over the surface at shading time. When compared to regular 2D textures, the inter-dimensional coherence of the 4D ABTF material model poses entirely new challenges to texture synthesis, which includes maintaining the consistency of material behavior throughout the 4D space spanned by the spatial image domain and the angular illumination hemisphere. In addition, we tackle the increased memory consumption caused by the numerous variations through a fitting scheme specifically designed to reconstruct the most prominent effects captured in the material model.

    KW - 4D texture synthesis

    KW - optical material behavior

    KW - reflectance modeling

    KW - texturing

    UR - http://www.scopus.com/inward/record.url?scp=85068082714&partnerID=8YFLogxK

    U2 - 10.1007/s41095-019-0141-4

    DO - 10.1007/s41095-019-0141-4

    M3 - Article

    VL - 5

    SP - 161

    EP - 170

    JO - Computational Visual Media

    JF - Computational Visual Media

    SN - 2096-0433

    IS - 2

    ER -