A 3D Time-of-Flight Mixed-Criticality System for Environment Perception

Josef Steinbäck, Allan Tengg, Gerald Holweg, Norbert Druml

Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandForschungBegutachtung

Abstract

Automated driving systems have to operate at the highest level of robustness and safety. Thus, redundancy and diversity of the deployed systems are inevitable in order to guarantee the functionality in any possible scenario. Today, the most used sensor technologies for environment perception are color cameras, radar, light detection and ranging (LIDAR), and ultrasonic sensors. This work evaluates the feasibility of a 3D Time-of-Flight (ToF) camera to be used as environmental perception sensor in robotics and automated/assisted driving. To examine the performance of the sensor in the field, a ToF processing platform is attached to a 1:5 scaled remote control vehicle. An algorithm, which detects and reacts to obstacles in real-time, is designed and implemented on an AURIX automotive safety-microcontroller as major part of a mixed-criticality application. The embedded system highly benefits from the low computational effort required by ToF imaging (in contrast to stereo vision). Utilizing all three cores of the AURIX, the system achieves frame-rates of up to 30 frames per second (FPS).

Originalspracheenglisch
TitelProceedings - 20th Euromicro Conference on Digital System Design, DSD 2017
Herausgeber (Verlag)Institute of Electrical and Electronics Engineers
Seiten368-374
Seitenumfang7
ISBN (elektronisch)978-1-5386-2146-2
DOIs
PublikationsstatusVeröffentlicht - 25 Sep 2017
Veranstaltung20th Euromicro Conference on Digital System Design, DSD 2017 - Vienna, Österreich
Dauer: 30 Aug 20171 Sep 2017

Konferenz

Konferenz20th Euromicro Conference on Digital System Design, DSD 2017
LandÖsterreich
OrtVienna
Zeitraum30/08/171/09/17

Fingerprint

Sensors
Cameras
Ultrasonic sensors
Stereo vision
Microcontrollers
Remote control
Embedded systems
Redundancy
Robotics
Radar
Color
Imaging techniques
Processing

Schlagwörter

    ASJC Scopus subject areas

    • !!Computer Science Applications
    • !!Control and Systems Engineering
    • !!Hardware and Architecture

    Dies zitieren

    Steinbäck, J., Tengg, A., Holweg, G., & Druml, N. (2017). A 3D Time-of-Flight Mixed-Criticality System for Environment Perception. in Proceedings - 20th Euromicro Conference on Digital System Design, DSD 2017 (S. 368-374). [8049812] Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/DSD.2017.59

    A 3D Time-of-Flight Mixed-Criticality System for Environment Perception. / Steinbäck, Josef; Tengg, Allan; Holweg, Gerald; Druml, Norbert.

    Proceedings - 20th Euromicro Conference on Digital System Design, DSD 2017. Institute of Electrical and Electronics Engineers, 2017. S. 368-374 8049812.

    Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandForschungBegutachtung

    Steinbäck, J, Tengg, A, Holweg, G & Druml, N 2017, A 3D Time-of-Flight Mixed-Criticality System for Environment Perception. in Proceedings - 20th Euromicro Conference on Digital System Design, DSD 2017., 8049812, Institute of Electrical and Electronics Engineers, S. 368-374, Vienna, Österreich, 30/08/17. https://doi.org/10.1109/DSD.2017.59
    Steinbäck J, Tengg A, Holweg G, Druml N. A 3D Time-of-Flight Mixed-Criticality System for Environment Perception. in Proceedings - 20th Euromicro Conference on Digital System Design, DSD 2017. Institute of Electrical and Electronics Engineers. 2017. S. 368-374. 8049812 https://doi.org/10.1109/DSD.2017.59
    Steinbäck, Josef ; Tengg, Allan ; Holweg, Gerald ; Druml, Norbert. / A 3D Time-of-Flight Mixed-Criticality System for Environment Perception. Proceedings - 20th Euromicro Conference on Digital System Design, DSD 2017. Institute of Electrical and Electronics Engineers, 2017. S. 368-374
    @inproceedings{7daecc620a044a929f38457019cb3fc7,
    title = "A 3D Time-of-Flight Mixed-Criticality System for Environment Perception",
    abstract = "Automated driving systems have to operate at the highest level of robustness and safety. Thus, redundancy and diversity of the deployed systems are inevitable in order to guarantee the functionality in any possible scenario. Today, the most used sensor technologies for environment perception are color cameras, radar, light detection and ranging (LIDAR), and ultrasonic sensors. This work evaluates the feasibility of a 3D Time-of-Flight (ToF) camera to be used as environmental perception sensor in robotics and automated/assisted driving. To examine the performance of the sensor in the field, a ToF processing platform is attached to a 1:5 scaled remote control vehicle. An algorithm, which detects and reacts to obstacles in real-time, is designed and implemented on an AURIX automotive safety-microcontroller as major part of a mixed-criticality application. The embedded system highly benefits from the low computational effort required by ToF imaging (in contrast to stereo vision). Utilizing all three cores of the AURIX, the system achieves frame-rates of up to 30 frames per second (FPS).",
    keywords = "3D imaging, accident prevention, infrared image sensors, robotics, Time-of-Flight, unmanned vehicles",
    author = "Josef Steinb{\"a}ck and Allan Tengg and Gerald Holweg and Norbert Druml",
    year = "2017",
    month = "9",
    day = "25",
    doi = "10.1109/DSD.2017.59",
    language = "English",
    pages = "368--374",
    booktitle = "Proceedings - 20th Euromicro Conference on Digital System Design, DSD 2017",
    publisher = "Institute of Electrical and Electronics Engineers",
    address = "United States",

    }

    TY - GEN

    T1 - A 3D Time-of-Flight Mixed-Criticality System for Environment Perception

    AU - Steinbäck, Josef

    AU - Tengg, Allan

    AU - Holweg, Gerald

    AU - Druml, Norbert

    PY - 2017/9/25

    Y1 - 2017/9/25

    N2 - Automated driving systems have to operate at the highest level of robustness and safety. Thus, redundancy and diversity of the deployed systems are inevitable in order to guarantee the functionality in any possible scenario. Today, the most used sensor technologies for environment perception are color cameras, radar, light detection and ranging (LIDAR), and ultrasonic sensors. This work evaluates the feasibility of a 3D Time-of-Flight (ToF) camera to be used as environmental perception sensor in robotics and automated/assisted driving. To examine the performance of the sensor in the field, a ToF processing platform is attached to a 1:5 scaled remote control vehicle. An algorithm, which detects and reacts to obstacles in real-time, is designed and implemented on an AURIX automotive safety-microcontroller as major part of a mixed-criticality application. The embedded system highly benefits from the low computational effort required by ToF imaging (in contrast to stereo vision). Utilizing all three cores of the AURIX, the system achieves frame-rates of up to 30 frames per second (FPS).

    AB - Automated driving systems have to operate at the highest level of robustness and safety. Thus, redundancy and diversity of the deployed systems are inevitable in order to guarantee the functionality in any possible scenario. Today, the most used sensor technologies for environment perception are color cameras, radar, light detection and ranging (LIDAR), and ultrasonic sensors. This work evaluates the feasibility of a 3D Time-of-Flight (ToF) camera to be used as environmental perception sensor in robotics and automated/assisted driving. To examine the performance of the sensor in the field, a ToF processing platform is attached to a 1:5 scaled remote control vehicle. An algorithm, which detects and reacts to obstacles in real-time, is designed and implemented on an AURIX automotive safety-microcontroller as major part of a mixed-criticality application. The embedded system highly benefits from the low computational effort required by ToF imaging (in contrast to stereo vision). Utilizing all three cores of the AURIX, the system achieves frame-rates of up to 30 frames per second (FPS).

    KW - 3D imaging

    KW - accident prevention

    KW - infrared image sensors

    KW - robotics

    KW - Time-of-Flight

    KW - unmanned vehicles

    UR - http://www.scopus.com/inward/record.url?scp=85034441512&partnerID=8YFLogxK

    U2 - 10.1109/DSD.2017.59

    DO - 10.1109/DSD.2017.59

    M3 - Conference contribution

    SP - 368

    EP - 374

    BT - Proceedings - 20th Euromicro Conference on Digital System Design, DSD 2017

    PB - Institute of Electrical and Electronics Engineers

    ER -