Impact of Image Sensor Output Data on Power Consumption of the Image Processing System

Gernot Fiala; Johannes Loining; Christian Steger

doi:10.1007/978-3-031-16072-1_45

Impact of Image Sensor Output Data on Power Consumption of the Image Processing System

Titel in Übersetzung: Einfluss von Bildsensordaten auf die Leistungsaufnahme des Bildverarbeitungssystems

Gernot Fiala^*, Johannes Loining, Christian Steger

^*Korrespondierende/r Autor/-in für diese Arbeit

Institut für Technische Informatik (4480)

Publikation: Beitrag in Buch/Bericht/Konferenzband › Beitrag in einem Konferenzband › Begutachtung

Abstract

Nowadays, image sensors are widely used for industrial or augmented and virtual reality (AR)/(VR) applications. Often, multiple sensors are used and the host platform needs to process each high resolution image frame with low latency. Therefore, the processing units and the communication have a big impact on the power consumption of the image processing system. This paper describes a method to simulate a smart image sensor and the impact of different output resolutions on the image processing system. In-sensor processing is simulated, by sending different image resolutions to the host platform, where a shape matching algorithm was processed. It shows an analysis of the power consumption of the communication from the sensor with region-of-interest (ROI) data to the host and the energy consumption of the whole image processing system with a Mira220 and an Nvidia Jetson Nano. The power consumption of the MIPI interface can be reduced by over 83% for ROIs smaller than 640×480. Furthermore, the system energy consumption can be reduces by 18% at 90 fps and 21% at 60 fps.

Titel in Übersetzung	Einfluss von Bildsensordaten auf die Leistungsaufnahme des Bildverarbeitungssystems
Originalsprache	englisch
Titel	Intelligent Systems and Applications - IntelliSys 2022
Untertitel	Proceedings of the 2022 Intelligent Systems Conference (IntelliSys)
Redakteure/-innen	Kohei Arai
Herausgeber (Verlag)	Springer Nature Switzerland AG
Seiten	618 - 636
Band	1
ISBN (elektronisch)	978-3-031-16072-1
ISBN (Print)	978-3-031-16071-4
DOIs	https://doi.org/10.1007/978-3-031-16072-1_45
Publikationsstatus	Veröffentlicht - 2022
Veranstaltung	Intelligent Systems Conference 2022: IntelliSys 2022 - Park Plaza Amsterdam Airport, Amsterdam, Niederlande Dauer: 1 Sept. 2022 → 2 Sept. 2022 Konferenznummer: IntelliSys2022 https://saiconference.com/Conferences/IntelliSys2022

Publikationsreihe

Name	Lecture Notes in Networks and Systems
Herausgeber (Verlag)	Springer Cham
Nummer	1
Band	542
ISSN (Print)	2367-3370
ISSN (elektronisch)	2367-3389

Konferenz

Konferenz	Intelligent Systems Conference 2022
Kurztitel	IntelliSys 2022
Land/Gebiet	Niederlande
Ort	Amsterdam
Zeitraum	1/09/22 → 2/09/22
Internetadresse	https://saiconference.com/Conferences/IntelliSys2022

Schlagwörter

smart image sensor
power
energy
communication bandwidth
region-of-interest
Nvidia Jetson Nano
Mira220

ASJC Scopus subject areas

Informatik (insg.)
Signalverarbeitung
Steuerungs- und Systemtechnik
Computernetzwerke und -kommunikation

UN SDGs

Dieser Output leistet einen Beitrag zu folgendem(n) Ziel(en) für nachhaltige Entwicklung

Zugriff auf Dokument

10.1007/978-3-031-16072-1_45Lizenz: Nicht definiert

https://doi.org/10.1007/978-3-031-16072-1_45Lizenz: Nicht definiert

Andere Dateien und Links

1 Konferenz oder Fachtagung (Teilnahme an/Organisation von)
1 Vortrag bei Konferenz oder Fachtagung

Intelligent Systems Conference 2022
Gernot Fiala (Teilnehmer/-in)
1 Sept. 2022 → 2 Sept. 2022
Aktivität: Teilnahme an / Organisation von › Konferenz oder Fachtagung (Teilnahme an/Organisation von)
Impact of Image Sensor Output Data on Power Consumption of the Image Processing System
Gernot Fiala (Redner/in)
1 Sept. 2022 → 2 Sept. 2022
Aktivität: Vortrag oder Präsentation › Vortrag bei Konferenz oder Fachtagung › Science to science

Dieses zitieren

Fiala, G., Loining, J., & Steger, C. (2022). Impact of Image Sensor Output Data on Power Consumption of the Image Processing System. in K. Arai (Hrsg.), Intelligent Systems and Applications - IntelliSys 2022: Proceedings of the 2022 Intelligent Systems Conference (IntelliSys) (Band 1, S. 618 - 636). Artikel 16072 (Lecture Notes in Networks and Systems; Band 542, Nr. 1). Springer Nature Switzerland AG. https://doi.org/10.1007/978-3-031-16072-1_45

Impact of Image Sensor Output Data on Power Consumption of the Image Processing System. / Fiala, Gernot; Loining, Johannes; Steger, Christian.
Intelligent Systems and Applications - IntelliSys 2022: Proceedings of the 2022 Intelligent Systems Conference (IntelliSys). Hrsg. / Kohei Arai. Band 1 Springer Nature Switzerland AG, 2022. S. 618 - 636 16072 (Lecture Notes in Networks and Systems; Band 542, Nr. 1).

Publikation: Beitrag in Buch/Bericht/Konferenzband › Beitrag in einem Konferenzband › Begutachtung

Fiala, G, Loining, J & Steger, C 2022, Impact of Image Sensor Output Data on Power Consumption of the Image Processing System. in K Arai (Hrsg.), Intelligent Systems and Applications - IntelliSys 2022: Proceedings of the 2022 Intelligent Systems Conference (IntelliSys). Bd. 1, 16072, Lecture Notes in Networks and Systems, Nr. 1, Bd. 542, Springer Nature Switzerland AG, S. 618 - 636, Intelligent Systems Conference 2022, Amsterdam, Niederlande, 1/09/22. https://doi.org/10.1007/978-3-031-16072-1_45

Fiala G, Loining J, Steger C. Impact of Image Sensor Output Data on Power Consumption of the Image Processing System. in Arai K, Hrsg., Intelligent Systems and Applications - IntelliSys 2022: Proceedings of the 2022 Intelligent Systems Conference (IntelliSys). Band 1. Springer Nature Switzerland AG. 2022. S. 618 - 636. 16072. (Lecture Notes in Networks and Systems; 1). doi: 10.1007/978-3-031-16072-1_45

Fiala, Gernot ; Loining, Johannes ; Steger, Christian. / Impact of Image Sensor Output Data on Power Consumption of the Image Processing System. Intelligent Systems and Applications - IntelliSys 2022: Proceedings of the 2022 Intelligent Systems Conference (IntelliSys). Hrsg. / Kohei Arai. Band 1 Springer Nature Switzerland AG, 2022. S. 618 - 636 (Lecture Notes in Networks and Systems; 1).

@inproceedings{84af5b21c1204f31ba81d105ae454dd1,

title = "Impact of Image Sensor Output Data on Power Consumption of the Image Processing System",

abstract = "Nowadays, image sensors are widely used for industrial or augmented and virtual reality (AR)/(VR) applications. Often, multiple sensors are used and the host platform needs to process each high resolution image frame with low latency. Therefore, the processing units and the communication have a big impact on the power consumption of the image processing system. This paper describes a method to simulate a smart image sensor and the impact of different output resolutions on the image processing system. In-sensor processing is simulated, by sending different image resolutions to the host platform, where a shape matching algorithm was processed. It shows an analysis of the power consumption of the communication from the sensor with region-of-interest (ROI) data to the host and the energy consumption of the whole image processing system with a Mira220 and an Nvidia Jetson Nano. The power consumption of the MIPI interface can be reduced by over 83% for ROIs smaller than 640×480. Furthermore, the system energy consumption can be reduces by 18% at 90 fps and 21% at 60 fps.",

keywords = "smart image sensor, power, energy, communication bandwidth, region-of-interest, Nvidia Jetson Nano, Mira220, Communication bandwidth, Energy, Mira220, Nvidia Jetson Nano, Power, Region-of-interest, Smart image sensor",

author = "Gernot Fiala and Johannes Loining and Christian Steger",

year = "2022",

doi = "10.1007/978-3-031-16072-1_45",

language = "English",

isbn = "978-3-031-16071-4",

volume = " 1",

series = "Lecture Notes in Networks and Systems",

publisher = "Springer Nature Switzerland AG",

number = "1",

pages = "618 -- 636",

editor = "Kohei Arai",

booktitle = "Intelligent Systems and Applications - IntelliSys 2022",

address = "Switzerland",

note = "Intelligent Systems Conference 2022 : IntelliSys 2022, IntelliSys 2022 ; Conference date: 01-09-2022 Through 02-09-2022",

url = "https://saiconference.com/Conferences/IntelliSys2022",

}

TY - GEN

T1 - Impact of Image Sensor Output Data on Power Consumption of the Image Processing System

AU - Fiala, Gernot

AU - Loining, Johannes

AU - Steger, Christian

N1 - Conference code: IntelliSys2022

PY - 2022

Y1 - 2022

N2 - Nowadays, image sensors are widely used for industrial or augmented and virtual reality (AR)/(VR) applications. Often, multiple sensors are used and the host platform needs to process each high resolution image frame with low latency. Therefore, the processing units and the communication have a big impact on the power consumption of the image processing system. This paper describes a method to simulate a smart image sensor and the impact of different output resolutions on the image processing system. In-sensor processing is simulated, by sending different image resolutions to the host platform, where a shape matching algorithm was processed. It shows an analysis of the power consumption of the communication from the sensor with region-of-interest (ROI) data to the host and the energy consumption of the whole image processing system with a Mira220 and an Nvidia Jetson Nano. The power consumption of the MIPI interface can be reduced by over 83% for ROIs smaller than 640×480. Furthermore, the system energy consumption can be reduces by 18% at 90 fps and 21% at 60 fps.

AB - Nowadays, image sensors are widely used for industrial or augmented and virtual reality (AR)/(VR) applications. Often, multiple sensors are used and the host platform needs to process each high resolution image frame with low latency. Therefore, the processing units and the communication have a big impact on the power consumption of the image processing system. This paper describes a method to simulate a smart image sensor and the impact of different output resolutions on the image processing system. In-sensor processing is simulated, by sending different image resolutions to the host platform, where a shape matching algorithm was processed. It shows an analysis of the power consumption of the communication from the sensor with region-of-interest (ROI) data to the host and the energy consumption of the whole image processing system with a Mira220 and an Nvidia Jetson Nano. The power consumption of the MIPI interface can be reduced by over 83% for ROIs smaller than 640×480. Furthermore, the system energy consumption can be reduces by 18% at 90 fps and 21% at 60 fps.

KW - smart image sensor

KW - power

KW - energy

KW - communication bandwidth

KW - region-of-interest

KW - Nvidia Jetson Nano

KW - Mira220

KW - Communication bandwidth

KW - Energy

KW - Mira220

KW - Nvidia Jetson Nano

KW - Power

KW - Region-of-interest

KW - Smart image sensor

UR - https://link.springer.com/chapter/10.1007/978-3-031-16072-1_45

UR - http://www.scopus.com/inward/record.url?scp=85137981480&partnerID=8YFLogxK

U2 - 10.1007/978-3-031-16072-1_45

DO - 10.1007/978-3-031-16072-1_45

M3 - Conference paper

SN - 978-3-031-16071-4

VL - 1

T3 - Lecture Notes in Networks and Systems

SP - 618

EP - 636

BT - Intelligent Systems and Applications - IntelliSys 2022

A2 - Arai, Kohei

PB - Springer Nature Switzerland AG

T2 - Intelligent Systems Conference 2022

Y2 - 1 September 2022 through 2 September 2022

ER -

Impact of Image Sensor Output Data on Power Consumption of the Image Processing System

Abstract

Publikationsreihe

Konferenz

Schlagwörter

ASJC Scopus subject areas

UN SDGs

Zugriff auf Dokument

Andere Dateien und Links

Aktivitäten

Intelligent Systems Conference 2022

Impact of Image Sensor Output Data on Power Consumption of the Image Processing System

Dieses zitieren