SensorFormer: Efficient Many-to-Many Sensor Calibration with Learnable Input Sub-Sampling

Yun Cheng, Olga Saukh, Lothar Thiele

Research output: Contribution to journalArticlepeer-review


Accurate calibration of low-cost environmental sensors is a prerequisite for their successful use in many monitoring applications. State-of-the-art calibration methods vary from simple linear regression to sophisticated deep models based on LSTMs and GRUs. The latter take past measurements to improve calibration accuracy. In this paper, we argue that both recent past and close future measurements help to achieve accurate calibration, whereas accuracy improvements beyond the past come with a delay introduced by the occurrence of the future. We propose a generalized calibration scheme called SensorFormer based on the successful Transformer model which takes both past and future raw measurements into account. We show that the proposed approach (1) outperforms other methods by improving calibration accuracy by 16.5 % to 20.4 % on public datasets and own field data, and (2) can efficiently run on low-power microcontrollers with very limited computational and storage capabilities. The latter is achieved by a novel optimization technique based on learnable input sub-sampling taking advantage of the properties of typical sensor data. We manage to reduce the model size by 20 % to 33 % and minimize the overall FLOPs by 65 % while maintaining superior accuracy than state-of-the-art methods.
Original languageEnglish
Number of pages12
JournalIEEE Internet of Things Journal
Publication statusE-pub ahead of print - 27 May 2022

Fields of Expertise

  • Information, Communication & Computing


Dive into the research topics of 'SensorFormer: Efficient Many-to-Many Sensor Calibration with Learnable Input Sub-Sampling'. Together they form a unique fingerprint.

Cite this