Nature at Your Service-Nature Inspired Representations Combined with Eye-gaze Features to Infer User Attention and Provide Contextualized Support

Carla Souta Barreiros*, N. Silva, Viktoria Pammer-Schindler, Eduardo Enrique Veas

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review


Internet of Things (IoT) enables the creation of sensing and computing machines to enhance the level of continuous adaptation and support provided by intelligent systems to humans. Nevertheless, these systems still depend on human intervention, for example, in maintenance and (re)configuration tasks. To this measure, the development of an Adaptive Instructional System (AIS) in the context of IoT allows for the creation of new, improved learning and training environments. One can test new approaches to improve the training and perception efficiency of humans. Examples are the use of virtual and augmented reality, the inclusion of nature inspired metaphors based on biophilic design and calm computing principles and the design of technology that aims at changing the users’ behaviour through persuasion and social influence. In this work, we specifically propose a nature inspired visual representation concept, BioIoT, to communicate sensor information. Our results show that this new representation contributes to the users’ well-being and performance while remaining as easy to understand as traditional data representations (based on an experiment with twelve participants over two weeks). We present a use case under which we apply the BioIoT concept. It serves the purpose of demonstrating the BioIoT benefits in a AR setting, when applied in households and workplaces scenarios. Furthermore, by leveraging our previous experience in the development of adaptive and supportive systems based on eye-tracking, we discuss the application of this new sensing technology to the support of users in machine intervention by using the user attention, i.e., eye-gaze, on different machine parts as a way to infer the user’s needs and adapt the system accordingly. In this way, a new level of continuous support can be provided to the users depending on their skill level and individual needs in the form of contextualized instructions and action recommendations based on user attention.
Original languageEnglish
Title of host publicationAdaptive Instructional Systems - 2nd International Conference, AIS 2020, Held as Part of the 22nd HCI International Conference, HCII 2020, Proceedings
EditorsRobert A. Sottilare, Jessica Schwarz
Number of pages13
ISBN (Print)9783030507879
Publication statusE-pub ahead of print - 10 Jul 2020
Event2nd International Conference on Adaptive Instructional Systems: AIS 2020 - Virtuell, Denmark
Duration: 19 Jul 202024 Jul 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12214 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference2nd International Conference on Adaptive Instructional Systems
Other held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020


  • IoT
  • Augmented Reality
  • Eye-Tracking
  • Recommendation
  • Support
  • Eye-tracking
  • Attention
  • BioIoT
  • Augmented reality

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)


Dive into the research topics of 'Nature at Your Service-Nature Inspired Representations Combined with Eye-gaze Features to Infer User Attention and Provide Contextualized Support'. Together they form a unique fingerprint.

Cite this