Skin Reading Meets Speech Recognition and Object Recognition for Sensory Substitution

Granit Luzhnica, Eduardo Veas

Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandForschungBegutachtung

Abstract

Sensory substitution has been a research subject for decades, and yet its applicability outside of the research is very limited. Thus creating scepticism among researchers that a full sensory substitution is not even possible [8]. In this paper, we do not substitute the entire perceptual channel. Instead, we follow a different approach which reduces the captured information drastically. We present concepts and implementation of two mobile applications which capture the user's environment, describe it in the form of text and then convey its textual description to the user through a vibrotactile wearable display. The applications target users with hearing and vision impairments.
Originalspracheenglisch
TitelProceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers
Seiten146-149
Seitenumfang4
ISBN (elektronisch)978-1-4503-5966-5
DOIs
PublikationsstatusVeröffentlicht - 2018

Fingerprint

Object recognition
Speech recognition
Skin
Substitution reactions
Audition
Display devices

Schlagwörter

    Dies zitieren

    Luzhnica, G., & Veas, E. (2018). Skin Reading Meets Speech Recognition and Object Recognition for Sensory Substitution. in Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers (S. 146-149) https://doi.org/10.1145/3267305.3267604

    Skin Reading Meets Speech Recognition and Object Recognition for Sensory Substitution. / Luzhnica, Granit; Veas, Eduardo.

    Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. 2018. S. 146-149.

    Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandForschungBegutachtung

    Luzhnica, G & Veas, E 2018, Skin Reading Meets Speech Recognition and Object Recognition for Sensory Substitution. in Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. S. 146-149. https://doi.org/10.1145/3267305.3267604
    Luzhnica G, Veas E. Skin Reading Meets Speech Recognition and Object Recognition for Sensory Substitution. in Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. 2018. S. 146-149 https://doi.org/10.1145/3267305.3267604
    Luzhnica, Granit ; Veas, Eduardo. / Skin Reading Meets Speech Recognition and Object Recognition for Sensory Substitution. Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. 2018. S. 146-149
    @inproceedings{50cfb51100df4145ace4d4628a72f3db,
    title = "Skin Reading Meets Speech Recognition and Object Recognition for Sensory Substitution",
    abstract = "Sensory substitution has been a research subject for decades, and yet its applicability outside of the research is very limited. Thus creating scepticism among researchers that a full sensory substitution is not even possible [8]. In this paper, we do not substitute the entire perceptual channel. Instead, we follow a different approach which reduces the captured information drastically. We present concepts and implementation of two mobile applications which capture the user's environment, describe it in the form of text and then convey its textual description to the user through a vibrotactile wearable display. The applications target users with hearing and vision impairments.",
    keywords = "haptic interfaces, skin reading, vibrotactile display, wearable display, wearables, accessible technology, accessibility",
    author = "Granit Luzhnica and Eduardo Veas",
    year = "2018",
    doi = "10.1145/3267305.3267604",
    language = "English",
    pages = "146--149",
    booktitle = "Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers",

    }

    TY - GEN

    T1 - Skin Reading Meets Speech Recognition and Object Recognition for Sensory Substitution

    AU - Luzhnica, Granit

    AU - Veas, Eduardo

    PY - 2018

    Y1 - 2018

    N2 - Sensory substitution has been a research subject for decades, and yet its applicability outside of the research is very limited. Thus creating scepticism among researchers that a full sensory substitution is not even possible [8]. In this paper, we do not substitute the entire perceptual channel. Instead, we follow a different approach which reduces the captured information drastically. We present concepts and implementation of two mobile applications which capture the user's environment, describe it in the form of text and then convey its textual description to the user through a vibrotactile wearable display. The applications target users with hearing and vision impairments.

    AB - Sensory substitution has been a research subject for decades, and yet its applicability outside of the research is very limited. Thus creating scepticism among researchers that a full sensory substitution is not even possible [8]. In this paper, we do not substitute the entire perceptual channel. Instead, we follow a different approach which reduces the captured information drastically. We present concepts and implementation of two mobile applications which capture the user's environment, describe it in the form of text and then convey its textual description to the user through a vibrotactile wearable display. The applications target users with hearing and vision impairments.

    KW - haptic interfaces

    KW - skin reading

    KW - vibrotactile display

    KW - wearable display

    KW - wearables

    KW - accessible technology

    KW - accessibility

    U2 - 10.1145/3267305.3267604

    DO - 10.1145/3267305.3267604

    M3 - Conference contribution

    SP - 146

    EP - 149

    BT - Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers

    ER -