Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment

Antonio Pepe, Gianpaolo F Trotta, Christina Gsaxner, Dieter Schmalstieg, Jürgen Wallner, Jan Egger, Vitoantonio Bevilacqua

Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandForschungBegutachtung

Abstract

Maxillofacial tumor resection is often dependent on the expertise of the surgeon performing the operation. This study wants to be a first exploration of the role that commercial mixed reality headsets could have in this field. With this purpose in mind, a mixed reality Head Mounted Display (HMD) application is proposed to ease this task and provide a training tool. Due to the invasiveness of the operation, a marker-less registration has been considered as advantageous and therefore a pattern recognition algorithm has been adopted for properly placing a segmented PET-CT scan over the target face. To document the validity and appreciation rate of such a system, groups of physicians and engineers were asked to evaluate and assess the resulting prototype according to the standard ISO-9241/110. The application showed a noticeable accuracy of millimeters, consistent with other biomedical studies, due to intrinsic limitations of the device. Nonetheless, the remarkably positive feedbacks collected from both groups suggest high interest in further work.

Originalspracheenglisch
TitelBMEiCON 2018 - 11th Biomedical Engineering International Conference
ISBN (elektronisch)9781538657249
DOIs
PublikationsstatusVeröffentlicht - 2019

Fingerprint

surgery
pattern recognition
Surgery
Pattern recognition
earphones
surgeons
positive feedback
physicians
Computerized tomography
markers
engineers
Tumors
education
tumors
Display devices
prototypes
Feedback
Engineers

Schlagwörter

    ASJC Scopus subject areas

    • Artificial intelligence
    • !!Instrumentation
    • !!Biomedical Engineering

    Dies zitieren

    Pepe, A., Trotta, G. F., Gsaxner, C., Schmalstieg, D., Wallner, J., Egger, J., & Bevilacqua, V. (2019). Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment. in BMEiCON 2018 - 11th Biomedical Engineering International Conference [8609921] https://doi.org/10.1109/BMEiCON.2018.8609921

    Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment. / Pepe, Antonio; Trotta, Gianpaolo F; Gsaxner, Christina; Schmalstieg, Dieter; Wallner, Jürgen; Egger, Jan; Bevilacqua, Vitoantonio.

    BMEiCON 2018 - 11th Biomedical Engineering International Conference. 2019. 8609921.

    Publikation: Beitrag in Buch/Bericht/KonferenzbandBeitrag in einem KonferenzbandForschungBegutachtung

    Pepe, A, Trotta, GF, Gsaxner, C, Schmalstieg, D, Wallner, J, Egger, J & Bevilacqua, V 2019, Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment. in BMEiCON 2018 - 11th Biomedical Engineering International Conference., 8609921. https://doi.org/10.1109/BMEiCON.2018.8609921
    Pepe, Antonio ; Trotta, Gianpaolo F ; Gsaxner, Christina ; Schmalstieg, Dieter ; Wallner, Jürgen ; Egger, Jan ; Bevilacqua, Vitoantonio. / Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment. BMEiCON 2018 - 11th Biomedical Engineering International Conference. 2019.
    @inproceedings{6de700f8015e4fee907a0cf53f54aaee,
    title = "Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment",
    abstract = "Maxillofacial tumor resection is often dependent on the expertise of the surgeon performing the operation. This study wants to be a first exploration of the role that commercial mixed reality headsets could have in this field. With this purpose in mind, a mixed reality Head Mounted Display (HMD) application is proposed to ease this task and provide a training tool. Due to the invasiveness of the operation, a marker-less registration has been considered as advantageous and therefore a pattern recognition algorithm has been adopted for properly placing a segmented PET-CT scan over the target face. To document the validity and appreciation rate of such a system, groups of physicians and engineers were asked to evaluate and assess the resulting prototype according to the standard ISO-9241/110. The application showed a noticeable accuracy of millimeters, consistent with other biomedical studies, due to intrinsic limitations of the device. Nonetheless, the remarkably positive feedbacks collected from both groups suggest high interest in further work.",
    keywords = "Head and Neck Cancer, Human-Computer Interaction, Maxillofacial Surgery, Medical Imaging, Microsoft HoloLens, Mixed Reality, PET-CT",
    author = "Antonio Pepe and Trotta, {Gianpaolo F} and Christina Gsaxner and Dieter Schmalstieg and J{\"u}rgen Wallner and Jan Egger and Vitoantonio Bevilacqua",
    year = "2019",
    doi = "10.1109/BMEiCON.2018.8609921",
    language = "English",
    isbn = "9781538657249",
    booktitle = "BMEiCON 2018 - 11th Biomedical Engineering International Conference",

    }

    TY - GEN

    T1 - Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment

    AU - Pepe, Antonio

    AU - Trotta, Gianpaolo F

    AU - Gsaxner, Christina

    AU - Schmalstieg, Dieter

    AU - Wallner, Jürgen

    AU - Egger, Jan

    AU - Bevilacqua, Vitoantonio

    PY - 2019

    Y1 - 2019

    N2 - Maxillofacial tumor resection is often dependent on the expertise of the surgeon performing the operation. This study wants to be a first exploration of the role that commercial mixed reality headsets could have in this field. With this purpose in mind, a mixed reality Head Mounted Display (HMD) application is proposed to ease this task and provide a training tool. Due to the invasiveness of the operation, a marker-less registration has been considered as advantageous and therefore a pattern recognition algorithm has been adopted for properly placing a segmented PET-CT scan over the target face. To document the validity and appreciation rate of such a system, groups of physicians and engineers were asked to evaluate and assess the resulting prototype according to the standard ISO-9241/110. The application showed a noticeable accuracy of millimeters, consistent with other biomedical studies, due to intrinsic limitations of the device. Nonetheless, the remarkably positive feedbacks collected from both groups suggest high interest in further work.

    AB - Maxillofacial tumor resection is often dependent on the expertise of the surgeon performing the operation. This study wants to be a first exploration of the role that commercial mixed reality headsets could have in this field. With this purpose in mind, a mixed reality Head Mounted Display (HMD) application is proposed to ease this task and provide a training tool. Due to the invasiveness of the operation, a marker-less registration has been considered as advantageous and therefore a pattern recognition algorithm has been adopted for properly placing a segmented PET-CT scan over the target face. To document the validity and appreciation rate of such a system, groups of physicians and engineers were asked to evaluate and assess the resulting prototype according to the standard ISO-9241/110. The application showed a noticeable accuracy of millimeters, consistent with other biomedical studies, due to intrinsic limitations of the device. Nonetheless, the remarkably positive feedbacks collected from both groups suggest high interest in further work.

    KW - Head and Neck Cancer

    KW - Human-Computer Interaction

    KW - Maxillofacial Surgery

    KW - Medical Imaging

    KW - Microsoft HoloLens

    KW - Mixed Reality

    KW - PET-CT

    UR - http://www.scopus.com/inward/record.url?scp=85062079689&partnerID=8YFLogxK

    UR - https://graz.pure.elsevier.com/en/publications/pattern-recognition-and-mixed-reality-for-computeraided-maxillofacial-surgery-and-oncological-assessment(6de700f8-015e-4fee-907a-0cf53f54aaee).html

    U2 - 10.1109/BMEiCON.2018.8609921

    DO - 10.1109/BMEiCON.2018.8609921

    M3 - Conference contribution

    SN - 9781538657249

    BT - BMEiCON 2018 - 11th Biomedical Engineering International Conference

    ER -