Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment

Antonio Pepe, Gianpaolo F Trotta, Christina Gsaxner, Dieter Schmalstieg, Jürgen Wallner, Jan Egger, Vitoantonio Bevilacqua

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Abstract

Maxillofacial tumor resection is often dependent on the expertise of the surgeon performing the operation. This study wants to be a first exploration of the role that commercial mixed reality headsets could have in this field. With this purpose in mind, a mixed reality Head Mounted Display (HMD) application is proposed to ease this task and provide a training tool. Due to the invasiveness of the operation, a marker-less registration has been considered as advantageous and therefore a pattern recognition algorithm has been adopted for properly placing a segmented PET-CT scan over the target face. To document the validity and appreciation rate of such a system, groups of physicians and engineers were asked to evaluate and assess the resulting prototype according to the standard ISO-9241/110. The application showed a noticeable accuracy of millimeters, consistent with other biomedical studies, due to intrinsic limitations of the device. Nonetheless, the remarkably positive feedbacks collected from both groups suggest high interest in further work.

LanguageEnglish
Title of host publicationBMEiCON 2018 - 11th Biomedical Engineering International Conference
ISBN (Electronic)9781538657249
DOIs
StatusPublished - 2019

Fingerprint

surgery
pattern recognition
Surgery
Pattern recognition
earphones
surgeons
positive feedback
physicians
Computerized tomography
markers
engineers
Tumors
education
tumors
Display devices
prototypes
Feedback
Engineers

Keywords

  • Head and Neck Cancer
  • Human-Computer Interaction
  • Maxillofacial Surgery
  • Medical Imaging
  • Microsoft HoloLens
  • Mixed Reality
  • PET-CT

ASJC Scopus subject areas

  • Artificial Intelligence
  • Instrumentation
  • Biomedical Engineering

Cite this

Pepe, A., Trotta, G. F., Gsaxner, C., Schmalstieg, D., Wallner, J., Egger, J., & Bevilacqua, V. (2019). Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment. In BMEiCON 2018 - 11th Biomedical Engineering International Conference [8609921] https://doi.org/10.1109/BMEiCON.2018.8609921

Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment. / Pepe, Antonio; Trotta, Gianpaolo F; Gsaxner, Christina; Schmalstieg, Dieter; Wallner, Jürgen; Egger, Jan; Bevilacqua, Vitoantonio.

BMEiCON 2018 - 11th Biomedical Engineering International Conference. 2019. 8609921.

Research output: Chapter in Book/Report/Conference proceedingConference contributionResearchpeer-review

Pepe, A, Trotta, GF, Gsaxner, C, Schmalstieg, D, Wallner, J, Egger, J & Bevilacqua, V 2019, Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment. in BMEiCON 2018 - 11th Biomedical Engineering International Conference., 8609921. https://doi.org/10.1109/BMEiCON.2018.8609921
Pepe, Antonio ; Trotta, Gianpaolo F ; Gsaxner, Christina ; Schmalstieg, Dieter ; Wallner, Jürgen ; Egger, Jan ; Bevilacqua, Vitoantonio. / Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment. BMEiCON 2018 - 11th Biomedical Engineering International Conference. 2019.
@inproceedings{6de700f8015e4fee907a0cf53f54aaee,
title = "Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment",
abstract = "Maxillofacial tumor resection is often dependent on the expertise of the surgeon performing the operation. This study wants to be a first exploration of the role that commercial mixed reality headsets could have in this field. With this purpose in mind, a mixed reality Head Mounted Display (HMD) application is proposed to ease this task and provide a training tool. Due to the invasiveness of the operation, a marker-less registration has been considered as advantageous and therefore a pattern recognition algorithm has been adopted for properly placing a segmented PET-CT scan over the target face. To document the validity and appreciation rate of such a system, groups of physicians and engineers were asked to evaluate and assess the resulting prototype according to the standard ISO-9241/110. The application showed a noticeable accuracy of millimeters, consistent with other biomedical studies, due to intrinsic limitations of the device. Nonetheless, the remarkably positive feedbacks collected from both groups suggest high interest in further work.",
keywords = "Head and Neck Cancer, Human-Computer Interaction, Maxillofacial Surgery, Medical Imaging, Microsoft HoloLens, Mixed Reality, PET-CT",
author = "Antonio Pepe and Trotta, {Gianpaolo F} and Christina Gsaxner and Dieter Schmalstieg and J{\"u}rgen Wallner and Jan Egger and Vitoantonio Bevilacqua",
year = "2019",
doi = "10.1109/BMEiCON.2018.8609921",
language = "English",
isbn = "9781538657249",
booktitle = "BMEiCON 2018 - 11th Biomedical Engineering International Conference",

}

TY - GEN

T1 - Pattern Recognition and Mixed Reality for Computer-Aided Maxillofacial Surgery and Oncological Assessment

AU - Pepe, Antonio

AU - Trotta, Gianpaolo F

AU - Gsaxner, Christina

AU - Schmalstieg, Dieter

AU - Wallner, Jürgen

AU - Egger, Jan

AU - Bevilacqua, Vitoantonio

PY - 2019

Y1 - 2019

N2 - Maxillofacial tumor resection is often dependent on the expertise of the surgeon performing the operation. This study wants to be a first exploration of the role that commercial mixed reality headsets could have in this field. With this purpose in mind, a mixed reality Head Mounted Display (HMD) application is proposed to ease this task and provide a training tool. Due to the invasiveness of the operation, a marker-less registration has been considered as advantageous and therefore a pattern recognition algorithm has been adopted for properly placing a segmented PET-CT scan over the target face. To document the validity and appreciation rate of such a system, groups of physicians and engineers were asked to evaluate and assess the resulting prototype according to the standard ISO-9241/110. The application showed a noticeable accuracy of millimeters, consistent with other biomedical studies, due to intrinsic limitations of the device. Nonetheless, the remarkably positive feedbacks collected from both groups suggest high interest in further work.

AB - Maxillofacial tumor resection is often dependent on the expertise of the surgeon performing the operation. This study wants to be a first exploration of the role that commercial mixed reality headsets could have in this field. With this purpose in mind, a mixed reality Head Mounted Display (HMD) application is proposed to ease this task and provide a training tool. Due to the invasiveness of the operation, a marker-less registration has been considered as advantageous and therefore a pattern recognition algorithm has been adopted for properly placing a segmented PET-CT scan over the target face. To document the validity and appreciation rate of such a system, groups of physicians and engineers were asked to evaluate and assess the resulting prototype according to the standard ISO-9241/110. The application showed a noticeable accuracy of millimeters, consistent with other biomedical studies, due to intrinsic limitations of the device. Nonetheless, the remarkably positive feedbacks collected from both groups suggest high interest in further work.

KW - Head and Neck Cancer

KW - Human-Computer Interaction

KW - Maxillofacial Surgery

KW - Medical Imaging

KW - Microsoft HoloLens

KW - Mixed Reality

KW - PET-CT

UR - http://www.scopus.com/inward/record.url?scp=85062079689&partnerID=8YFLogxK

UR - https://graz.pure.elsevier.com/en/publications/pattern-recognition-and-mixed-reality-for-computeraided-maxillofacial-surgery-and-oncological-assessment(6de700f8-015e-4fee-907a-0cf53f54aaee).html

U2 - 10.1109/BMEiCON.2018.8609921

DO - 10.1109/BMEiCON.2018.8609921

M3 - Conference contribution

SN - 9781538657249

BT - BMEiCON 2018 - 11th Biomedical Engineering International Conference

ER -