{"id":2428,"date":"2024-05-03T16:08:00","date_gmt":"2024-05-03T16:08:00","guid":{"rendered":"https:\/\/labs.cs.queensu.ca\/perklab\/members\/javier-pascau\/"},"modified":"2024-05-03T16:08:00","modified_gmt":"2024-05-03T16:08:00","slug":"javier-pascau","status":"publish","type":"qsc_member","link":"https:\/\/labs.cs.queensu.ca\/perklab\/members\/javier-pascau\/","title":{"rendered":"Javier Pascau"},"content":{"rendered":"
\n
\n\t\t\n\t<\/div>\n
\n
\n

Javier Pascau<\/h1>\n<\/div>\n
Faculty<\/div>\n
<\/div>\n
Universidad Carlos III de Madrid<\/div>\n
Member from July 2022<\/em> to present<\/em><\/div>\n
\n
\n\t\t\t<\/div>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\n
\n\tJavier Pascau is Full Professor from the Department of Bioengineering and Aerospace Engineering at Universidad Carlos III de Madrid (UC3M) since 2011. He received his degree on Telecommunication Engineering from Universidad Polit\u00e9cnica de Madrid in 1999, a Master in Biomedical Technology and Instrumentation in 2005 and his PhD from Universidad Polit\u00e9cnica de Madrid in 2006. Before joining UC3M he was a research fellow at Laboratorio de Imagen M\u00e9dica (Hospital Gregorio Mara\u00f1\u00f3n) in Madrid, where he also supervised the digital radiology migration project.<\/p>\n

His research topics include multimodal image quantification and registration both in clinical and preclinical areas, surgical guidance by combining image studies and tracking systems and machine learning methods for medical image analysis. He has published more than 70 papers in indexed journals, is co-inventor of two patents and has contributed to several proceedings in medical and engineering meetings. As principal investigator he has led several projects from competitive calls in Health Technology Evaluation, Public-Private collaboration, National Research Plan for Societal Challenges, Technological Development and EraPerNet H2020 Consortium. He collaborates with several international research groups in Image Guided Treatments. Details of his research are found here: https:\/\/biig-igt.uc3m.es<\/a>
\n

<\/a><\/form>

Zachmann, Gabriel; Haddawy, Peter; Kikinis, Ron; Hennemuth, Anja; Cattin, Philippe C.; D\u00f6ring, Tanja; Drouin, Simon; Fichtinger, G\u00e1bor; Fl\u00fcgge, Tabea; Jorge, Joaquim A.; Kohli, Luv; Lorenz, Mario; Malaka, Rainer; Pascau, Javier; Reiners, Dirk; Reinschluessel, Anke V.; Schenk, Andrea; Schmid, Falko; Suebnukarn, Siriwan; Uslar, Verena; Welch, Gregory F.; Weller, Ren\u00e9; Weyhe, Dirk; Yin, Myat Su; Wijewickrema, Sudanthi<\/p>

Extended reality for enhancing surgery: Research directions to transform the operating environment Journal Article<\/span> <\/p>

In: <\/span>Journal of Healthcare Informatics Research, <\/span>2026<\/span>.<\/p>

Abstract<\/a><\/span> | BibTeX<\/a><\/span><\/p>

@article{zachmann2026,
\r\ntitle = {Extended reality for enhancing surgery: Research directions to transform the operating environment},
\r\nauthor = {Gabriel Zachmann and Peter Haddawy and Ron Kikinis and Anja Hennemuth and Philippe C. Cattin and Tanja D\u00f6ring and Simon Drouin and G\u00e1bor Fichtinger and Tabea Fl\u00fcgge and Joaquim A. Jorge and Luv Kohli and Mario Lorenz and Rainer Malaka and Javier Pascau and Dirk Reiners and Anke V. Reinschluessel and Andrea Schenk and Falko Schmid and Siriwan Suebnukarn and Verena Uslar and Gregory F. Welch and Ren\u00e9 Weller and Dirk Weyhe and Myat Su Yin and Sudanthi Wijewickrema},
\r\nyear  = {2026},
\r\ndate = {2026-01-01},
\r\njournal = {Journal of Healthcare Informatics Research},
\r\nabstract = {Abstract In the past decade, virtual reality (VR) and augmented reality (AR) have seen a second wave of activity due to consumer-level availability of devices. In the medical realm, use of VR and AR has been investigated extensively and successfully for training, teaching, rehabilitation, and therapy. However, extended reality (XR) and its intraoperative use in the operating room has yet been underexplored and underdeveloped. Intelligent XR environments that integrate advanced visualization, intuitive interaction, and AI-assisted decision support have the potential to transform clinical care. Responsive, context-aware spaces could enhance medical teams\u2019 capabilities by enabling real-time access to critical information, enhancing situation awareness, and supporting remote collaboration and access to clinical expertise across geographical boundaries\u2014all while preserving the natural flow of procedures. But to realize the potential benefits of XR in the operating room requires a significant and focused effort by an interdisciplinary community. It is the intention of this paper to help to catalyze such an effort. In this paper, we identify pressing issues in clinical care, the potential of XR to address them, and the further research that is needed to realize that potential. We look at a broad range of areas where XR can play an important role, including direct support for the surgeon, support for the surgical team, support for the patient, and remote collaboration. We also consider ways in which XR can be integrated with AI to provide enhanced information and interaction. Discussions are underpinned by considerations of methods to evaluate contributions and progress. This paper is the result of a Dagstuhl Seminar on Extended Reality for the Operating Room (XR4OR) , held at the Leibniz Center for Informatics, Schloss Dagstuhl, Germany, in February 2025. It gathered twenty-four researchers working in the areas of virtual reality, augmented reality, medical informatics, human-computer interaction, and surgery.},
\r\nkeywords = {},
\r\npubstate = {published},
\r\ntppubtype = {article}
\r\n}
\r\n<\/pre><\/div>
Close<\/a><\/p><\/div>
Abstract In the past decade, virtual reality (VR) and augmented reality (AR) have seen a second wave of activity due to consumer-level availability of devices. In the medical realm, use of VR and AR has been investigated extensively and successfully for training, teaching, rehabilitation, and therapy. However, extended reality (XR) and its intraoperative use in the operating room has yet been underexplored and underdeveloped. Intelligent XR environments that integrate advanced visualization, intuitive interaction, and AI-assisted decision support have the potential to transform clinical care. Responsive, context-aware spaces could enhance medical teams\u2019 capabilities by enabling real-time access to critical information, enhancing situation awareness, and supporting remote collaboration and access to clinical expertise across geographical boundaries\u2014all while preserving the natural flow of procedures. But to realize the potential benefits of XR in the operating room requires a significant and focused effort by an interdisciplinary community. It is the intention of this paper to help to catalyze such an effort. In this paper, we identify pressing issues in clinical care, the potential of XR to address them, and the further research that is needed to realize that potential. We look at a broad range of areas where XR can play an important role, including direct support for the surgeon, support for the surgical team, support for the patient, and remote collaboration. We also consider ways in which XR can be integrated with AI to provide enhanced information and interaction. Discussions are underpinned by considerations of methods to evaluate contributions and progress. This paper is the result of a Dagstuhl Seminar on Extended Reality for the Operating Room (XR4OR) , held at the Leibniz Center for Informatics, Schloss Dagstuhl, Germany, in February 2025. It gathered twenty-four researchers working in the areas of virtual reality, augmented reality, medical informatics, human-computer interaction, and surgery.<\/div>
Close<\/a><\/p><\/div><\/div><\/div>
 Pose-D\u00edez-de-la-Lastra, Alicia;  Ungi, Tamas;  Morton, David;  Fichtinger, Gabor;  Pascau, Javier<\/p>
Real-time integration between Microsoft HoloLens 2 and 3D Slicer with demonstration in pedicle screw placement planning<\/a> Journal Article<\/span> <\/p>
In: <\/span>International Journal of Computer Assisted Radiology and Surgery, <\/span>vol. 18, <\/span>iss. 11, <\/span>pp. 2023-2032, <\/span>2023<\/span>.<\/p>
Abstract<\/a><\/span> | Links<\/a><\/span> | BibTeX<\/a><\/span><\/p>
@article{fichtinger2023f,
\r\ntitle = {Real-time integration between Microsoft HoloLens 2 and 3D Slicer with demonstration in pedicle screw placement planning},
\r\nauthor = {Alicia Pose-D\u00edez-de-la-Lastra and Tamas Ungi and David Morton and Gabor Fichtinger and Javier Pascau},
\r\nurl = {https:\/\/link.springer.com\/article\/10.1007\/s11548-023-02977-0},
\r\nyear  = {2023},
\r\ndate = {2023-01-01},
\r\njournal = {International Journal of Computer Assisted Radiology and Surgery},
\r\nvolume = {18},
\r\nissue = {11},
\r\npages = {2023-2032},
\r\npublisher = {Springer International Publishing},
\r\nabstract = {Purpose 
\r\nUp to date, there has been a lack of software infrastructure to connect 3D Slicer to any augmented reality (AR) device. This work describes a novel connection approach using Microsoft HoloLens 2 and OpenIGTLink, with a demonstration in pedicle screw placement planning. 
\r\nMethods 
\r\nWe developed an AR application in Unity that is wirelessly rendered onto Microsoft HoloLens 2 using Holographic Remoting. Simultaneously, Unity connects to 3D Slicer using the OpenIGTLink communication protocol. Geometrical transform and image messages are transferred between both platforms in real time. Through the AR glasses, a user visualizes a patient\u2019s computed tomography overlaid onto virtual 3D models showing anatomical structures. We technically evaluated the system by measuring message transference latency between the platforms. Its functionality was assessed in pedicle screw placement planning \u2026},
\r\nkeywords = {},
\r\npubstate = {published},
\r\ntppubtype = {article}
\r\n}
\r\n<\/pre><\/div>
Close<\/a><\/p><\/div>
Purpose 
\r\nUp to date, there has been a lack of software infrastructure to connect 3D Slicer to any augmented reality (AR) device. This work describes a novel connection approach using Microsoft HoloLens 2 and OpenIGTLink, with a demonstration in pedicle screw placement planning. 
\r\nMethods 
\r\nWe developed an AR application in Unity that is wirelessly rendered onto Microsoft HoloLens 2 using Holographic Remoting. Simultaneously, Unity connects to 3D Slicer using the OpenIGTLink communication protocol. Geometrical transform and image messages are transferred between both platforms in real time. Through the AR glasses, a user visualizes a patient\u2019s computed tomography overlaid onto virtual 3D models showing anatomical structures. We technically evaluated the system by measuring message transference latency between the platforms. Its functionality was assessed in pedicle screw placement planning \u2026<\/div>
Close<\/a><\/p><\/div>