Mixed Reality Surgery World Tour - A new step forward in medical innovation

15 surgeons from 13 different countries have undertaken 13 mixed reality orthopedic operations as part of a 24-hour event. The surgeons virtually collaborated using Microsoft HoloLens 2 and Dynamics 365 Remote Assist, and were led by Professor Thomas Grégory of the Avicenne AP-HP Hospital, France.

Medicine’s (virtual) world tour

Professor Grégory and his team led all 13 mixed reality surgeries from the Avicenne AP-HP Hospital. From there, the surgery toured a number of countries, including: France, India, UAE, South Africa, Ukraine, Germany, Belgium, Morocco, Brazil, Bolivia, Mexico, USA, UK.

Equipped with the HoloLens 2 and Dynamics 365 Remote Assist, the surgeons in each country were able to:

  • Visualize and operate surgery via hologram;
  • Share their real-time view of the surgery, benefitting from remote peers’ expertise on different clinical cases;
  • Train their peers remotely, enriching their surgical practices.

HoloLens is a wireless, holographic mixed reality headset that connects with apps and solutions to enhance or enable collaboration, innovation and productivity. Compared to previous designs, HoloLens 2 is lighter, more comfortable and immersive for the surgeon. Hand and eye-tracking technology detects where the surgeon’s gaze is, allowing them to operate with greater precision.

The event’s international component enabled healthcare practitioners from different countries and cultures to share the diversity and richness of their respective practices:

  • Dr Ashish Babhulkar (Head of Shoulder & Sports Injuries Department, Deenanath Mangeshkar Hospital Pune, India): “In some countries where expertise is higher, surgeons have better results on some specific clinical cases. This experience has allowed us to learn from others in a new way and improve our surgical skills.”
  • Dr Bruno Gobatto (Orthopaedic Surgeon - Shoulder & Elbow, Jaragua Hospital Brazil): “The greatness of this project is in its ability to bring together people from different cultures and expertise. This is the best way to democratize the use of mixed reality in the surgical block.”
  • Dr Rashed Alshaeel (Director of Orthopedic & Trauma, VPS Burjeel Medical City, UAE): “HoloLens will change the way we operate. We will start using it to train our future surgeons and for remote assistance. It’s a new world for the healthcare industry.”
  • Professor Thomas Gregory (Shoulder, Elbow, Wrist and Hand Surgeon, Avicenne AP-HP Hospital, France): “Mixed reality transforms our surgical practices. HoloLens 2 acts as an assistant and allows us to use technology to secure and standardize surgeries.”
  • Charles Claestroupat (Public Sector Lead, Microsoft France): "We believe that if there is one area where technology should have a significant impact in serving public interest, it is in healthcare. Effective use of technology contributes to improving care globally. From patient experience and caregiver practice, through to providing more comprehensive and secure information to all stakeholders.”

Roundtable discussions demonstrate a shared vision and perspective 

In addition to the 24-hour broadcast, the event was complemented by some 25 recorded roundtable discussions focused on the contribution of technology to surgical practice, and the future of medicine.

Over 60 international healthcare professionals discussed the strengths of mixed reality, artificial intelligence, and more generally, technological innovation, for their discipline. These panels were also an opportunity to highlight the importance of the development of e-health and present the future of training in the healthcare field.

All content broadcasted during the event will be available at aka.ms/24h.

For many years, Professor Thomas Gregory and the Avicenne AP-HP University Hospital have been committed to developing a modern, efficient, and safe healthcare system that increases the capabilities of each surgeon.

As a major player in applied research and health innovation, Avicenne AP-HP University Hospital has been a pioneer in the practice of cutting-edge technologies. It also serves as a center of excellence for the training of future practitioners.

Through both its initial mixed reality operation in 2017, and its recent 24-hour holographic surgery, the hospital, together with its partners, is extending France's expertise in medical innovation, around the world.

LaMSN of Sorbonne University Paris Nord, with its interdisciplinary vision, is committed to the innovation and development of AI and mixed reality-based tools for learning and practice of surgery. It houses an AI surgical center, Moveo, run by Professor Thomas Gregory. Among other things, Moveo processes large volumes of surgical data collected from HoloLens. This data feeds AI algorithms and provides real-time recommendations to surgeons, enhancing their procedures.

Surgeons involved in the 24-hour surgery:

  • Professor Stefan Greiner - GERMANY
  • Doctor John Erickson - USA
  • Doctor John Sledge - USA
  • Doctor Bruno Gobbato - BRAZIL
  • Doctor Ashish Babhulkar - INDIA
  • Professor Roger Emery - UNITED KINGDOM
  • Professor Stephen Roche - SOUTH AFRICA
  • Doctor Jean-Florin Ciornohac - BELGIUM
  • Doctor Jaber Al-Khayli - UAE
  • Doctor Rashed Alshaeel - UAE
  • Doctor Amara Gantier - BOLIVIA
  • Doctor Michell Ruiz - MEXICO
  • Professor Belkacem Chagar - KINGDOM OF MOROCCO
  • Professor Abderrahim Rafaoui - KINGDOM OF MOROCCO
  • Doctor Oleksandr Strafun - UKRAINE