D.C. hospital is first to use Utah- developed AR surgical system

Springville-based image processing company Novarad and George Washington University Hospital, based in Washington, D.C., have partnered to implement the country’s first augmented reality (AR) medical process in a surgical setting. OpenSight Augmented Reality System, powered by Microsoft HoloLens, accurately overlays 2D, 3D and 4D images directly onto the patient’s body, helping surgeons visualize the procedures interactively. This partnership is driving pre-operative planning and surgical strategy into new frontiers as surgeons can now visually track tumors, other masses, organs, circulation tracks and more, improving accuracy and lowering both surgery and recovery time, according to a press statement from Novarad.

While some earlier technology was limited in both scope and efficacy, OpenSight, co-created by Dr. Wendell Gibby, Novarad CEO, and Dr. Steve Cvetko of OpenSight, was designed to visualize 3D imaging holograms of the patient — on the patient — for pre-operative localization and planning of surgical options. The 3D holograms are created by a refractory system in the device using a combination of the Microsoft HoloLens hardware and OpenSight technology.

“OpenSight allows the surgeon to overlay the medical image on to the patient’s body, so not only do I see the patient laying on top of the table, but I can see the CT hologram,” said Dr. Babak Sarani, professor of surgery and emergency medicine and director of the center for trauma and critical care at George Washington University. “Us having this technology meets the endpoint of our mission as an academic hospital.”

The infrared camera within the headset has ranging and localizing technology, which maps the surrounding environment — including the patient. It determines where objects are and creates mesh surface maps to determine 3D positioning. Placing visual tracking tags on the patient follows movement and allows for even higher accuracy. Image capabilities include virtual incisions to guide the surgeon, shunts and needle placement; finding the optimal entrance and trajectory for pedicle screws, ACL tunnels and other instrumentation; finding and resecting masses; interventional biopsies; and more.

“A revolution in surgery is beginning and George Washington University is leading the charge,” said Gibby. “Using the OpenSight augmented reality device from Novarad, doctors can literally see the patient and see into them at the same time. High-resolution advanced holographic imaging is merged in 3D onto the patient with optical precision. This transformative technology promises to improve outcomes in a world of more precise medicine.” 

“Novarad’s unique OpenSight system uses the Microsoft HoloLens headset and augments real-world healthcare environments with virtual 3D patient images, and we are very pleased that they have achieved FDA medical clearance for pre-surgical use of their OpenSight solutions for HoloLens,” said Matt Fleckenstein, senior director of marketing for Microsoft HoloLens at Microsoft Corp. “It’s exciting to see George Washington University Hospital become the first medical team to adopt this new system, empowering its doctors with the technology to improve surgical outcomes.”

Gibby founded Novarad in 1998 and the company currently has 160 employees.