First virtual surgery with VIPAAR, Google Glass

First virtual surgery with VIPAAR, Google Glass

A University of Alabama at Birmingham (UAB) surgical team has performed the first surgery using a virtual augmented reality technology called VIPAAR with Google Glass, a wearable computer with an optical head-mounted display. The combination of the two technologies could be an important step toward the development of useful, practical telemedicine.

VIPAAR, which stands for Virtual Interactive Presence in Augmented Reality, is a UAB-developed technology that provides real time, two-way interactive video conferencing.

UAB orthopedic surgeon Brent Ponce, MD, performed a shoulder replacement surgery on Sept. 12, 2013, at UAB Highlands Hospital in Birmingham. Watching and interacting with Ponce via VIPAAR was Phani Dantuluri, MD, from his office in Atlanta.

Ponce wore Google Glass during the operation. The built-in camera transmitted the image of the surgical field to Dantuluri. Dantuluri saw on his computer monitor exactly what Ponce saw in the operating room. VIPAAR allowed Dantuluri to introduce his hands into the virtual surgical field. Ponce saw Dantuluri’s hands as a ghostly image in his heads-up display.

"It’s not unlike the line marking a first down that a television broadcast adds to the screen while televising a football game," said Ponce. "You see the line, although it’s not really on the field. Using VIPAAR, a remote surgeon is able to put his or her hands into the surgical field and provide collaboration and assistance."

The two surgeons were able to discuss the case in a truly interactive fashion because Dantuluri could watch Ponce perform the surgery yet could introduce his hands into Ponce’s view as if they were standing next to each other. "It’s real time, real life, right there, as opposed to a Skype or video conference call which allows for dialogue back and forth, but is not really interactive," said Ponce.

This kind of technology could greatly enhance patient care by allowing a veteran surgeon to remotely provide valuable expertise to less experienced surgeons, according to UAB physicians. VIPAAR owes its origins to UAB neurosurgeon Barton Guthrie, MD, who some 10 years ago grew dissatisfied with the current state of telemedicine.

Guthrie described telemedicine as basically just a little more than a phone call between physicians. "A surgeon in a small, regional hospital might call looking for guidance on a difficult procedure — one that perhaps I’d done a hundred times, but he’d only done once or twice," he said. It offers an advantage to the patient if physicians can get virtual hands and instruments into the field of a trained, skillful surgeon who lacks only experience, Guthrie said.

"The paradigm of the telephone consultation is, Do the best you can and send the patient to me when stable,’ while the paradigm with VIPAAR is Get me to the patient,’" he said. "Let’s get my expertise and experience to the physician on the frontline, and I think we can implement that concept with these technologies."

Ponce says VIPAAR allows the remote physician to point out anatomy, provide guidance, or even demonstrate the proper positioning of instruments. He says it could be an invaluable tool for teaching residents or helping surgeons first learning a new procedure.

"This system is able to provide that help from an expert who is not on site, guiding and teaching new skills while enhancing patient safety and outcomes," he said. "It provides a safety net to improve patient care by having that assistance from an expert who is not in the room."

In 2003, Guthrie approached the Enabling Technology Laboratory in UAB’s Mechanical Engineering Department, which already was at work on virtual, interactive technologies, with the idea of using two-way video to enhance surgery. The resulting technology became VIPAAR, now a start-up company at Innovation Depot, a technology business incubator partnered with UAB.

Drew Deaton, CEO of VIPAAR, said, "VIPAAR brings experts or collaborators to the site of need, in any field where a visual collaboration would be beneficial. VIPAAR uses video on mobile devices to allow experts or collaborators to connect in real time and not only see what might need to be fixed, corrected or solved, but also be able to reach in, using tools or just their hands, and demonstrate. It’s like being there, side by side, with someone when you might be a thousand miles or 10,000 miles away."

Ponce and Dantuluri were pleased with the results of their interactive collaboration. Adjustments will be needed to fine tune the marriage between VIPAAR and Google Glass, but the promise of useful, practical telemedicine is drawing ever closer. Deaton calls it one more step on the technology evolutionary ladder.

"Today, you can’t imagine having a phone without the capability to take picture or a video," he said. "I can’t imagine, five years from now, not being able to use a smartphone to connect to an expert to solve my problem and have that person reach in and show me how to solve that problem, because the technology is advancing rapidly, and we’re bringing this technology to market today."