Previous

Case Study

Surgery simulation VR/AR Prototype

Pioneering, scalable handheld medical surgery simulation with Virtual Reality aspects.

This is part of the Touch Surgery case study.

TS-xr2

Project Overview

The Touch Surgery app, later rebranded as Digital Surgery, is a mobile application designed to simulate surgical training. It caters to all levels of medical practice, providing a comprehensive library of procedures and articles from esteemed sources like Stanford and Imperial College.

The challenge was to create a user interface that supports both 2D and 3D surgical simulations. The existing 2D modules lacked the immersive experience needed for effective training, which necessitated a redesign to accommodate advanced 3D mechanics.

Research

We conducted qualitative research through interviews with surgeons from Imperial College and Guys' Hospital. This research informed our understanding of user needs and helped us develop a user journey for the training modules.

Design Process

Ideation

During the ideation phase, we gathered a team to brainstorm ideas for updating the UI to fit the new 3D simulation requirements. This included rethinking the user interface and game mechanics.

User Flow 

The user flow was designed to ensure a logical progression through the training modules. This flow guided users from selecting a procedure to engaging with the simulation, enhancing their overall experience.

Wireframing 

We created wireframes that depicted the new user interface for both 2D and 3D simulations. This visual representation allowed for early feedback and adjustments before moving to the prototyping phase.

Prototyping 

Interactive prototypes were developed to demonstrate the new HUD (Heads Up Display) for the 3D simulations. These prototypes showcased the use of the smartphone's gyroscope to enhance realism.

ts-xr-graph Smartphone's gyroscope and camera allowed for a low-effort Augmented Reality implementation that would enrich the experience and challenge of the surgery simulation.

Visual design

The visual design focused on clarity and usability. We established a consistent design language that aligned with the app’s educational purpose, ensuring that users could easily navigate and understand the interface.

Validation

User testing

User testing sessions were conducted to evaluate the effectiveness of the new design. Feedback from surgeons and trainees highlighted areas for further refinement.

Iterations and Refinements

Based on user feedback, we made several iterations to improve usability and functionality. This iterative process ensured that the final design effectively met the training needs of users in a surgical context.

Previous