Introduction
As robotic surgery becomes more prevalent, the lack of integrated and intelligent data systems creates operational inefficiencies and negatively impacts patient care. In collaboration with Johnson & Johnson MedTech, our team set out to explore how AI and cloud technology could be leveraged to support a new robotic surgical system and improve the surgical workflow.
partnered with J&J Med Tech @UW
6 months | Jan 2023 - Jun 2023
Led the end-to-end design process, from user research to high-fidelity prototype. Conducted interviews, synthesized insights, and shaped the design direction. Focused on translating research into solutions, driving concept development, co-design sessions, and usability testing.
Product Designer | Soo Hwang
Product Designer
UX Researcher
Product Manager
project background
Johnson & Johnson MedTech is developing a new robotic surgical system and seeking opportunities to close critical gaps in current offerings, particularly around fragmented data systems. Existing surgical workflows are hindered by siloed tools and poor information flow across the pre-op, intra-op, and post-op stages, leading to miscommunication, lost data, and delayed decisions.
Design question
From talking to medical professionals and industry experts, we learned that many of the current inefficiencies are caused by fragmented and cumbersome data systems and tools that do not lend themselves well to medical workflows. Crucial data gets lost, miscommunicated, and is difficult to find and utilize.
Handoffs of crucial information are prone to error and inefficiencies.
Current system and tools do not integrate well into medical workflows.
Fragmented data and tools hider discoverability and organization of crucial data.
Both generative and evaluative research was conducted over the course of the product conception and development, continuously guiding and shaping our direction and design.
Interviewed stakeholders and mapped out pre-, intra-, and post-operative phases to understand the current workflow.
Conducted in-person visits to local hospitals to observe live surgical procedures and run simulated workflows.
Interviewed the Clinical Engineer and Data Systems Manager to understand data fragmentation and identify UX challenges.
design evaluation
Stakeholders reviewed concept storyboards, shared feedback, and co-workshopped ideas. Their input helped us prioritize pre- and post-op support systems, focusing on accuracy, transparency, and trust while refining scope based on feasibility and desirability
design goal
Given the fast-paced nature of medical environments, designs must focus on clarity and efficiency over visual flair. Simple, intuitive workflows help reduce cognitive load and improve task completion.
Medical professionals vary widely in age, background, and tech familiarity. Interfaces should feel approachable and intuitive, accommodating both seasoned surgeons and newer staff.
Because responsibilities differ greatly across roles, designs should be flexible and customizable. This ensures the system can adapt to individual needs without forcing a one-size-fits-all approach.
project snap shot
final outcome
Below is a demo video highlighting the final product.
reflection
The medical field introduced a steep learning curve with unfamiliar tools, language, and workflows. This challenged us to remain flexible and open-minded while designing solutions that respect the precision and nuance required in healthcare.
Working within the assumption of a centralized medical database helped us imagine new ways to support surgical workflows. It also highlighted how fragmented current systems are and the long road ahead for true interoperability.
project wrap-up
With more time and access, we would prioritize continuous contextual inquiry within specific surgical procedures to surface patterns and refine design decisions. Expanding co-design and usability testing would allow us to validate and tailor workflows across different surgical roles.
We’re also interested in exploring physical components such as robotic tools and port placement aids that complement our digital solution. Ultimately, we'd aim to partner more closely with clinical stakeholders to further ground the product in real-world practice and implementation constraints.
