Postdoctoral Researcher in Multi-Modal Surgical Scene Modeling and Simulation

Postdoctoral Researcher in Multi-Modal Surgical Scene Modeling and Simulation

University of Zurich

Zurich, Switzerland

We are offering a postdoctoral position around Surgical Digital Twins, with involvement in two highly visible national and inter-institutional projects funded by the Swiss National Science Foundation and the Digitalization Initiative Zurich. Our work on Surgical Digital Twins focuses on developing multi-modal (visual, acoustic, and tactile) representations of surgical dynamics covering tool-tissue interactions, human behavior, and robotic systems. These representations are integrated into immersive applications for surgical training and remote surgery.

This position provides a unique opportunity to work at the frontier of computer-assisted orthopedic surgery, embedded in Zurich's vibrant MedTech and AI ecosystem. With direct access to the state-of-the-art OR-X infrastructure for translational validation, the successful candidate will join an innovative team and collaborate with surgeons and industry partners to shape technologies with strong potential for clinical adoption.

Your responsibilities

The postdoctoral researcher's primary responsibility is to conduct original research at the intersection of medical imaging, computer vision, and simulation. This includes refining research concepts in line with state-of-the-art and emerging ideas, supervising PhD students in the implementation of corresponding methodologies, and guiding them through validation and scientific publication. Beyond core research activities, the postdoctoral researcher is expected to support and supervise experimental data collection and validation in the ex-vivo environment of the OR-X.

In particular, the responsibilities include:

• Supervising PhD students and collaboratively developing methods that advance the state-of-the-art in soft tissue simulation, multi-modal generative modelling, and digital twinning;
• Contributing to the development of new research concepts and methodologies in relevant fields;
• Designing experimental studies and advanced data-capture setups for acquiring high-quality surgical data in ex-vivo experiments;
• Collaborating with surgeons and engineers to ensure strong translational relevance;
• Disseminating results through scientific publications, patents, and prototype demonstrations;
• Active involvement in shaping and strengthening the group's research direction, methods, and best practices.

Your profile

You hold an excellent PhD degree in computer science, robotics, or electrical engineering with a strong background in computer vision, machine learning, and computer graphics - ideally in the context of computer-assisted surgery. You have experience with deep learning and simulation frameworks and bring hands-on experience with hardware (e.g., cameras, tracking systems, audio capture devices, augmented reality).

We are looking for candidates who demonstrate:

• Significant experience with computer vision, camera calibration, and tracking, and proficiency in relevant libraries (e.g., OpenCV, Open3D);
• Familiarity with AI/ML frameworks (e.g., PyTorch, TensorFlow) and medical image analysis libraries (Slicer3D, MONAI);
• Solid understanding of generative models and proven experience in working with multimodal data (images, 3D data, natural language, audio);
• Experience with signal processing, especially in the audio domain, is a plus;
• Experience with haptic rendering and Augmented Reality is a plus;
• Excellent communication skills in English (German is an asset), combined with initiative, problem-solving ability, and teamwork.