Portable Projection Mapping Device (PPMD)

/ Overview

Designed a portable projection mapping device that delivers medical augmented reality guidance for single-stage cranioplasty. The system projects surgical planning information directly onto the patient or implant, enabling more intuitive visualization and surgical instrument tracking using RGB-D cameras. By embedding augmented reality in a compact, mobile form factor, the device is tailored for developers to implement AR applications in real-world settings. We demonstrated the system's capability in single-stage cranioplasty, showing accurate instrument tracking and real-time visualization.

/ Key Contributions

• Designed and developed a portable projection-based augmented reality system
• Performed camera-projector calibration. Designed stereo IR optical tracking camera using RGB-D camera. Developed surgical instrument tracking algorithm. Integrated projection mapping with surgical planning to display guidance directly in the operative field
• Demonstrated the feasibility of the system in single-stage cranioplasty, showing accurate instrument tracking and real-time visualization