Lumen

A virtual training platform for endoscopic surgery. Doctors practise a complete endoscopic submucosal dissection (ESD) with a dedicated endoscope controller and foot pedal, without risk to a patient. I am its lead programmer at XR Japan.

Unity · C# · Burst · custom hardware · in beta

Product page (Japanese)

Why it matters

Endoscopic procedures take years to master, and young doctors have little time and few mentors to learn them from. Lumen gives every trainee the same high-quality, repeatable practice environment, available wherever there is a PC and the controller. The scenarios are supervised by the head of gastroenterology at Tokyo Metropolitan Komagome Hospital.

The beta focuses on ESD in the esophagus, with more procedures and scenarios planned.

Lumen running on a monitor next to the endoscope controller

The full procedure, step by step

Marking around the lesion
Submucosal injection lifts the tissue
Mucosal incision along the markings
Dissecting the submucosal layer

What I built

  • Tissue behaviour. How the tissue responds to each step of the procedure, running on Burst-compiled solvers so it stays smooth at a high frame rate.
  • Lesion marking. Placing and showing the markings that guide the incision.
  • Controller input. Turning the custom endoscope controller and foot pedal into precise movement of the endoscope tip: push and pull, rotation and angle.
  • Performance. Faster loading of the mesh data and frame-time work on the simulation.
  • Lead programmer. Architecture and conventions, code reviews, mentoring, and the technical side of conversations with doctors and partners.
Push and pull on the controller moves the endoscope through the esophagus

A living esophagus

The environment is reconstructed from real endoscope footage, and the esophagus moves with natural peristalsis, so trainees have to work with a moving target just like in a real procedure.

Peristalsis

Footage from XR Japan's public product video. Lumen is developed by the team at XR Japan.

← Back to the portfolio