Healthcare & Medical AI3D RECONSTRUCTIONlive2023

Treace Medical

Surgeon-focused mobile application that generates 3D foot models from 2D X-ray images using machine learning, with user authentication, profile management, and clinical report creation.

Treace Medical's mobile application enables orthopaedic surgeons to upload standard 2D X-ray images and receive a reconstructed 3D foot model within seconds. The app uses a machine learning pipeline trained on thousands of annotated clinical scans to extract bone geometry, generate volumetric models, and produce standardised clinical measurement reports—accelerating pre-operative planning and improving surgical precision for procedures like the Lapiplasty bunion correction.

Orthopaedic surgeons planning foot and ankle procedures rely on flat 2D X-rays that obscure the true three-dimensional anatomy of the joint. Detailed 3D imaging via CT requires expensive equipment, significant radiation exposure, and is not routinely ordered for outpatient procedures—leaving surgeons to mentally extrapolate 3D structure from 2D shadows.

2D-to-3D Bone Reconstruction

A convolutional network trained on paired X-ray and CT scans learns to predict volumetric bone geometry from a single lateral and AP radiograph, outputting a mesh that can be rotated and measured in 3D.

Clinical Measurement Pipeline

OpenCV-based landmark detection identifies anatomical reference points on the 2D input; MediaPipe hand-off passes coordinates to the 3D model for auto-generation of standardised surgical measurements and PDF reports.

  1. 01.

    Reconstructs accurate 3D foot bone models from standard 2D AP and lateral X-ray images in under 10 seconds.

  2. 02.

    Automatically calculates key surgical measurements (hallux valgus angle, intermetatarsal angle) from the 3D model.

  3. 03.

    Generates formatted clinical PDF reports that surgeons can attach directly to patient records and surgical plans.

<10s

Reconstruction Time

From X-ray upload to interactive 3D model on mobile.

92%

Measurement Accuracy

Versus ground-truth CT measurements on validation set.

3X

Planning Speed

Faster pre-operative planning versus conventional 2D review.

Treace Medical screenshot 1
Treace Medical screenshot 2
Treace Medical screenshot 3