NVIDIA Isaac for Healthcare is the 3-computer solution for healthcare robotics, allowing simulation, training and deployment of AI solutions. It extends and tailors Isaac Sim and Isaac Lab and Omniverse to enable multi-scale simulation from anatomy to sensors, surgical instruments, robotic systems, operating rooms, intensive care units, labs, sterile processing departments (SPD), and full hospital environments. NVIDIA Isaac for Healthcare leverages NVIDIA Holoscan for hardware-in-the-loop (HIL) simulation and Sim2Real deployment of trained algorithms and policies.
NVIDIA Isaac for Healthcare is a domain-specific framework built on top of NVIDIA Isaac Sim, NVIDIA Isaac Lab, NVIDIA Omniverse and NVIDIA Holoscan, enabling developers to design, simulate, test, train and deploy AI-enabled robots and autonomous systems, and generate synthetic data across:
- Therapeutics: e.g., surgical robotics, interventional radiology and radiotherapy
- Diagnostics: e.g., ultrasound (US), computed tomography (CT), cone-beam CT (CBCT)
- Hospital & patient care: e.g., hospitals, operating rooms and intensive care units with medication delivery, supply transport, disinfection robots, cobots
- Rehabilitation & assistive technologies: e.g., physical therapy robots, exoskeletons, etc.
Get started with NVIDIA Isaac for Healthcare by exploring our core components:
| Component | Description | Repository |
|---|---|---|
| 🔧 Workflows | Complete reference implementations for healthcare robotics applications | View Workflows → |
| 📡 Sensor Simulation | Virtual models for medical sensors and imaging modalities | View Sensor Simulation → |
| 📦 Asset Catalog | Collection of assets for medical devices and sensors | View Asset Catalog → |
The workflows module provides comprehensive reference implementations for healthcare robotics applications, including robotic surgery and ultrasound systems. Each workflow includes complete simulation environments, training datasets, pre-trained models, and deployment tools.
The sensor simulation module provides virtual models for a variety of medical sensors and imaging modalities, such as ultrasound, CT, RGB-D cameras, and more. This enables realistic testing and development of AI solutions in simulated healthcare environments.
The asset catalog contains a collection of assets that can be used to simulate medical devices and sensors.
