Foottroller for locomotion control in Nvidia Omniverse and Teleoperation

System preparations

ISPAC Lab tutorials:

Tutorial #1 – Installation of Isaac Sim (Option 1: Workstation Installation)

Tutorial 1: Robot control in Isaac Sim with Foottroller

This is a basic tutorial of using Foottroller for locomotion control in Nvidia Isaac Sim.

The tutorial is developed based on ISAPC lab tutorial #6 part 1 and part 2.

It demonstrates how to control a two-wheeled robot in NVIDIA Isaac Sim using foot gestures with the Foottroller to achieve hand-free locomotion control.

What you will learn:

• Setup and test Foottroller in Ubuntu linux

• Run Isaac Sim simulation

• Use python to read Foottroller inputs, generate robot controls, and use ROS2 to send the controls to Isaac Sim to control the Robot

Required software installations:

• Nvidia Isaac Sim (Tutorial)

• ROS2 (search ROS2 installation on Untuntu)

• pygame: sudo apt install python3-pygame

• jstest-gtk (Install with command: sudo apt install jstest-gtk)

Project file download

Use VR in Isaac Sim + Foottroller for Natural Locomotion Control (Windows Tutorial)

What’s covered:

• Enabling the XR Experience extension in Isaac Sim

• Launching and configuring VR mode

• Integrating Foottroller for natural, intuitive locomotion

• Live demonstration of foot-based movement in VR inside Isaac Sim