Augmented Rock Climbing Wall

A game in Robokids

TODO: 2 images of settings with a user (for main and page)

Role in Project
  • Implemented real-time pose estimation model to identify the locations of children’s hands and feet.
  • Utilized a real-time multi-object tracker (MOT) to track children across camera frames.
  • Optimized pose estimation model to reduce model size and inference time to be deployed on general-purpose computer systems.
  • Integrated AI into Unity
Product Description

The Augmented Rock Climbing Wall Game is an interactive game, implemented in Robokids, that combines traditional rock climbing with augmented reality (AR) technology. Let’s see how it works:

  1. Projection: The climbing wall is equipped with a projector that display various interactive elements such as targets, obstacles, and game graphics directly onto the wall surface.
  2. Real-time Motion Tracking: A webcam track the climber’s movements in real-time. This allows the system to respond dynamically to the climber’s actions.
  3. Game Mechanics: Climbers can participate in different types of games, such as hitting targets, following specific routes, or avoiding obstacles.