Robot Task Learning through AR Human Demonstration


This robot learning platform developed by FLAIR is to apply a modular HRI framework with AR technology for robotic task demonstration and learning. The platform is able to perform various robotic tasks such as pick and place and assembling through learning through AR human demonstration.

Commercialisation opportunities
Technology licensing agreement
Problem addressed

In recent years, research in learning robotic manipulation tasks has made significant progress and shown great potential to shorten the robot downtime in industry. However, the learning outcomes are highly limited to modest-sized datasets due to difficulty of collecting large quantities of task demonstrations through existing mechanisms. Recent advances in Augmented Reality (AR) have introduced a new dimension for Human-Robot Interaction (HRI), facilitating various applications that are difficult to conduct in the physical world, such as dataset collection of Artificial Intelligent (AI) training for robotic application.

  • AR-based interaction technology development for human data collection
  • State-of-the-art reinforcement learning algorithm development to achieve excellent ability to learn from mixed quality human dataset
  • Category-level manipulation learning from few human demonstrations
Key impact
  • The System can be used to teach the robot to perform various tasks through human demonstration which greatly reduce the setup time and the required skillset
  • Complex assembly process in production line
  • Any path teaching tasks of robotics applications

The Hong Kong Industrial Artificial Intelligence & Robotics Centre (FLAIR) is established by the Hong Kong Productivity Council (HKPC) at the Hong Kong Science Park and is part of AIR@InnoHK, which is one of the two world-class research clusters being established by InnoHK Clusters of the HKSAR Government, to support Hong Kong in developing into an international innovation and technology hub.

FLAIR aims to engender synergy and achieve a clustering effect by attracting top-notch local, Mainland and overseas research institutions to engage in research collaboration. It will also actively approach private enterprises and industry associations for consultation and solicit their involvement in FLAIR’s work to ensure its industry orientation in addressing major R&D problems encountered by the industries in AI adoption.

As the sole founder, HKPC works together with RWTH Aachen Campus of Germany, the major collaborator of FLAIR, by bundling their strengths and repertoire of resources in technical expertise, networks, innovation and patents etc. to set up the FLAIR and support its operation.

For more information, please visit FLAIR’s website: