Ray Summit 2020

Digital Twin (DT) is widely used in various industrial sectors to optimize the operations and maintenance of physical assets, system and manufacturing processes. Our goal is to introduce an architecture in which the radio access control happens automatically to minimize the utilized radio resources while still maximizing the production KPIs of the robot cell. To achieve this, we apply Reinforcement Learning (RL) in a simulated environment to explore the environment fast, while the DT ensures that the learned policy can be applied on the real world environment as well. We show that the application of Ultra Reliable Low Latency Communication (URLLC) connection can be reduced to approx. 30% of the total radio time while achieving real-world accurate robot control. We discuss the implementation of the concept within RLlib.