Introducing Autoregressive Policies for Temporally Coherent Exploration in Continuous Control Reinforcement Learning

Introducing Autoregressive Policies for Temporally Coherent Exploration in Continuous Control Reinforcement Learning

Reinforcement Learning (RL) is a promising approach to solving complex real world tasks with physical robots, supported by recent successes, e.g. in grasping and object manipulation. In RL, a decision-making agent interacting with the world discovers new behaviours by trial and error, sometimes exploring new ways to do things, and sometimes exploiting what it has already found to work well. Efficient exploration of alternative behaviours is the key to reinforcement learning.

Reproducing Kindred’s UR-Reacher-2 Learning Experiment

Reproducing Kindred’s UR-Reacher-2 Learning Experiment

Achieving reproducible results in reinforcement learning experiments can be notoriously difficult; with the added hardware artifacts of physical robots, this becomes an even more challenging feat. In this guest blog post, Oliver presents an overview of his experience as an early tester working with SenseAct to reproduce the UR-Reacher-2 experiment.

Introducing a framework and benchmark tasks for reproducible reinforcement learning research on real robots

Introducing a framework and benchmark tasks for reproducible reinforcement learning research on real robots

We introduce six reinforcement learning benchmark tasks based on three commercially available robots. These tasks are developed in SenseAct, a new open-source framework for implementing real-time reinforcement learning tasks. We furthermore provide benchmarking results from our evaluation of several state of the art learning algorithms for continuous control on these tasks.

Benchmarking reinforcement learning algorithms on real-world robots

Benchmarking reinforcement learning algorithms on real-world robots

Reinforcement learning research with physical robots faces substantial resistance due to the lack of benchmark tasks and supporting source code. In this work, we introduce several reinforcement learning tasks with multiple commercially available robots that present varying levels of learning difficulty, setup, and repeatability. 

Kindred introduces SenseAct, the first reinforcement learning open-source toolkit for physical robots

Kindred introduces SenseAct, the first reinforcement learning open-source toolkit for physical robots

Today, Kindred announced the launch of SenseAct, the first open-source toolkit to set-up reinforcement learning tasks on physical robots. Kindred’s SenseAct was created to provide robotics developers and researchers with a consistent, learnable interface that efficiently controls for time delays, a factor that simulation environments aren’t hindered by.

Reinforcement learning beat games such as Backgammon and Go, and is paving a path for smarter robots

Reinforcement learning beat games such as Backgammon and Go, and is paving a path for smarter robots

From Go to Dota 2 to the operation of commercial HVAC systems - reinforcement learning modeling and algorithms are changing how engineers see complicated dynamical systems as games, and learn strategies to play them well. Kindred is applying the revolutionary technology that powered AlphaGo to the creation of a new generation of intelligent robotics for material handling.

Differences in interaction patterns and perception for teleoperated and autonomous humanoid robots

As the linguistic capabilities of interactive robots advance, it becomes increasingly important to understand how humans will instruct robots through natural language. What is more, with the increased use of teleoperated humanoid robots, it is important to recognize whether any differences between instructions given to humans and robots are due to the physical embodiment or perceived autonomy of the instructee. In this paper, we present the results of a human-subject experiment in which participants interacted in a collaborative, task-based setting with both a human and a suit-based, teleoperated humanoid robot said to be either autonomous or teleoperated.