Sign in Subscribe

Xavier Geerinck

Training the Continuous Lunar Lander with Reinforcement Learning, RLLib and PPO

Training the Continuous Lunar Lander with Reinforcement Learning, RLLib and PPO

For an upcoming blog post, I would like to have a robotic arm to land a Lunar Lander autonomously. In Part 1 I explained how we can build such a robotic arm already, but now we need to be able to go deeper into how we are able to train

Autonomously Landing a Lunar Lander with an Xbox Controller Robotic Arm - Part 1

Autonomously Landing a Lunar Lander with an Xbox Controller Robotic Arm - Part 1

Creating an Xbox Robot Arm is something that I've been wanting to do ever since I saw the post by Kevin Drouglazet who was able to utilize an Xbox Controller with an arm he created and was so friendly to publish the design files for (I am definitely

Getting Xbox Controller inputs through Node.js

Getting Xbox Controller inputs through Node.js

For an upcoming Blog Post I wanted to connect my Xbox controller and start reading the input values through a simple node.js script that I could send back to an Arduino Nano. This entire process however seemed to be quite "interesting" to find suitable libraries and long-term

Unity ML-Agents - An Introduction

Unity ML-Agents - An Introduction

Seeing the rising popularity of the ML-Agents framework and them having achieved Release 2 - congratulations! - I decided to start by running one of the examples and documenting it. Installing Unity First we have to install Unity, for that we simply can go to https://unity3d.com/get-unity/download

Digital Twins - Creating an Open-Source Platform

Digital Twins - Creating an Open-Source Platform

In a previous blog post I introduced the concept of creating a Digital Twin representation utilizing Dapr's Virtual Actors. Now, this was a theoretical post on how feasible this could be. Of course anything theoretical should also be put in practice, which is what I have been doing

Digital Twins - Utilizing Virtual Actors through Dapr

Digital Twins - Utilizing Virtual Actors through Dapr

As stated before, "A Digital Twin is a virtual representation of a physical object". This virtual representation should strive towards being an exact copy of the physical object in both state and logic associated with it. Note: this is a continuation on my previous posts around Digital Twins

Reinforcement Learning with the Bonsai Platform

Reinforcement Learning with the Bonsai Platform

The Bonsai Machine Teaching platform has been released! Promising an easy to use environment for end-to-end Reinforcement Learning projects, starting with simulator selection / integration to algorithm configuration and training. Of course I had to instantly try this out! Seeing that I "stalked" this team endlessly for over a