June 8, 2020 | coding ai ai-rl iot
Autonomously Landing a Lunar Lander with an Xbox Controller Robotic Arm - Part 2
June 7, 2020 | coding ai ai-rl iot
Training the Continuous Lunar Lander with Reinforcement Learning, RLLib and PPO
For an upcoming blog post, I would like to have a robotic arm to land a Lunar Lander autonomously. In Part 1 I explained how we can build such a robotic arm already, but now we need to be able to go deeper into how we are able to train an environment in a simulation environment (before deploying it on a physical device).
May 30, 2020 | coding ai ai-rl iot
Autonomously Landing a Lunar Lander with an Xbox Controller Robotic Arm - Part 1
Creating an Xbox Robot Arm is something that I've been wanting to do ever since I saw the post by Kevin Drouglazet who was able to utilize an Xbox Controller with an arm he created and was so friendly to publish the design files for (I am definitely not a hardware designer 😅) - thanks for that Kevin!
Getting Xbox Controller inputs through Node.js
For an upcoming Blog Post I wanted to connect my Xbox controller and start reading the input values through a simple node.js script that I could send back to an Arduino Nano. This entire process however seemed to be quite "interesting" to find suitable libraries and long-term supported solutions.
May 27, 2020 | ai ai-ml ai-rl
Unity ML-Agents - Creating a Robot Picker
In my last article about ML-Agents I went through an introduction of what it was and how we can use it. Now I wanted to get some more hands-on experience and found this awesome course on Unity Learn that went in detail on how to create a Hummingbird. After following this course, I wanted to do my own and work on a more industrial focused example.
May 24, 2020 | coding iot
Digital Twins - Creating an Open-Source Platform
In a previous blog post I introduced the concept of creating a Digital Twin representation utilizing Dapr's Virtual Actors. Now, this was a theoretical post on how feasible this could be. Of course anything theoretical should also be put in practice, which is what I have been doing this weekend 😉.
May 5, 2020 | ai ai-ml ai-rl
Reinforcement Learning with the Bonsai Platform
The Bonsai Machine Teaching platform has been released! Promising an easy to use environment for end-to-end Reinforcement Learning projects, starting with simulator selection / integration to algorithm configuration and training.