June 8, 2020 | coding ai ai-rl iot

Autonomously Landing a Lunar Lander with an Xbox Controller Robotic Arm - Part 2

In Part 1 I explained you how you can create a Robot Arm that can be mounted on an Xbox controller. In OpenAI Lunar Lander I then continued to see how we are able to train a lunar lander environment to land a lunar lander all by itself with a continuous action space.

June 7, 2020 | coding ai ai-rl iot

Training the Continuous Lunar Lander with Reinforcement Learning, RLLib and PPO

For an upcoming blog post, I would like to have a robotic arm to land a Lunar Lander autonomously. In Part 1 I explained how we can build such a robotic arm already, but now we need to be able to go deeper into how we are able to train an environment in a simulation environment (before deploying it on a physical device).

May 30, 2020 | coding ai ai-rl iot

Autonomously Landing a Lunar Lander with an Xbox Controller Robotic Arm - Part 1

Creating an Xbox Robot Arm is something that I've been wanting to do ever since I saw the post by Kevin Drouglazet who was able to utilize an Xbox Controller with an arm he created and was so friendly to publish the design files for (I am definitely not a hardware designer πŸ˜…) - thanks for that Kevin!

May 24, 2020 | coding iot

Digital Twins - Creating an Open-Source Platform

In a previous blog post I introduced the concept of creating a Digital Twin representation utilizing Dapr's Virtual Actors. Now, this was a theoretical post on how feasible this could be. Of course anything theoretical should also be put in practice, which is what I have been doing this weekend πŸ˜‰.

November 25, 2018 | coding javascript big-data

Building a Minecraft Puppet Scanner with Event Hub, a NFC 522 Reader and a Raspberry PI

In Belgium we every year celebrate the coming of "Sinterklaas" on the 6th of December, a celebration for children where this mythologic figure delivers presents for all the children that behaved well that year. (see: https://en.wikipedia.org/wiki/Sinterklaas for more information). To follow this tradition, many companies hold internal events where children of the employees are invited to participate in all kinds of events. I was asked to participate in one of these events and come up with a workshop for children of all ranges - being divided in 2 groups (the very young ones, and the somewhat older ones).

May 27, 2018 | coding dotnet

Getting started with DotNet Core

I wanted to get started with Machine Learning, but rather than using Tensorflow, I wanted to take a different approach and use ML.NET. Now you might ask yourself: "Why use .NET if you have something such as Tensorflow in Python?". Well, my preference goes towards languages containing brackets (C#, JS, ...) rather than having pure identations (Python), making me want to try .NET Core for this.

January 13, 2018 | coding

Visual Studio Android Emulator Debugging

So you decided to get into Mobile development? Well your best bet on windows currently is the Visual Studio Emulator for Android Apps by Microsoft (https://www.visualstudio.com/vs/msft-android-emulator/). But you may run into some trouble when using it. This blog post consists out of the most commonly encountered problems with the Visual Studio Emulator for Android Apps, and how you could solve them.

Xavier Geerinck Β© 2020

TwitterΒ -Β LinkedIn