Sign in Subscribe

Internet of Things

Running Dapr on Azure IoT Edge

Running Dapr on Azure IoT Edge

I've been working on a large-scale project that has some interesting requirements performance wise. While having around 6+ modules, I should get a performance of around 10ms roundtrip! One container does AI inferencing within ~2ms. Problem Definition The problem I am seeing now is that the Azure IoT

Setting up Stable Baselines with Python 3.7 and WSL 2

Setting up Stable Baselines with Python 3.7 and WSL 2

I've been playing around a bit with Stable Baselines lately for an upcoming project. However while playing, I encountered some issues seeing that Stable Baselines currently requires Tensorflow <= 1.14 which is only supported through Python < 3.8. Due those difficulties, I thought it would be

Autonomously Landing a Lunar Lander with an Xbox Controller Robotic Arm - Part 2

Autonomously Landing a Lunar Lander with an Xbox Controller Robotic Arm - Part 2

In Part 1 I explained you how you can create a Robot Arm that can be mounted on an Xbox controller. In OpenAI Lunar Lander I then continued to see how we are able to train a lunar lander environment to land a lunar lander all by itself with a

Training the Continuous Lunar Lander with Reinforcement Learning, RLLib and PPO

Training the Continuous Lunar Lander with Reinforcement Learning, RLLib and PPO

For an upcoming blog post, I would like to have a robotic arm to land a Lunar Lander autonomously. In Part 1 I explained how we can build such a robotic arm already, but now we need to be able to go deeper into how we are able to train

Autonomously Landing a Lunar Lander with an Xbox Controller Robotic Arm - Part 1

Autonomously Landing a Lunar Lander with an Xbox Controller Robotic Arm - Part 1

Creating an Xbox Robot Arm is something that I've been wanting to do ever since I saw the post by Kevin Drouglazet who was able to utilize an Xbox Controller with an arm he created and was so friendly to publish the design files for (I am definitely

Digital Twins - Creating an Open-Source Platform

Digital Twins - Creating an Open-Source Platform

In a previous blog post I introduced the concept of creating a Digital Twin representation utilizing Dapr's Virtual Actors. Now, this was a theoretical post on how feasible this could be. Of course anything theoretical should also be put in practice, which is what I have been doing

Digital Twins - Utilizing Virtual Actors through Dapr

Digital Twins - Utilizing Virtual Actors through Dapr

As stated before, "A Digital Twin is a virtual representation of a physical object". This virtual representation should strive towards being an exact copy of the physical object in both state and logic associated with it. Note: this is a continuation on my previous posts around Digital Twins