Sign in Subscribe

Internet of Things

Roadwork RL - A Multi-Language Reinforcement Learning Environment

Roadwork RL - A Multi-Language Reinforcement Learning Environment

After explaining the end-to-end concept of creating a Digital Twin Reinforcement Learning environment I wanted to go into a deeper explanation of how the first part of this can be done. This is something I have been working on for the last couple of months and decided to call "

Internet Of Things - Digital Twins Explained

Internet Of Things - Digital Twins Explained

Looking at the history in manufacturing, we saw that many manufacturing companies were deploying statistical models on-edge (e.g. based on parameters such as temperature, pressure and speed, do we send an alert or not), having the main impact on their production volume. If they can then squeeze out this

A Multi-Language Reinforcement Learning Digital Twin Environment

A Multi-Language Reinforcement Learning Digital Twin Environment

One of the ideas I have been playing around with the last couple of months is the combination of Digital Twins and Reinforcement Learning. This is an experimental idea where I would love to hear your opinions about it (feel free to comment below, send me an email or reach

Act in realtime on IoT Data without writing any code through Azure IoT Hub, Event Grid, Cosmos DB and Logic Apps

Act in realtime on IoT Data without writing any code through Azure IoT Hub, Event Grid, Cosmos DB and Logic Apps

Creating a realtime application is quite trivial, you most of the time take in all the events and put a dedicated processor on there that will process the incoming events for you. But what if you would like to make things a bit more interesting and develop this entire path

Creating a Pub/Sub system with 100.000 subscribers and 1 publisher

Creating a Pub/Sub system with 100.000 subscribers and 1 publisher

I decided to do something exciting and challenging for personal growth in my Data & AI area and posed myself the hypothesis: "Can I create a system that with a few publishers but a massive amount of subscribers?" with the constraints of: * Should be easy to maintain (as

Part 4 - Creating a Automated Machine Learning model based on our Car Simulation Data

Part 4 - Creating a Automated Machine Learning model based on our Car Simulation Data

This is Part 4 in the IoT Edge series, view the main article or go the part 3 to view the previous article. Recap and next steps We just built our 2 simulators that will produce the data that we want to filter. Before we can create our modules to

Part 3 - Creating a Car Camera simulator in IoT Edge

Part 3 - Creating a Car Camera simulator in IoT Edge

This is Part 3 in the Iot Edge series, view the main article or go the part 2 to view the previous article. Recap and next steps In part 2 we created our car data simulator that will send data points every second from a CSV file. Next up is