Sign in Subscribe

Artificial Intelligence

Running ONNX with onnruntime on your M1 Mac

Running ONNX with onnruntime on your M1 Mac

When wanting to work with AI models on my latest Macbook Pro 2021 with M1 Architecture, I received the following error while running pip install onnxruntime: ERROR: Could not find a version that satisfies the requirement onnxruntime>=1.10.0 (from tinx) (from versions: none) After doing some research,

Enabling Serverless AI with Azure Container Apps and Dapr

Enabling Serverless AI with Azure Container Apps and Dapr

In my previous post I explained how you can get started with Container Apps. The one missing piece of that puzzle is how you can utilize a queue behind to dynamically scale your workload based on items in a queue! This has been one my most difficult blog items so

AI Model Inferencing with ONNX on GPU (CUDA)

AI Model Inferencing with ONNX on GPU (CUDA)

Recently I've been working a lot with different AI Models for a variety of use cases, ranging from simple object classification to massive crowd counting models. While working with these models, I saw that it is always difficult to implement a model in custom code since the Architecture

Running your AI Workload through Azure Container Apps

Running your AI Workload through Azure Container Apps

For a new project I am working on, I am utilizing a Queuing architecture where jobs come in and a cluster of containers is processing work on this queue. Each job takes an item from a queue, runs the item through its AI pipeline and spits out a JSON response.

Enabling CUDA with PyTorch on Nvidia Jetson and Python 3.9

Enabling CUDA with PyTorch on Nvidia Jetson and Python 3.9

For a use case I wanted to utilize the Nvidia Jetson for edge inference. One of the bottlenecks here was that my software required a Python version that is greater than 3.6. When looking at the Nvidia Jetson packages for PyTorch it was seen that this was only created

Machine Teaching through Azure Project Bonsai - Series Overview

Machine Teaching through Azure Project Bonsai - Series Overview

Autonomous Platforms are being deployed all around us, optimizing our daily processes and improving their efficiency and stability without the need of human intelligence. They learn by themself, iteratively improving themselves and staying ahead of the competition. One of the biggest hurdles for Autonomous Platforms to be deployed is the

Azure Project Bonsai - Physical CartPole Project

Azure Project Bonsai - Physical CartPole Project

In my previous post I revisited the Bonsai platform. Now it's time to actually start preparing to put it into production! (this will become more clearer over time 😉) To start off with a spoiler: Project Bonsai - It's impressive! 😎 Everything in this article is the result