Incremental Delta Copying from SQL Server to Apache Iceberg Learn how you can load data from SQL Server to Apache Iceberg in an incremental way.
Big Data Platform Comparisons Choosing a platform for doing your Big Data processing tasks is not an easy choice. At one side you want to be flexible and open, but at another you would like a stable and robust platform that can handle your critical business workloads. This is the reason that I decided
Sampling a real-time stream A common problem when working with real-time streams is that you are unaware of the data going in there due to the vast amount of systems connected to it and producing data. Therefor it is interesting to be able to "sample" a stream, where you will connect to
Creating a Big Data cluster with SQL Server 2019 SQL Server 2019 came out in preview a while ago, and the new features announced are just wonderful! A one-to-go-tool for all your big data needs: Unstructured and Structured data that can be processed using just one tool! But the most wonderful feature of all in my opinion are the
Building a Minecraft Puppet Scanner with Event Hub, a NFC 522 Reader and a Raspberry PI In Belgium we every year celebrate the coming of "Sinterklaas" on the 6th of December, a celebration for children where this mythologic figure delivers presents for all the children that behaved well that year. (see: https://en.wikipedia.org/wiki/Sinterklaas for more information). To follow this tradition,
Big Data, the why, how and what - A thought Process and Architecture One of the most common questions I get when talking with customers, is how they are able to set up a good big data architecture that will allow them to process all their existing data. With as an ultimate goal to perform advanced analytics and AI on top of it,
Building a real-time streaming dashboard with Spark, Grafana, Chronograf and InfluxDB When you work with the Internet of Things (IoT) or other real-time data sources, there is one things that keeps bothering you, and that's a real-time visualization dashboard. So in this post, I will explain how you can set up a pipeline that allows you to visualize through