Azure Databricks and Spark @ Techorama '18

AI, Amplifying human ingenuity through Intelligent Technology @ Big Data Expo '18

@WesleyBackelant and I spoke at the first edition of BigData-expo.be on AI and some of it’s Ethical challenges, as well as the Microsoft AI platform.

Interview in Tweakers.net on AI & Ethics

An interview on AI with @WesleyBackelant and me was published at tweakers.net [Dutch]. BigData-expo.be arranged for us to do an interview, to give some extra background to our presentation on AI and Ethics.

Announcing EventHubs ReIngest

When building a Kappa Architecture replaying historic events is an important property of the system. EventHub and IoTHub support EventHub Capture a way to automatically archive all incoming messages on Azure Blob or Azure Data Lake Store, this takes care of the archiving part. To replay those messages back onto an EventHub (preferably a different one!) I created nathan-gs/eventhubs-reingest, a Spark based application that reads the Avro messages, sorts, repartitions (by random chance) and writes them as fast as possible to EventHub.

OneDrive on NixOS using Docker

My NAS is a Atom based Thecus running NixOS. NixOS is a Linux distribution with a functional, as in functional programming, approach to package and configuration management. It contains many packages and services. In most cases enabling a new service is as easy as adding services.openssh.enable = true to /etc/nixos/configuration.nix.
Unfortunately skilion/onedrive, a D-lang based OneDrive client, is not available on NixOS and building it required a different version of the DMD compiler.
I was a bit lazy and also wanted to experiment with docker on NixOS so I decided to run skilion/onedrive as docker container on NixOS.