May 28, 2019

Did I beat Ben? Race tracking with Kafka KSQL, MQTT & Kibana

Did I beat Ben? Race tracking with Kafka KSQL, MQTT & Kibana Live race tracking with MQTT and Kafka streaming. Race statistics using KSQL and visualisations with Kibana. Can I run a half marathon faster than Ben? Kibana dashboard — showing live race analytics Design Overview Runners are tracked with GPS based apps installed on their phones. Location updates are sent (via MQTT) to a central server. Kafka acts as a streaming platform with KSQL performing the live race computations (speed, rank, distance to finish line).

Sep 8, 2018

Machine learning & Kafka KSQL stream processing — bug me when I’ve left the heater on

Machine learning & Kafka KSQL stream processing — bug me when I’ve left the heater on Continuous household power monitoring with a trained model to alert on unexpected power usage for time of day. Let my Google Home and Phone notify me when I’ve used more electricity than expected. What on earth is this? Household power consumption fluctuates throughout the day. However, the *pattern *of electricity use follows a typical curve and becomes predictable after sufficient observations.

Sep 1, 2018

Home Power Monitoring using a Raspberry Pi

Home Power Monitoring using a Raspberry Pi. Home electricity usage monitoring using a Raspberry Pi. Plus some shaky maths to find out when we left the heater on. As we approached the colder months I wanted a way of monitoring our household power consumption. Our electric heaters are fairly ancient, and I had no accurate way of monitoring their cost (either financially or environmentally). I want to know this number!

May 20, 2018

Using KSQL, Apache Kafka, a Raspberry Pi and a software defined radio to find the plane that wakes Snowy the cat

Using KSQL, Apache Kafka, a Raspberry Pi and a software defined radio to find the plane that wakes Snowy the cat Using open-source streaming solutions to map the correlation between aircraft traffic and cat behaviour Aircraft determine their position using GPS; and periodically transmit that position along with identity string, altitude, speed etc as ADS-B signals. Cats behave erratically, but generally display their displeasure by jumping on your face. The post describes how we can use open source streaming solutions (Apache Kafka), KSQL (streaming SQL engine) and a Raspberry Pi to process aircraft movements in real-time to determine which plane is upsetting my cat.