Data observability is so hot right now...but do you know what's also hot? Using some tried and tested ingredients like Apache Airflow and PyOD to perform painless anomaly detection on your key business metrics. You don't need to run off and buy an (expensive!) subscription for the latest hot data observability Sass offering (there is … Continue reading Painless Anomaly Detection with Apache Airflow
Category: anomaly-detection
Explaining kmeans clustering for unsupervised anomaly detection
Here is a video I did in work explaining how our anomaly detection works. https://www.youtube.com/watch?v=L1xleckyuDQ https://www.netdata.cloud/blog/how-netdatas-machine-learning-works
Some ML hot takes
Here is a blog post I made in work with some thoughts on the approach to ML that I want us to try take: https://www.netdata.cloud/blog/our-approach-to-machine-learning
Time series anomaly detection using PCA
Here is a little recipe for using good old PCA to do some fast and efficient time series anomaly detection.
Anomaly Detection using the Matrix Profile
I like an excuse to play with fancy things, so when i first learned about the Matrix Profile for time series analysis, particularly around anomaly detection, i was intrigued. When i learned there was a nice python package (STUMPY) i could just pip install i was outright excited, as one thing i like more than … Continue reading Anomaly Detection using the Matrix Profile
Time series anomaly detection in Go using GoLearn
Output of the Go script. I've posted recently about learning just enough Go to be dangerous over the christmas break, well here is a update on my adventures so far. The below script (which is probably horrible in places if you know Go properly - tips welcome) uses goroutines to pull data from some REST … Continue reading Time series anomaly detection in Go using GoLearn
Anomaly Detection Resources
A list of useful Anomaly Detection resources, as I find interesting material I will add to this list. - "Awesome" time series anomaly detection list of GitHub. - YouTube playlist of interesting anomaly detection videos I maintain. - Creator of PyOD "yzhao062/anomaly-detection-resources" list of useful stuff. - An interesting r/machinelearning thread. - Public Mendeley group … Continue reading Anomaly Detection Resources
Anomaly Detection Tutorial
always use a meme to kick off a tutorial Here is an anomaly detection tutorial that i created for my boss and the open source community where i work. It's part of some work i have been doing around adding some anomaly detection functionality into our open source monitoring project. Like most ML projects the … Continue reading Anomaly Detection Tutorial
Different types of time series anomalies
I find myself having to refer to this enough times that I decided to make a little infographic I can just more easily link to 🙂
I helped build a thing!
don't mind if i do Here is a thing i helped build in work that i'm fairly happy with: https://www.linkedin.com/posts/andrewm4894_netdata-introducing-our-first-netdata-cloud-activity-6712008465574887424-SlIr Now, onto the next thing!