Leverage Machine Learning to defend against DDoS Manual identification and mitigation of (DDoS) attacks on websites is a difficult and time-consuming task with many challenges. This is where Baskerville comes in. Baskerville is an open-source Security Analytics Engine, a system to identify the attacks (currently) directed to Deflect protected websites as they happen and give the infrastructure…

Time to check your spark clusters — It is well known — or should be — that spark is not secured by default. It is right there in the docs Security in Spark is OFF by default So you should be well aware that you’ll need to put the effort to secure your cluster. And there are…

Research and awareness needed TL;DR It seems that more and more people are agreeing that G6PDd can be a risk factor for COVID-19, not only in terms of the medication that is used to combat the virus, but regarding one’s susceptibility to the virus and the severity of its side-effects…

Lessons learned — So, after a few runs with the PySpark ml implementation of Isolation Forest presented here, I stumbled upon a couple of things and I thought I’d write about them so that you don’t waste the time I wasted troubleshooting. Only Dense Vectors In the previous article, I used VectorAssembler to gather the feature…

How to leverage spark to read in parallel from a database — A usual way to read from a database, e.g. Postgres, using spark would be something like the following: However, by running this, you will notice that the spark application has only one task active, which means, only one core is being used and this one task will try to…