All you will read here is personal opinion or lack of knowledge :) Please feel free to contact me for fixing incorrect parts. In previous blogposts I have described how to setup environment for Kubernetes and how to auto scale Standalone Spark. In this post let’s have a look on…

All you will read here is personal opinion or lack of knowledge :) Please feel free to contact me for fixing incorrect parts. If you’re in this blogpost — most probably you know what Apache Spark and K8s is. Probably the most exciting feature which is possible under Kubernetes is…

All you will read here is personal opinion or lack of knowledge :) Please feel free to contact me for fixing incorrect parts. In order to start working with Spark on Kubernetes first step is to prepare sandbox. In my case I’m using Windows 10 based machine with Hyper-V. …

All you will read here is personal opinion or lack of knowledge :) Please feel free to contact me for fixing incorrect parts. As data engineer who is passionated about Apache Spark I decided to compare different and similar open-source projects like Delta, Hudi and Iceberg. The idea is simple…