engineering
-
What is the best data compression for data lakes? (with benchmark!)
Every time that I’m in a project starting a data lake or storing some information in a blob storage like S3, I start to think about a few basic things. Such as: And much more. Data engineers can spend hours debating those topics but one…
-
How to Start in Data Engineering?
I started to work with data a few years ago, messing with databases and SQL while building dashboards for my boss to report in some meetings. One thing that I noticed was how hard it was to get quality data at a decent frequency. I…