How to improve Airflow 2.0 performance with Smart Sensors?
Compare Azure Data Factory and Apache Airflow: source integration, workflow management, data transformation, and scheduling flexibility for your needs.
Author
Mikolaj Klepacz
Mikołaj is a Data Engineer experienced in many Big Data related tools such as Apache Beam, Airflow, Hadoop and Spark. He is no stranger to cloud technologies as he is a 2x Certified Google Cloud Professional and has gained experience working in multiple GCP projects. Always working on improving his clean code writing skills in python. In his free time, he likes travelling and watching NBA basketball.
- 3
Articles
First article
Latest article
Areas of expertise
- DevOps
- Data Engineering
Articles by Mikolaj Klepacz
Create declarative ETL pipelines in Databricks with Delta Live Tables
Delta Live Tables brings declarative ETL pipelines to Databricks: you define the target data state, DLT handles orchestration, quality and monitoring.
Google Cloud cost management - how to save money on your infrastructure?
How Google Cloud billing works and how cost management tools like dashboards and cost breakdowns help you control and cut infrastructure spend.