Kafka, for your data pipeline? Why not?

Create a streaming pipeline using Docker, Kafka, and Kafka Connect

Kafka was developed and open-sourced by LinkedIn in 2011, and it has since quickly evolved from messaging queue to a full-fledged streaming platform with an exuberant ecosystem. Many tech companies, besides LinkedIn such as Airbnb, Spotify, or Twitter, use Kafka for their mission-critical applications.

Build your first data warehouse with Airflow on GCP

What are the steps in building a data warehouse? What cloud technology should you use? How to use Airflow to orchestrate your pipeline?

Airflow has grown to be an essential part of my toolset as a data professional. After my previous post, many people reached out to me, asking about how to get started learning Airflow. As with many things else, I believe that the best way to get started learning something is by doing.

These are unprecedented times…

This pandemic is unlike any other ones before it, we all are affected in one way or the other. Even my parents told me that they have never witnessed anything like this before in their lives.

Here are some of my thoughts living through the strangest time so far in my life.

Pagination


© 2023. All rights reserved.

Powered by Hydejack v8.5.0