in Blog
Create a streaming pipeline using Docker, Kafka, and Kafka Connect
Kafka was developed and open-sourced by LinkedIn in 2011, and it has since quickly evolved from messaging queue to a full-fledged streaming platform with an exuberant ecosystem. Many tech companies, besides LinkedIn such as Airbnb, Spotify, or Twitter, use Kafka for their mission-critical applications.
in Blog
What are the steps in building a data warehouse? What cloud technology should you use? How to use Airflow to orchestrate your pipeline?
Airflow has grown to be an essential part of my toolset as a data professional. After my previous post, many people reached out to me, asking about how to get started learning Airflow. As with many things else, I believe that the best way to get started learning something is by doing.
in Blog
Airflow has been around for a while, but it has gained a lot of traction lately. So what is Airflow? How can you use it? And how to set it up locally and remotely?
in Blog
This pandemic is unlike any other ones before it, we all are affected in one way or the other. Even my parents told me that they have never witnessed anything like this before in their lives.
Here are some of my thoughts living through the strangest time so far in my life.
in Blog
Three things I have learned from trying to be more competitive.
How to utilize Jupyter Notebook to manage your SQL queries better.
I’m a computer geek, a data guru, a cloud advocate, an amateur astronomer & physicist, a writer, and a bookworm. Welcome to my blog!