Part 3. Airflow in practice

Now that you’ve learned how to build complex pipelines, let’s start using them in production! To help you get started, part 3 discusses several topics in using Airflow in production.

First, chapter 11 reviews some of the practices we’ve seen for implementing pipelines and highlights several best practices that should help you build efficient and maintainable pipelines.

Chapter 12 and 13 dive into details to consider for running Airflow in a production setting. Chapter 12 describes how to deploy Airflow, touching on topics such as architectures for scaling Airflow, monitoring, logging, and alerting. Chapter 13 focuses specifically on securing Airflow to avoid unwanted access and minimizing the impact of security breaches.

Finally, chapter 14 ties all previous chapters together in a summary use case.

After completing part 3, you should be able to write efficient and maintainable pipelines in Airflow. You should also have a good idea of how to deploy Airflow and which implementation details to consider for a robust and secure deployment.

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
3.16.212.99