Join us on a literary world trip!
Add this book to bookshelf
Grey
Write a new comment Default profile 50px
Grey
Subscribe to read the full book or read the first pages for free!
All characters reduced
Apache Airflow Best Practices - A practical guide to orchestrating data workflow with Apache Airflow - cover

Apache Airflow Best Practices - A practical guide to orchestrating data workflow with Apache Airflow

Dylan Intorf, Dylan Storey, Kendrick van Doorn

Publisher: Packt Publishing

  • 0
  • 0
  • 0

Summary

Data professionals face the challenge of managing complex data pipelines, orchestrating workflows across diverse systems, and ensuring scalable, reliable data processing. This definitive guide to mastering Apache Airflow, written by experts in engineering, data strategy, and problem-solving across tech, financial, and life sciences industries, is your key to overcoming these challenges. Covering everything from Airflow fundamentals to advanced topics such as custom plugin development, multi-tenancy, and cloud deployment, this book provides a structured approach to workflow orchestration. You’ll start with an introduction to data orchestration and Apache Airflow 2.x updates, followed by DAG authoring, managing Airflow components, and connecting to external data sources. Through real-world use cases, you’ll learn how to implement ETL pipelines and orchestrate ML workflows in your environment, and scale Airflow for high availability and performance. You’ll also learn how to deploy Airflow in cloud environments, tackle operational considerations for scaling, and apply best practices for CI/CD and monitoring.By the end of this book, you’ll be proficient in operating and using Apache Airflow, authoring high-quality workflows in Python, and making informed decisions crucial for production-ready Airflow implementations.
Available since: 10/31/2024.
Print length: 188 pages.

Other books that might interest you

  • Making Bird-Friendly Birdhouses - Instructions and Plans for 15 Specific Birds Including Bluebirds Wrens Robins & Owl - cover

    Making Bird-Friendly Birdhouses...

    Melvin "Bird Man Mel" Toellner,...

    • 0
    • 1
    • 0
    As popular as birdhouses are, many are designed with aesthetics in mind, rather than the bird's preferences and needs. Not so for the projects in Making Bird-Friendly Birdhouses. Lifelong birder Mel "Bird Man Mel" Toellner and pro woodworker Matt Maguire walk readers step-by-step through 15+ projects for safe birdhouses that birds find conducive to their natural nesting habitats. They begin with a comprehensive introduction to why birdhouses are so important, and why the birdhouses should be created with specific birds in mind like bluebirds, wrens, chickadees, owls and even bats! With additional sections on distribution maps, detailed plans, mounting instructions, and tips on attracting birds to your yard, it has everything you need to create a successful backyard haven for your winged friends.
    Show book
  • Make Your Home a Nature Reserve - cover

    Make Your Home a Nature Reserve

    Donna Mullen

    • 0
    • 1
    • 0
    Bees, butterflies, bats, badgers …
    These beautiful and fascinating creatures need a little help from us, as their natural habitats are under pressure.
    It's time to invite nature into your home – whether it's a window box, a suburban garden or a farm. Learn how to build a pond, make places for bats to roost and spaces for hedgehogs to ramble. Discover the amazing secret lives of Ireland's wildlife, from tiny bugs to large mammals.
    Do try this at home!
    Show book