Join us on a literary world trip!
Add this book to bookshelf
Grey
Write a new comment Default profile 50px
Grey
Subscribe to read the full book or read the first pages for free!
All characters reduced
Building Modern Data Applications Using Databricks Lakehouse - Develop optimize and monitor data pipelines on Databricks - cover

Building Modern Data Applications Using Databricks Lakehouse - Develop optimize and monitor data pipelines on Databricks

Will Girten

Publisher: Packt Publishing

  • 0
  • 0
  • 0

Summary

With so many tools to choose from in today’s data engineering development stack as well as operational complexity, this often overwhelms data engineers, causing them to spend less time gleaning value from their data and more time maintaining complex data pipelines. Guided by a lead specialist solutions architect at Databricks with 10+ years of experience in data and AI, this book shows you how the Delta Live Tables framework simplifies data pipeline development by allowing you to focus on defining input data sources, transformation logic, and output table destinations.This book gives you an overview of the Delta Lake format, the Databricks Data Intelligence Platform, and the Delta Live Tables framework. It teaches you how to apply data transformations by implementing the Databricks medallion architecture and continuously monitor the data quality of your pipelines. You’ll learn how to handle incoming data using the Databricks Auto Loader feature and automate real-time data processing using Databricks workflows. You’ll master how to recover from runtime errors automatically.By the end of this book, you’ll be able to build a real-time data pipeline from scratch using Delta Live Tables, leverage CI/CD tools to deploy data pipeline changes automatically across deployment environments, and monitor, control, and optimize cloud costs.
Available since: 10/31/2024.
Print length: 246 pages.

Other books that might interest you

  • Make Money with Podcasting - Turn Your Passion into Profit - cover

    Make Money with Podcasting -...

    Oliver Villaverde

    • 0
    • 0
    • 0
    Dreaming of a podcast that not only shares your passion but also pads your wallet? "Make Money with Podcasting" is your roadmap to success. From crafting compelling content to mastering monetization strategies, this book gives you the tools to launch, grow, and profit from your podcast. Plus, join our exclusive community for support and inspiration
    Show book
  • Database Design for Beginners - Mastering the Foundations of Efficient Data Management and Modeling - cover

    Database Design for Beginners -...

    Vincent Berry

    • 0
    • 0
    • 0
    Diving into the world of databases can be overwhelming, but "Database Design for Beginners: Mastering the Foundations of Efficient Data Management and Modeling" serves as your comprehensive guide to understanding the core principles and methodologies of effective database design. This book is crafted for beginners, aiming to transform novices into knowledgeable practitioners capable of designing databases that are both efficient and scalable. 
    From the fundamentals of relational database management systems (RDBMS) to the intricacies of data normalization and SQL, this book covers essential concepts in a clear and approachable manner. It begins with an introduction to database systems, explaining the importance of databases in today’s data-driven world and providing a historical perspective on the evolution of database technology. 
    As you progress, you'll delve into the specifics of data modeling, learning how to create logical and physical designs that accurately represent business requirements. The book demystifies complex topics such as entity-relationship (ER) modeling, normalization, and transaction management, breaking them down into easy-to-understand lessons. 
    "Database Design for Beginners" also includes practical exercises and real-world examples to apply what you’ve learned. You'll be guided through the process of designing your own database, from conceptualization to implementation, using popular RDBMS software like MySQL and PostgreSQL. 
    Moreover, this book addresses modern challenges in database design, including handling big data, cloud database systems, and the basics of NoSQL databases, preparing readers for the future of data management. 
    "Database Design for Beginners: Mastering the Foundations of Efficient Data Management and Modeling" is your first step towards mastering this crucial field in computer science.
    Show book
  • Digital Declutter - Breaking Free from Screen Addiction - cover

    Digital Declutter - Breaking...

    Nura Uba

    • 0
    • 0
    • 0
    In today’s hyperconnected world, our screens demand more of our attention than ever before stealing our time, draining our focus, and quietly shaping our lives. Digital Declutter: Breaking Free from Screen Addiction is your guide to taking back control. 
    This audiobook offers a practical and empowering path from digital overwhelm to intentional living. You’ll discover how to identify hidden triggers, set healthy boundaries, and replace endless scrolling with purposeful habits that support your productivity, relationships, and well-being. 
    With clear strategies, real-life insights, and actionable steps, you’ll learn how to silence distractions, reduce dependency on devices, and reclaim your time for what truly matters. Whether you struggle with social media, constant notifications, or the pressure to always be “online,” this audiobook will help you break free. 
    Digital Declutter isn’t about rejecting technology it’s about using it with clarity and balance. By the end, you’ll not only feel lighter and more focused, but you’ll also have the tools to design a healthier relationship with your digital world. 
    Take the first step toward freedom from screen addiction and create space for the life you’ve been missing.
    Show book
  • The Palestine Laboratory - How Israel Exports the Technology of Occupation Around the World - cover

    The Palestine Laboratory - How...

    Antony Loewenstein

    • 0
    • 0
    • 0
    ** Winner of the 2023 Walkley Book Award for Non-fiction Journalism ** 
    ** Shortlisted for the 2023 Moore Prize for Human Rights Writing ** 
    Israel’s military industrial complex uses the occupied, Palestinian territories as a testing ground for weaponry and surveillance technology that they then export around the world to despots and democracies. For more than 50 years, occupation of the West Bank and Gaza has given the Israeli state invaluable experience in controlling an “enemy” population, the Palestinians. It’s here that they have perfected the architecture of control. 
     
    Best-selling journalist Antony Loewenstein, author of Disaster Capitalism, uncovers this largely hidden world in a global investigation with secret documents, revealing interviews and on-the-ground reporting. This book shows in-depth, for the first time, how Palestine has become the perfect laboratory for the Israeli military-techno complex: surveillance, home demolitions, indefinite incarceration and brutality to the hi-tech tools that drive the 'Start-up Nation'. From the Pegasus software that hacked Jeff Bezos' and Jamal Khashoggi’s phones, the weapons sold to the Myanmar army that has murdered thousands of Rohingyas and drones used by the European Union to monitor refugees in the Mediterranean who are left to drown.  
    Israel has become a global leader in spying technology and defence hardware that fuels the globe’s most brutal conflicts. As ethno-nationalism grows in the 21st century, Israel has built the ultimate model. 
    “A sad and sordid record of how "the light unto the nations" became the purveyor of the means of violence and brutal repression from Guatemala to Myanmar and wherever else the opportunity arose.” - Noam Chomsky 
    “A sharp exposé of how Israel's suppression of Palestine has translated into lucrative anti-terrorist systems that the Israeli government exports globally...[An] eye-opening delineation of the alarming ramifications of Israel's status as an 'ethnonationalist state.” - Kirkus Reviews
    Show book
  • Agile Basics in 60 Minutes - cover

    Agile Basics in 60 Minutes

    Tom Henricksen

    • 0
    • 0
    • 0
    This book will give you the Agile Framework basics in only 60 minutes. We cover all the fundamentals of Agile Framework from a Certified Scrum Master.
    Show book
  • When the City Stopped - Stories from New York's Essential Workers - cover

    When the City Stopped - Stories...

    Robert W. Snyder

    • 0
    • 0
    • 0
    In When the City Stopped, Robert Snyder tells the story of COVID-19 in the words of ordinary New Yorkers, illuminating the fear and uncertainty of life in the early weeks and months, as well as the solidarity that sustained the city. New Yorkers were "alone together," separated by the protective measures of social distancing and the fundamental inequalities of life and work in New York City. Through their personal accounts, we see that while many worked from home, others knowingly exposed themselves to the dangers of the pandemic as they drove buses, ran subways, answered 911 calls, tended to the sick, and made and delivered meals. 
     
     
     
    Snyder builds bridges of knowledge and empathy between those who bore dangerous burdens and those who lived in relative safety. The story is told through the words of health care workers, grocery clerks, transit workers, and community activists who recount their experiences in poems, first-person narratives, and interviews. When the City Stopped preserves for future generations what it was like to be in New York when it was at the center of the pandemic.
    Show book