Modern Data Architectures with Python - A practical guide to building and deploying data pipelines data warehouses and data lakes with Python

Lipp Brian

Summary

Modern Data Architectures with Python will teach you how to seamlessly incorporate your machine learning and data science work streams into your open data platforms. You’ll learn how to take your data and create open lakehouses that work with any technology using tried-and-true techniques, including the medallion architecture and Delta Lake.
Starting with the fundamentals, this book will help you build pipelines on Databricks, an open data platform, using SQL and Python. You’ll gain an understanding of notebooks and applications written in Python using standard software engineering tools such as git, pre-commit, Jenkins, and Github. Next, you’ll delve into streaming and batch-based data processing using Apache Spark and Confluent Kafka. As you advance, you’ll learn how to deploy your resources using infrastructure as code and how to automate your workflows and code development. Since any data platform's ability to handle and work with AI and ML is a vital component, you’ll also explore the basics of ML and how to work with modern MLOps tooling. Finally, you’ll get hands-on experience with Apache Spark, one of the key data technologies in today’s market.
By the end of this book, you’ll have amassed a wealth of practical and theoretical knowledge to build, manage, orchestrate, and architect your data ecosystems.

Available since: 09/29/2023.

Print length: 318 pages.

Science & Technology

Other books that might interest you

Controlled Explosions in Mental...

Charlie Heriot-Maitland

Have you ever wondered why your brain self-sabotages? Or why your actions seem self-defeating or destructive? This book explores how our brains have evolved to favor survival over mental well-being—creating "controlled explosions"—and provides practical ways to understand, acknowledge, and diffuse them. 
 
Controlled Explosions in Mental Health identifies everyday scenarios in which one may experience self-destructive behavior such as procrastination or self-criticism. Each chapter guides the listener through key examples of controlled explosions, identifying and exploring their possible functions. Listeners will learn how to identify when one or more of these "explosions" are operating in their lives, recognize the potential harm or difficulties this may cause, and learn practical ways to navigate and overcome. The friendly, accessible narrative, teamed with guided examples to aid self-practice, makes this book the ultimate companion for navigating your mental health. 
 
This book supports the path to self-awareness, helping the listener take control of their own struggles with insight, care, and compassion. It's a must-have for any listener looking to better understand their mental health and wellbeing.

Show book

Metaverse for Beginners: The...

Donn Newman

If you want to be one step ahead and avoid missing out on the next big thing, then pay attention… 
Are you ready for the next evolution of the internet? 
Do you want to get involved in the Metaverse craze but don’t know where to start? 
Have you been dabbling in this space for a while, but you still feel like you’re missing something? 
Mark Zuckerberg, CEO of Facebook, believes the internet is – or will eventually become – a type of “Metaverse” that people can use for various purposes. The truth is, the term “Metaverse” refers to a very complex concept that is difficult to summarize. 
In this audiobook, you’ll:Explore the history of the MetaverseUnderstand what a Metaverse is under its many definitionsLearn all about different technologies that can be used to create a MetaverseLearn about the benefits and risks of investing in the MetaverseDiscover how cryptocurrency and NFTs play into the MetaverseMaster how to make money in the MetaverseUnderstand how the Metaverse will affect your future 
To be a part of the future, it’s important to stay educated on the latest and most innovative trends. Whether you choose to invest, build something in the Metaverse or just keep your eye on it from the sidelines, this audiobook is perfect for those wanting to know more about the phenomenon. 
Click the “add to cart” button now and venture into the world of the Metaverse.

Show book

Summary: Why We Sleep -...

Brooks Bryant

Disclaimer: This is not the official book, but a summary & it does not accompany the official.
The book takes readers on a journey through the intricacies of the sleeping mind, exploring the various sleep stages and the distinct purposes they serve. Walker doesn't just stop at illustrating the beneficial aspects of good sleep; he sheds light on the perilous path that chronic sleep deprivation can lead individuals down, impacting everything from memory retention to the immune system.
By amalgamating scientific research with accessible narratives, the book unravels the complex relationship between sleep and a host of other factors including diet, exercise, and mental health. It explains how sleep can dictate emotional well-being, decision-making, and even the predisposition to diseases such as Alzheimer's and cancer.
In a society where sleep deprivation is often worn as a badge of honor, "Why We Sleep" issues a clarion call to re-evaluate our approach to sleep. Walker provides a comprehensive overview of the latest findings in sleep science, effectively dismissing myths and misconceptions that have long surrounded this essential biological function. He offers practical advice on how to nurture sleep, enhancing its quality and, consequently, improving overall health and well-being.
As you summarize this groundbreaking book, emphasize the indispensable role of sleep that the author underlines through a spectrum of scientific facts and real-life examples. Illustrate how the book serves as both a wake-up call and a guide, encouraging readers to foster healthier sleep habits to unlock a more fulfilling and healthier life.

Show book

The Farmer's Code - How Legacies...

Mike C. Young

The Farmer’s Code takes you on a hero’s journey of self-development. It follows a path of transformation and growth to help you become your true, highest self. This journey will lead to a greater understanding of the self and a deeper connection to one’s own values and core principles, which paves the way for a long-lasting legacy. Legacies provide a roadmap for future generations, showing those who follow your footsteps what is possible as they strive to reach their full potential. Filled with personal stories of the struggles and triumphs of one American farming family, the Code shows how legacies are about more than just personal fulfillment. They can have a profound impact on the lives of others by serving as a guiding light to those who are seeking a better way to live. Just as airline passengers are instructed to see to their own oxygen masks first in the event of an emergency before helping others, legacy building has to start with the self. When you are safe, secure, and strong, you are in a much better position to turn outward to help others. It is then that you can help address societal challenges, advance knowledge and innovation, promote social change, or support the important causes you see in your community. The Farmer’s Code should spark aspirations, ignite passion, and encourage everyone to strive for greatness. By considering the lasting impact you can make, you will be able to live more purposefully and leave a more positive imprint on the world.

Show book

ISO 22301: 2019 - An...

Alan Calder

In an increasingly volatile world, exemplified by the 2020 COVID-19 pandemic, organisations are looking at business continuity with a fresh perspective. While most organisations believe they are prepared for disruption, COVID-19 has proved otherwise. The need for business continuity has never been clearer.
If you were hit by a cyber attack and lost the use of your IT systems, would you be able to carry on? If your business premises were forced to close, what would you do? If you were affected by unexpected staff absence, how could you reassure your customers that you can still offer them the service they expect?
Being unprepared can lead to financial and reputational damage, which could prove disastrous. You could fail to keep up with customer demand or lose important business, or your customers could go elsewhere. Without a proper risk assessment strategy, your company directors could even face prosecution if a major incident occurs and results in loss or injury.
An introduction to ISO 22301
To minimise the impact of a disaster on your business, and to continue to provide essential services to your customers, you need to put in place a BCMS (business continuity management system). This pocket guide will help you understand the basics of business continuity and ISO 22301:2019, the international standard that describes the specification for a BCMS.
It covers:

- What business continuity is;
- Key terms and definitions;
- A brief history of business continuity management;
- The BCMS;
- ISO 22301 BCMS requirements; and
- CertificationISO 22301:2019 - An introduction to a business continuity management system (BCMS) provides an easy-to-read and straightforward introduction to a BCMS that business continuity managers, compliance managers, C-suites and disaster recovery planners – or any organisation implementing, or considering implementing, an ISO 22301 BCMS – will find valuable.

Show book

Decoding Animal Minds - Bridging...

John Harpoon

The question of whether animals possess consciousness has intrigued philosophers, scientists, and animal lovers for centuries. Consciousness, often described as the awareness of one's thoughts, feelings, and surroundings, is a concept that has been challenging to define, even in humans. When applied to animals, the puzzle becomes even more complex, as humans must contend with species whose mental processes are vastly different, yet still intriguing. 
For much of history, animals were thought to be little more than instinctual beings, driven by basic needs and lacking the higher cognitive functions attributed to humans. Early philosophers, such as René Descartes, even went so far as to declare that animals were mere automata, incapable of experiencing consciousness or complex thoughts. This perspective began to shift, however, with the growing body of research into animal behavior and cognition, which showed that many animals exhibit problem-solving skills, emotional responses, and even a sense of self. 
Theories of animal intelligence have evolved over time, with a growing recognition that animal minds are not simply mechanical, but can possess depth and complexity. Cognitive ethology, the study of animal minds in their natural environments, emphasizes that animals may experience the world in ways similar to humans, but with distinct differences shaped by their evolutionary paths. From elephants who demonstrate clear evidence of grief, to dolphins that engage in sophisticated social interactions, the evidence suggests that animals may possess emotional and cognitive layers far more intricate than previously imagined.

Show book