Join us on a literary world trip!
Add this book to bookshelf
Grey
Write a new comment Default profile 50px
Grey
Subscribe to read the full book or read the first pages for free!
I want to read the book!
All characters reduced
Building Modern Data Applications Using Databricks Lakehouse - Develop optimize and monitor data pipelines on Databricks - cover

Building Modern Data Applications Using Databricks Lakehouse - Develop optimize and monitor data pipelines on Databricks

Will Girten

Publisher: Packt Publishing

  • 0
  • 0
  • 0

Summary

With so many tools to choose from in today’s data engineering development stack as well as operational complexity, this often overwhelms data engineers, causing them to spend less time gleaning value from their data and more time maintaining complex data pipelines. Guided by a lead specialist solutions architect at Databricks with 10+ years of experience in data and AI, this book shows you how the Delta Live Tables framework simplifies data pipeline development by allowing you to focus on defining input data sources, transformation logic, and output table destinations.This book gives you an overview of the Delta Lake format, the Databricks Data Intelligence Platform, and the Delta Live Tables framework. It teaches you how to apply data transformations by implementing the Databricks medallion architecture and continuously monitor the data quality of your pipelines. You’ll learn how to handle incoming data using the Databricks Auto Loader feature and automate real-time data processing using Databricks workflows. You’ll master how to recover from runtime errors automatically.By the end of this book, you’ll be able to build a real-time data pipeline from scratch using Delta Live Tables, leverage CI/CD tools to deploy data pipeline changes automatically across deployment environments, and monitor, control, and optimize cloud costs.
Available since: 10/31/2024.
Print length: 246 pages.

Other books that might interest you

  • The Edge of Silence - In Search of the Disappearing Sounds of Nature - cover

    The Edge of Silence - In Search...

    Neil Ansell

    • 0
    • 0
    • 0 
    A journey like no other.
Acclaimed nature writer Neil Ansell has suffered from progressive hearing loss his whole life. As his world is becoming ever more silent, he suddenly hears something quite unexpected – the haunting call of the great northern diver. It is this extraordinary experience which makes him realise that there might still be remarkable sounds in nature within his reach – if he can only find himself in the right place at the right time.
This moving book charts Neil's mission to hear rare and elusive creatures that he had not previously encountered. This journey takes him from the mountaintops and islands of the Scottish Highlands to the marshes of England and the hills of Wales. Many of these species are in grave danger of extinction, so the future Neil faces, devoid of their distinctive calls, is one we all must fight to prevent.
 
LOCATIONS AND AND ANIMALS:
Great northern diver (Nether Lochaber, Scottish Highlands), Ptarmigan (Ardgour, Scottish Highlands), Little Grebe (Ardgour, Scottish Highlands), Bittern (Morecambe Bay, Lancashire), Natterjack toad (The Wirral), Red-throated diver (Ardgour, Scottish Highlands), Corncrake (Coll), Snipe (Coll), Black grouse (North Wales), Greenshank (Ardgour, Scottish Highlands), Puffin (Canna and Sanday), Storm petrel (Mousa, Shetland), Whimbrel (Shetland), Red kite (Perthshire), Otter (Sunart, Scottish Highlands), Manx shearwater (Rum)
    Show book
  • Ring of Fire - High-Stakes Mining in a Lowlands Wilderness - cover

    Ring of Fire - High-Stakes...

    Virginia Heffernan

    • 0
    • 0
    • 0 
    A valuable discovery under the world’s second-largest temperate wetland and in the traditional lands of the Cree and Ojibway casts light on the growing conflict among resource development, environmental stewardship, and Indigenous rights
		 
When prospectors discovered a gigantic crescent of metal deposits under the James Bay Lowlands of northern Canada in 2007, the find touched off a mining rush, lured a major American company to spend fortunes in the remote swamp, and forced politicians to confront their legal duty to consult Indigenous Peoples about development on their traditional territories. But the multibillion-dollar Ring of Fire was all but abandoned when stakeholders failed to reach a consensus on how to develop the cache despite years of negotiations and hundreds of millions of dollars in spending. Now plans for an all-weather road to connect the region to the highway network are reigniting the fireworks.
		 
In this colorful tale, Virginia Heffernan draws on her bush and newsroom experiences to illustrate the complexities of resource development at a time when Indigenous rights are becoming enshrined globally. Ultimately, Heffernan strikes a hopeful note: the Ring of Fire presents an opportunity for Canada to leave behind centuries of plunder and set the global standard for responsible development of minerals critical to the green energy revolution.
    Show book
  • Endocrinology - The Body's Chemical Messengers Hormones and Health - cover

    Endocrinology - The Body's...

    Mike Crawford

    • 0
    • 0
    • 0 
    The endocrine system is a complex network of glands and organs that produce, regulate, and secrete hormones—chemical messengers that influence nearly every physiological process in the body. These hormones control metabolism, growth and development, reproduction, mood, and overall homeostasis. Unlike the nervous system, which relies on rapid electrical signals, the endocrine system operates through the bloodstream, allowing hormones to exert long-lasting effects on target organs and tissues. 
The endocrine system consists of several major glands, each responsible for specific hormone production. The hypothalamus, often referred to as the control center, regulates hormonal signals and maintains communication between the nervous and endocrine systems. It directs the pituitary gland, known as the "master gland," to release hormones that influence other endocrine organs. The thyroid gland regulates metabolism through thyroid hormones, while the parathyroid glands control calcium levels in the blood. The adrenal glands produce cortisol and adrenaline, essential for stress response and energy regulation. The pancreas, an organ with both endocrine and exocrine functions, plays a crucial role in blood sugar regulation through insulin and glucagon secretion. The gonads—testes in males and ovaries in females—produce sex hormones that govern reproductive functions and secondary sexual characteristics. Additionally, the pineal gland regulates sleep-wake cycles through melatonin production.
    Show book
  • Primordium - cover

    Primordium

    Lucas Schrader

    • 0
    • 0
    • 0 
    A New Myth for a New Age!Enjoy the origins of the universe from a new perspective, combining aspects of Christian, Norse, Egyptian, and Greek cosmology.*Primordium, Latin for the first beginning and used in Biology to mean the earliest developmental stage for an organic substructure. These same Latin roots are combined to describe the theoretical swamp where life first began, the primordial soup.
    Show book
  • Touching Cancer - My Journey of Self-Discovery with Oncology Massage - cover

    Touching Cancer - My Journey of...

    Eleanor Oyston

    • 0
    • 0
    • 0 
    We all know someone who has been touched by cancer, but for many diagnosed with the disease, that is where the human touch stops. 
Oncology massage brings us gentle human touch when we are feeling our most vulnerable, safely creating a longed-for sense of peace, wholeness and hope. 
In this must-read book for any practitioner, carer or patient, Eleanor Oyston shares her story of bringing oncology massage to Australia. 
After many years as a scientist, Eleanor went from diagnosing cancer in a lab to massaging clients with a variety of medical conditions. Very quickly, she witnessed the amazing benefits and knew she wanted to spread the word. 
This is Eleanor's story of determination, passion, commitment and vision to give others the gift of compassionate, mindful touch. 
'Cancer is rough. Cancer treatments are brutal. I can't tell you how much oncology massage has helped with my pain and fatigue. I feel less anxious and depressed, and it has improved the quality of the time I have left.As far as I'm concerned, oncology massage is value for money, no argument. Just don't take all the appointment slots!' 
Client at Peter MacCallum Cancer Centre, Melbourne, 2020
    Show book
  • Last Sunset in the West - Britain's Vanishing West Coast Orcas - cover

    Last Sunset in the West -...

    Natalie Sanders

    • 0
    • 0
    • 0 
    Britain has a single pod of orca, also known as killer whales, native to its home waters, although other orca visit from more northern regions. In 2014 Dr Natalie Sanders joined the crew of the HV Silurian to seek them out and study them before we lose them forever. In The Last Sunset in the West she discusses them one by one, and the many issues surrounding their lives in a captivating account that will take the reader deep into the history of our relations with the sentient and beautiful creatures.
    Show book