Join us on a literary world trip!
Add this book to bookshelf
Grey
Write a new comment Default profile 50px
Grey
Subscribe to read the full book or read the first pages for free!
I want to read the book!
All characters reduced
Data Engineering with Databricks Cookbook - Build effective data and AI solutions using Apache Spark Databricks and Delta Lake - cover

Data Engineering with Databricks Cookbook - Build effective data and AI solutions using Apache Spark Databricks and Delta Lake

Pulkit Chadha

Publisher: Packt Publishing

  • 0
  • 0
  • 0

Summary

Written by a Senior Solutions Architect at Databricks, Data Engineering with Databricks Cookbook will show you how to effectively use Apache Spark, Delta Lake, and Databricks for data engineering, starting with comprehensive introduction to data ingestion and loading with Apache Spark.
What makes this book unique is its recipe-based approach, which will help you put your knowledge to use straight away and tackle common problems. You’ll be introduced to various data manipulation and data transformation solutions that can be applied to data, find out how to manage and optimize Delta tables, and get to grips with ingesting and processing streaming data. The book will also show you how to improve the performance problems of Apache Spark apps and Delta Lake. Advanced recipes later in the book will teach you how to use Databricks to implement DataOps and DevOps practices, as well as how to orchestrate and schedule data pipelines using Databricks Workflows. You’ll also go through the full process of setup and configuration of the Unity Catalog for data governance.
By the end of this book, you’ll be well-versed in building reliable and scalable data pipelines using modern data engineering technologies.
Available since: 05/31/2024.
Print length: 438 pages.

Other books that might interest you

  • Big Data Processing for Beginners - A Step-by-Step Guide to Mastering Big Data Analytics - cover

    Big Data Processing for...

    Brian Paul

    • 0
    • 0
    • 0 
    In the age of information, understanding the vast universe of big data and analytics is no longer a luxury but a necessity. "Big Data and Analytics for Beginners: Navigating the World of Data-Driven Decision Making" is a comprehensive guide designed to usher beginners into the expansive world of big data, equipping them with the essential knowledge and tools to navigate this rapidly evolving field. 
This book demystifies the concept of big data, exploring its origins, fundamental principles, and the various types of data that organizations encounter. Readers will gain a solid grasp of big data technologies, including an introduction to databases, storage solutions, and data processing frameworks essential for managing and analyzing large datasets. 
Data analytics lies at the heart of big data, and this book delves deep into its various types—descriptive, diagnostic, predictive, and prescriptive—providing a clear understanding of how each type contributes to data-driven decision-making. The exploration of data analytics tools and techniques is practical and accessible, ensuring readers can grasp the concepts regardless of their technical background. 
With data visualization playing a crucial role in interpreting data, the book offers insights into effective visualization techniques and tools, empowering readers to present data in meaningful and impactful ways. 
Accompanied by a glossary of key terms and additional resources for extended learning, this book is an invaluable resource for anyone beginning their journey into the world of big data and analytics. Whether you are a student, professional, or just a curious mind, "Big Data and Analytics for Beginners" offers a clear, engaging, and comprehensive pathway to understanding and leveraging the power of data in the modern world.
    Show book
  • Quantum Gravity Made Simple - Fundamentals of Quantum Gravity In Everyday Language - cover

    Quantum Gravity Made Simple -...

    Turing Editorial Team

    • 0
    • 0
    • 0 
    This is short audiobook on Everything You Should Know About Quantum Gravity, the search for the missing theory that could finally make the very large and the very small speak the same language. 
Why do our two best theories of reality stop working when we need them most? 
Einstein taught us that gravity is the bending of space and time. Quantum mechanics taught us that the tiny world is uncertain, jumpy, and deeply strange. Both theories work beautifully until we ask what happened at the Big Bang or what lies inside a black hole. 
Then the math breaks. 
This audiobook explores the great unfinished problem in physics: is spacetime smooth, or is it built from something deeper? Is gravity a force, a particle, a web of information, or something that emerges from hidden quantum connections? 
For decades, quantum gravity seemed impossible to test. The energies were too high, the distances too tiny, the signals too weak. But now scientists are asking a surprising question: do we need a galaxy-sized machine, or can gravity’s quantum nature be caught on a tabletop? 
The audiobook follows new experiments that try to use tiny masses, extreme isolation, and quantum entanglement to ask whether gravity itself obeys quantum rules.
    Show book
  • Secrets of the Sea - The story of New Zealand's native sea creatures - cover

    Secrets of the Sea - The story...

    Robert Vennell

    • 0
    • 0
    • 0 
    **SHORTLISTED FOR THE OCKHAM NZ BOOK AWARD BEST ILLUSTRATED BOOK OF NONFICTION** 
An illuminating tour through the native sea creatures of Aotearoa, by the bestselling author of The Meaning of Trees 
 
  
Secrets of the Sea is a fascinating introduction to New Zealand's fish and shellfish, weaving together history, biology and culture to reveal how these unique and intriguing creatures have shaped our lives. Ranging from sandy shores and rocky reefs to the open ocean and its cavernous depths, Robert Vennell celebrates the magic and mystery of the world beneath the waves. 
Lavishly illustrated with stunning photographs and fascinating historical illustrations. 
** 
'Steeped in history and tradition, Secrets of the Sea is a standout ... gorgeously illustrated, and with stunning photography, Secrets of the Sea is a resplendent unravelling of the mysteries surrounding some of the incredible inhabitants of Aotearoa waters' Jo Lucre, Wellington Regional News 
'Secrets of the Sea is a treasury of interesting facts, beautiful photography and remarkable prose. Beyond the luscious illustrations is a perfect blend of science, history and mātauranga Māori that gives the text depth and relevance and reveals in fascinating (and urgent) ways the interconnectedness of the human and extra human world. Visually compelling and hugely accessible, this impactful book will delight the marine biologist, sea aficionado and general reader alike.' New Zealand Book Awards Trust, Ockham shortlist for Best Illustrated Book of Nonfiction
    Show book
  • Teaching Primary Programming with Scratch Pupil Book Year 5 - cover

    Teaching Primary Programming...

    Phil Bagge

    • 0
    • 0
    • 0 
    Scratch teaching and learning made easy thanks to up-to-date, classroom-tested methodologies. Draws on the expertise of Code-IT and HIAS.
    Show book
  • Living with Epilepsy - An audiobook about living with epilepsy - cover

    Living with Epilepsy - An...

    Edmonton Epilepsy Association

    • 0
    • 0
    • 0 
    This audiobook is designed to provide general information about Epilepsy to the public. It does not include specific medical advice. People with epilepsy should not make changes based on this information. Always consult your physician prior to making any changes. 
    Show book
  • Opioid Drug and Alcohol Abuse - cover

    Opioid Drug and Alcohol Abuse

    Miranda M Hill Jones Pharm D J D

    • 0
    • 0
    • 0 
    This manuscript is about educating parents and youth on the safe and proper use of medications to avoid the potential dangers of prescription and substance drug abuse and misuse. The author was inspired to write this book in an effort to help parents and teenage youth, particularly adolescents (12 to 17 year-olds) about the dangers of abusing opioid prescription drugs, substances, and alcohol. In this book the reader will learn to define and describe patterns of prescription (opioid) drug and alcohol abuse while identifying the commonly abused prescription drugs and reasons for abuse in a solution focused approach to educating, preventing and treating prescription ( opioid) drug, alcohol, and other substances use disorders. The author addresses America's struggles with the epidemic of drug substance and alcohol addiction, and how important it is for families to be able to break the feeling of isolation, by connecting with community resources, and by having access to drug education, information, and services that promote health and wellness. The author, believes in assessing the "root cause" of substance use, pain and other underline health issues in order to develop an appropriate plan of action to problem solve the health or pain issues. She also believes in collaboratively referring patients and clients to pain specialists, psychotherapists or detox centers for evaluation. Dr. Miranda believes that as a society we must have understanding and patience. Thus, this book is a valuable resource for relatives, friends, or neighbors of youth who are or were addicts to drug or substances, as well as those who have died from drug or substance abuse. This is an excellent read for those who want to be a help for hope and healing! Dr. Miranda M. Hill Jones is a community pharmacist and Drug Information Director of Metro Drug Information Services, Inc. in Ann Arbor, Michigan.
    Show book