Unisciti a noi in un viaggio nel mondo dei libri!
Aggiungi questo libro allo scaffale
Grey
Scrivi un nuovo commento Default profile 50px
Grey
Iscriviti per leggere l'intero libro o leggi le prime pagine gratuitamente!
All characters reduced
Data Engineering with Scala and Spark - Build streaming and batch pipelines that process massive amounts of data using Scala - cover

Data Engineering with Scala and Spark - Build streaming and batch pipelines that process massive amounts of data using Scala

Eric Tome, Rupam Bhattacharjee, David Radford

Casa editrice: Packt Publishing

  • 0
  • 0
  • 0

Sinossi

Most data engineers know that performance issues in a distributed computing environment can easily lead to issues impacting the overall efficiency and effectiveness of data engineering tasks. While Python remains a popular choice for data engineering due to its ease of use, Scala shines in scenarios where the performance of distributed data processing is paramount.This book will teach you how to leverage the Scala programming language on the Spark framework and use the latest cloud technologies to build continuous and triggered data pipelines. You’ll do this by setting up a data engineering environment for local development and scalable distributed cloud deployments using data engineering best practices, test-driven development, and CI/CD. You’ll also get to grips with DataFrame API, Dataset API, and Spark SQL API and its use. Data profiling and quality in Scala will also be covered, alongside techniques for orchestrating and performance tuning your end-to-end pipelines to deliver data to your end users. By the end of this book, you will be able to build streaming and batch data pipelines using Scala while following software engineering best practices.
Disponibile da: 31/01/2024.
Lunghezza di stampa: 300 pagine.

Altri libri che potrebbero interessarti

  • Hardware for LLM AI - A Comprehensive Guide to Hardware Infrastructure for Large Language Models AI - cover

    Hardware for LLM AI - A...

    Et Tu Code

    • 0
    • 0
    • 0
    Hardware for LLM AI offers a comprehensive exploration into the intricate world of hardware infrastructure tailored for Large Language Models (LLMs). With a keen focus on practicality and depth, this ebook serves as an indispensable guide for both beginners and seasoned professionals navigating the complexities of LLM hardware. 
    In the introductory section, readers are primed with fundamental insights into the role of hardware in powering LLMs. From understanding the core principles behind LLM hardware to grasping its significance in the broader landscape of artificial intelligence, this section sets the stage for a deep dive into the intricacies of hardware optimization. 
    Whether you're delving into LLM hardware for the first time or seeking to refine your existing setup, this ebook equips you with the knowledge needed to make informed decisions. From dissecting the essential components of LLM hardware to unraveling the
    Mostra libro
  • Lost Lake Erie - cover

    Lost Lake Erie

    Jennifer Boresz Engelking

    • 0
    • 0
    • 0
    Serene one moment and destructive the next, Lake Erie's moods mirror its tumultuous role in history . 
     
    As the site of Cleveland's Great Lakes Exposition, the lake offered visitors a respite from the Great Depression, and Hotel Victory, once considered the world's largest summer resort, drew thousands to Put-In-Bay. Daring postal workers dangerously crossed the ice-covered surface on hybrid "boats" and by foot. Canal Street, at the Buffalo Wharf, was once called "the Wickedest Street in America." The Erie is one of thousands of ships that lie in a solemn graveyard below the surface. And rum runners turned the lake into a watery highway for illegal booze during Prohibition. 
     
    Author Jennifer Boresz Engelking reveals entertaining, heartbreaking, and nostalgic stories of the lost sites, businesses, and industries of Lake Erie.
    Mostra libro
  • Equine Minds and Human Insights: Neuroscience of Horsemanship Simplified - "Transform Your Riding Skills! Dive into neuroscience-driven horsemanship with engaging audio lessons" - cover

    Equine Minds and Human Insights:...

    Dorian Levant

    • 0
    • 0
    • 0
    Equine Minds and Human Insights: Neuroscience of Horsemanship Simplified 
    Are you looking to progress in your career and solidify your knowledge by unlocking deeper connections through neuroscience of horsemanship? 
    Seeking a comprehensive guide that provides all necessary elements to deepen your understanding of this fascinating field? 
    Your search ends here! 
    This guide serves as your definitive companion for deepening your understanding, applying your skills, and engaging in hands-on exercises. With this, you're geared for success. 
    Updated for the most current insights and information. 
    Key features of this enriched guide: 
    - Profound insights about the neuroscience of horsemanship 
    - Detailed explanation of equine and human interactions 
    - Effective strategies for enhancing the human-horse relationship 
    Our guide distinguishes itself through comprehensive coverage, which is essential for your success. Concepts aren't merely skimmed; they are delved into with precision. 
    Please note that this guide is not affiliated with any official entity and is purely an independent resource for your benefit. 
    Designed with a clear structure and easy-to-understand language, our Equine Minds and Human Insights Guide ensures smooth transitions between topics. Say goodbye to dense jargon and welcome clear, precise, and technically accurate content. 
    So, why wait? Click the BUY NOW button, secure your guide, and begin your journey to mastering the neuroscience of horsemanship today!
    Mostra libro
  • BRAINSPOTTING - Adventures in Neurology - cover

    BRAINSPOTTING - Adventures in...

    A. J. Lees

    • 0
    • 0
    • 0
    As a trainee doctor, Andrew Lees was enthralled by his mentors: esteemed neurologists who combined the precision of mathematicians, the scrupulosity of entomologists and the solemnity of undertakers in their diagnoses and treatments. For them, there was no such thing as an unexplained symptom or psychosomatic problem – no difficult cases, only interesting ones – and it was only a matter of time before all disorders of the brain would be understood in terms of anatomical electrical and chemical connections.
    Today, this kind of 'holistic neurology' is on the brink of extinction as a slavish adherence to protocols and algorithms – plus a worship of machines – runs the risk of destroying the key foundational clinical skills of listening, observation and imagination that have been at the heart of the discipline for over 150 years. In this series of brilliant, insightful and autobiographical essays, Andrew Lees takes us on a kind of Sherlock Holmes tour of neurology, giving the reader insight into – and defending – the deep analytical tools that the best neurologists still rely on to diagnose patients: to heal minds and to fix brains.
    Mostra libro
  • The Silent Universe - How Dark Energy Drives Galactic Evolution - cover

    The Silent Universe - How Dark...

    Dirk Fallon

    • 0
    • 0
    • 0
    Dark energy represents one of the most perplexing and enigmatic components of our universe, fundamentally altering our understanding of cosmic evolution. This mysterious force, which constitutes a major part of the cosmos, has intrigued scientists, astronomers, and physicists for decades. Its discovery, in part by observing the accelerated expansion of the universe, challenged long-held beliefs that gravity would eventually decelerate the cosmic expansion after the Big Bang. The revelation that the universe is not slowing down but actually speeding up has led to an explosion of theories and debates regarding the true nature of dark energy. 
    The initial hints of dark energy arose from studies that observed distant supernovae and measured their redshifts. When these measurements indicated that galaxies were moving away from each other at accelerating speeds, researchers were forced to rethink the previously accepted model of a decelerating universe. This unexpected acceleration suggested that some form of energy, previously unknown, was counteracting the force of gravity on a cosmic scale. Scientists have since begun to consider the possibility that this energy is uniformly spread throughout space, rather than being concentrated in specific locations, an idea that fundamentally differs from classical forms of matter and energy. 
    One of the core puzzles in understanding dark energy lies in its apparent uniformity and pervasive influence. Unlike ordinary matter, which clumps together to form stars, planets, and galaxies, dark energy seems to work in a diffuse, omnipresent manner, influencing the fabric of space itself. Its effects are subtle and counterintuitive, pushing galaxies apart rather than drawing them together.
    Mostra libro
  • Pulmonology - Lung Diseases and Respiratory Care - cover

    Pulmonology - Lung Diseases and...

    Ava Westwood

    • 0
    • 0
    • 0
    Pulmonology is a branch of medicine that focuses on the diagnosis, treatment, and prevention of diseases affecting the respiratory system. The respiratory system, comprising the lungs, airways, and associated structures, is vital for the process of respiration, which allows the body to exchange oxygen and carbon dioxide. Pulmonology addresses a broad range of conditions, from common ailments like asthma and chronic obstructive pulmonary disease (COPD) to more complex disorders such as lung cancer, pulmonary hypertension, and interstitial lung disease. This field plays a critical role in ensuring optimal lung health and preventing the potentially debilitating effects of respiratory conditions. 
    The importance of pulmonology has grown significantly in recent years due to the increasing prevalence of respiratory diseases worldwide. Factors such as air pollution, smoking, and the global rise in respiratory infections have contributed to the heightened demand for specialized care in pulmonology. Chronic respiratory diseases, such as asthma and COPD, are among the leading causes of morbidity and mortality globally. Early diagnosis, effective treatment, and ongoing management are key to improving quality of life and reducing the burden of these diseases on patients and healthcare systems. 
    Pulmonologists are medical professionals who specialize in diagnosing and treating respiratory diseases. They are trained to perform a variety of diagnostic procedures, including pulmonary function tests, imaging studies, and bronchoscopy, to assess lung function and identify underlying conditions. Pulmonologists also manage respiratory diseases through a combination of pharmacological treatments, lifestyle modifications, and, in some cases, surgical interventions. They work closely with other healthcare providers, including primary care physicians, oncologists, and thoracic surgeons, to deliver comprehensive care for patients with complex respiratory conditions.
    Mostra libro