¡Acompáñanos a viajar por el mundo de los libros!
Añadir este libro a la estantería
Grey
Escribe un nuevo comentario Default profile 50px
Grey
Suscríbete para leer el libro completo o lee las primeras páginas gratis.
All characters reduced
Data Engineering with Scala and Spark - Build streaming and batch pipelines that process massive amounts of data using Scala - cover

Data Engineering with Scala and Spark - Build streaming and batch pipelines that process massive amounts of data using Scala

Eric Tome, Rupam Bhattacharjee, David Radford

Editorial: Packt Publishing

  • 0
  • 0
  • 0

Sinopsis

Most data engineers know that performance issues in a distributed computing environment can easily lead to issues impacting the overall efficiency and effectiveness of data engineering tasks. While Python remains a popular choice for data engineering due to its ease of use, Scala shines in scenarios where the performance of distributed data processing is paramount.
This book will teach you how to leverage the Scala programming language on the Spark framework and use the latest cloud technologies to build continuous and triggered data pipelines. You’ll do this by setting up a data engineering environment for local development and scalable distributed cloud deployments using data engineering best practices, test-driven development, and CI/CD. You’ll also get to grips with DataFrame API, Dataset API, and Spark SQL API and its use. Data profiling and quality in Scala will also be covered, alongside techniques for orchestrating and performance tuning your end-to-end pipelines to deliver data to your end users. 
By the end of this book, you will be able to build streaming and batch data pipelines using Scala while following software engineering best practices.
Disponible desde: 31/01/2024.
Longitud de impresión: 300 páginas.

Otros libros que te pueden interesar

  • Hypnosis to Beat Depression - Unlock The Secrets To Achieving Success With Hypnosis - cover

    Hypnosis to Beat Depression -...

    Be Conscious Creators

    • 0
    • 0
    • 0
    Rewire Your Mindset And Get Fast Results With Hypnosis! 
    The advantages of hypnosis therapy are widespread. A lot of individuals report positive changes with hypnosis and it's recognized as a valid type of holistic alternative medicine. 
    Hypnosis is a popular technique utilized for weight loss, overcoming addiction, healing, achieving goals, relaxation and stress relief. It's utilized to get rid of undesired behaviors and beliefs and to manifest new desires and achieve goals in life. 
      
    If you wish to influence your subconscious mind to accept new programming for positive alterations hypnosis is an effective technique for doing that. 
    Among the chief advantages of hypnosis is that when you in a hypnotic state brain wave frequencies decelerate. You center or focus your awareness and you're actually much more aware than usual. A state of centered awareness almost feels as though you're more of an observer of thought and images rather than a part of them. This allows you to bypass the "gatekeepers" at the entrance to the subconscious and superconscious so you are able to access these levels of consciousness directly, and the brain is much more receptive to suggestion. 
    The unconscious, or subconscious may then be reprogrammed so it lets go of old patterns, beliefs and feelings that no longer serve you. They may be replaced with suggestions that are favorable and affirming. The superconscious mind may open you into fresh insights and originative ideas. 
    For lasting positive changes, hypnosis suggestions need to be repeated several times till your mind accepts the new programming. 
    Put this audio on each night before you go to bed and listen to it right before you fall asleep. If you have time also listen to it first thing upon waking. Do this for at least 21 days consistently so that positive change can take affect in your life.
    Ver libro
  • Cosmic Conversations - Dialogues on the Nature of the Universe and the Search for Reality - cover

    Cosmic Conversations - Dialogues...

    Stephan Martin

    • 0
    • 0
    • 0
    “Some of the most compelling, cutting-edge ideas about who we are and what kind of world we live in. This is a daring book—and a great read!”—Glenn Hartelius, PhD, coeditor of the International Journal of Transpersonal Studies   Have you ever looked up at the night sky and wondered “What is the universe?” In this lively and engaging collection of interviews, astronomer Stephan Martin talks with some of today’s most innovative and cutting-edge thinkers on the nature of the universe and our relationship to it. Scientists, mystics, indigenous elders, and cultural creatives all share their unique voices on the nature of reality, the interplay of science and religion, the future of humanity, and the role of each person in a mysterious and evolving universe. Filled with rich insight, dynamic discussion, and penetrating wisdom, Cosmic Conversations asks the fundamental questions about the universe many of us have wondered about, yet few have explored in-depth, questions such as:   Do time, space, and matter really exist? Can the universe be inside us, outside us, or both? Is the universe alive, conscious, and intelligent? Where are we in the cosmic evolutionary picture?   A compelling journey from the farthest reaches of outer space to the innermost realms of the human heart, Cosmic Conversations will change the way you look at the universe (and yourself) forever.   “An excellent contribution to the philosophical revival that is taking place in the marketplace of ideas. Stephan’s searching and heartfelt questions bring out the best of the authors he interviews.”—Steve McIntosh, author of The Presence of the Infinite
    Ver libro
  • The Vested Outsourcing Manual - cover

    The Vested Outsourcing Manual

    Eric Parks

    • 0
    • 0
    • 0
    The Vested Outsourcing Manual: The Ultimate Outsourcing Guide That Will Help You Automate and Expand Your Business to Achieve More for LessSome people may think that outsourcing is a new thing but it has actually been going on for years. The essence of outsourcing is engaging the services of an individual or organization outside your full-time staff to handle certain aspects of your business plan. These aspects could be public relations, marketing, and other administrative functions. As the business grows, it is easy to get caught up in dealing with general office functions such as answering emails, handling correspondence, and maintaining client lists. But by outsourcing your clerical support needs, you can spend more time focusing on the expansion of your business and not the day-to-day details of running it.In this audiobook, you will learn everything about outsourcing, how it works, the benefits to your business and how to get started. This audiobook will discuss the following topics:- Introduction to Outsourcing- Tasks You Can Outsource- How to Negotiate Outsourcing Deals- Outsourcing Tips and Tricks- And many more!Outsourcing is a great way to expand your online business without undue stress on your resources. To learn more, scroll up and click “add to cart” now!
    Ver libro
  • South Africa Beyond Covid-19 - Trends change and recovery - cover

    South Africa Beyond Covid-19 -...

    Pieter du Toit

    • 0
    • 0
    • 0
    In the aftermath of the worldwide outbreak of Covid-19, 31 of South Africa's top analysts, economists, academics and journalists – including Adriaan Basson, Koos Bekker, Pieter du Toit, Adam Habib and Thuli Madonsela – try to chart a way forward, identify our biggest stumbling blocks, and offer solutions for when the virus subsides.
    When reports emerged from China in December 2019 about a seemingly incurable virus, few South Africans took notice. But less than three months after those reports, in March 2020, South Africa went into a full lockdown. Life as we knew it ground to a halt. Schools were closed, businesses were shuttered, a curfew imposed, freedom of movement curtailed and hospitals prepared for an unprecedented health storm.
    The spread of Covid-19, the disease caused by the novel coronavirus, has forced the world and South Africa to reconsider how society works. Can the economy continue to function as it has for the past century, and how can it be reconfigured to be more inclusive? In a post-state-capture country, what must citizens expect and demand from their government? And how can we bridge societal cleavages – many caused by our unjust past – so that we emerge a stronger nation beyond Covid-19?
    Contributors: Pieter du Toit, Haroon Bhorat, Servaas van der Berg, Imraan Valodia, Alex van den Heever, Louis Reynolds, Kuku Voyi, James Arens, Ron Derby, Thabi Leoka, Koos Bekker, Ann Bernstein, Dawie Roodt, Norman Mbazima, Isaah Mhlanga, Qaanitah Hunter, Thuli Madonsela, Anthoni van Nieuwkerk, Mcebisi Ndletyana, Nicole Fritz, Mpumelelo Mkhabela, William Gumede, Judith February, Darias Jonker, Theo Venter, Leon Wessels, Elmien du Plessis, Ralph Mathekga, Adriaan Basson, Adam Habib, Wilmot James.
    Ver libro
  • Saber-Toothed Tigers: The History and Legacy of the Most Famous Extinct Cat Species - cover

    Saber-Toothed Tigers: The...

    Charles River Editors

    • 0
    • 0
    • 0
    Saber-toothed tigers were arguably the most fabled of all the Ice Age creatures. The fearsome beast has earned itself quite the reputation, and it has been referenced to, appeared in, and inspired unique characters in endless books, films, comics, and other pop culture mediums. For example, Marvel's Victor Creed, otherwise known as “Sabretooth,” is most known as Wolverine's nemesis, and he’s depicted as a hulking, vigorously robust menace in a red and orange-gold jumpsuit with a hunched back, a shock of wild blond hair, tiger-like claws, and frightening fangs. As that indicates, the prehistoric creature is often portrayed as impossibly cunning, unfeeling villains. Even in films geared towards children, such as the first of the Ice Age animations, the saber-toothed tigers, excluding Diego, are depicted as vicious and vindictive, lawless fiends whose sights are set on a Neanderthal toddler. 
    The name and reputation of the ruthless saber-toothed tiger, as enduring as it is chilling, overshadows those of its contemporaries, and the fanged feline remains a household name and one of the foremost symbols of the Ice Age to this very day. So, what is it about the Smilodon that has captured – and continues to capture – the fears, morbid curiosities, hearts, minds, and imaginations of Holocene humans after all this time? And exactly how accurate is the general public's perception and understanding of the saber-toothed tiger? 
    Ver libro
  • The Story Behind Feature-Driven Development - cover

    The Story Behind Feature-Driven...

    Jeff DeLuca

    • 0
    • 0
    • 0
    Feature-Driven Development is one of six recognized major agile development methodologies.  FDD and Jeff De Luca are a part of the Agile Software Consortium, and FDD was one of the original agile methodologies represented at the signing of the Agile Manifesto.  While most recent writing about agile has concerned Scrum and Extreme Programming (XP), there are still a sizable number of people succeeding in agile software development using the FDD method. In this 60-minute interview with Jeff De Luca, the co-creator of the FDD method, he tells us about the story behind the development of the FDD approach: how it was conceived, its early evolution, and how it was introduced to development teams and organizations.Topics Covered What is Feature-Driven Development?    What sparked the original idea for its creation?    What/Who influenced its structure?    How was it first used?    What early lessons helped change the approach to the format we know today?    How was it first introduced to the broader software development community, and what were the reactions?    And answers to questions raised by the audience
    Ver libro