Join us on a literary world trip!
Add this book to bookshelf
Grey
Write a new comment Default profile 50px
Grey
Subscribe to read the full book or read the first pages for free!
I want to read the book!
All characters reduced
Data Engineering with Scala and Spark - Build streaming and batch pipelines that process massive amounts of data using Scala - cover

Data Engineering with Scala and Spark - Build streaming and batch pipelines that process massive amounts of data using Scala

Eric Tome, Rupam Bhattacharjee, David Radford

Publisher: Packt Publishing

  • 0
  • 0
  • 0

Summary

Most data engineers know that performance issues in a distributed computing environment can easily lead to issues impacting the overall efficiency and effectiveness of data engineering tasks. While Python remains a popular choice for data engineering due to its ease of use, Scala shines in scenarios where the performance of distributed data processing is paramount.This book will teach you how to leverage the Scala programming language on the Spark framework and use the latest cloud technologies to build continuous and triggered data pipelines. You’ll do this by setting up a data engineering environment for local development and scalable distributed cloud deployments using data engineering best practices, test-driven development, and CI/CD. You’ll also get to grips with DataFrame API, Dataset API, and Spark SQL API and its use. Data profiling and quality in Scala will also be covered, alongside techniques for orchestrating and performance tuning your end-to-end pipelines to deliver data to your end users. By the end of this book, you will be able to build streaming and batch data pipelines using Scala while following software engineering best practices.
Available since: 01/31/2024.
Print length: 300 pages.

Other books that might interest you

  • Earn Money While Losing Weight With Jesus - How To Advertise Your Products Services & Content Like The Big Players - cover

    Earn Money While Losing Weight...

    Edward J. Baldega

    • 0
    • 0
    • 0 
    It can be tough to know where to start when it comes to advertising your content. You don't want to waste time and money on strategies that don't work. 
Earn Money While Losing Weight With Jesus: How to Advertise Your Products, Services, & Content Like the Big Players is here to help! 
This book breaks down advertising for you by category and provides helpful tips on how to make the most of your advertising budget. 
It’s divided into 3 main categories: Money, Weight Loss, and Religion, so you can better tailor your work to those audiences. It’s also filled with information on how to create successful ad campaigns, regardless of what you’re selling. 
Create ad campaigns that are so effective you can convince absolutely anyone that they want/ need your product in their lives. You’ll also be able to see past the sparkle and glamour of the billboards and know precisely what makes them so effective. 
Learn from the best in the business – Dissect, analyze, and utilize those same strategies to get amazing results!
    Show book
  • Artificial General Intelligence (AGI) - The Quest for Human-Like intelligence - cover

    Artificial General Intelligence...

    Et Tu Code

    • 0
    • 0
    • 0 
    Artificial General Intelligence (AGI): The Quest for Human-Like Intelligence" delves into the exciting and rapidly evolving field of AGI, where human-like intelligence meets artificial intelligence. 
In this comprehensive guide, you'll discover the basics of AGI, how to build it from scratch, popular models, and the differences between AGI and AI. You'll also learn about top tech companies working on AGI, popular language models, sci-fi movies, and robots that showcase AGI in action. 
Explore the challenges and implications of creating AGI, as well as planning for its potential impact. Dive into applications such as healthcare, finance, and education, and get a glimpse into the future directions of AGI. 
Join the quest to create human-like intelligence and discover how AGI will transform our world.
    Show book
  • Sleep Hypnosis for Anxiety - cover

    Sleep Hypnosis for Anxiety

    Meditation Masters

    • 0
    • 0
    • 0 
    Are anxiety and sleepless nights leaving you feeling exhausted and overwhelmed? Do you long for restful, uninterrupted sleep and a peaceful mind? Imagine drifting into a deep, rejuvenating sleep every night, free from the grip of anxiety. 
Our transformative audiobook offers a powerful journey into sleep hypnosis specifically designed to alleviate anxiety. Through expertly crafted sessions, you'll be guided to relax your mind, release tension, and embrace a state of deep, restorative sleep. 
Each session combines soothing narratives and calming techniques to help you unwind, fall asleep effortlessly, and stay asleep throughout the night. Whether you're struggling with racing thoughts or nighttime anxiety, these hypnosis sessions will support you in creating a bedtime routine that fosters tranquility and restfulness. 
Consistent listening will help you wake up refreshed, with reduced anxiety and a greater sense of well-being. Start your journey towards peaceful nights and anxiety-free days today. Embrace the opportunity to transform your sleep and improve your overall mental health. 
Don't let anxiety steal another night of rest. Take the first step towards healing and serenity. Listen now and discover the profound benefits of sleep hypnosis for anxiety.
    Show book
  • Artificial Intelligence in the Modern World: Transformative Technologies and Ethical Implications - Navigating the Impact of AI on Society Economy and Culture - cover

    Artificial Intelligence in the...

    David Chang

    • 0
    • 0
    • 0 
    The book "Artificial Intelligence in the Modern World: Transformative Technologies and Ethical Implications" explores both the revolutionary potential of AI and the ethical issues it raises, delving into the enormous effects of AI on modern society. This book gives readers a comprehensive grasp of AI's capabilities and uses by deeply analyzing how AI is changing several industries, including healthcare, finance, education, and entertainment. 
The book highlights AI's revolutionary potential to solve complicated issues, boost productivity, and spur economic growth, but it also stresses the importance of responsible AI development. It covers important topics like discrimination, privacy, loss of employment, and the need for strong legal structures. Using comprehensive examination and varied viewpoints, the writer promotes openness, responsibility, and the incorporation of moral factors into the management of artificial intelligence. 
To guarantee that AI's advantages are distributed fairly, the book emphasizes the significance of international cooperation and urges global initiatives to create common standards and exchange best practices. For technologists, policymakers, and anybody else interested in comprehending AI's transformational potential and navigating its ethical environment, "Artificial Intelligence in the Modern World" is an indispensable read.
    Show book
  • Spectroscopy - Science Spectronomy and Astronomy Explained - cover

    Spectroscopy - Science...

    Arnoud Varens

    • 0
    • 0
    • 0 
    In the vast expanse of the cosmos, where stars twinkle in the night sky and galaxies swirl in the abyss, a remarkable dance of light and matter unfolds—a dance that has captivated the human imagination for centuries. This dance, illuminated by the science of spectroscopy, is what this book seeks to explore and explain. 
Spectroscopy, the study of the interaction between matter and electromagnetic radiation, may sound complex and esoteric, but at its heart lies a simple and profound idea: the colors of light can reveal the secrets of the universe. From the examination of distant stars to the analysis of molecules in a laboratory, spectroscopy is the key that unlocks the hidden stories encoded in light. 
This book is your guide to the fascinating world of spectroscopy, spanning from the fundamental principles that underpin this science to its myriad applications across various disciplines. We will journey together through the realms of chemistry and biology, where spectroscopy plays a vital role in unraveling the mysteries of molecules and cells. We will then venture into the realm of astronomy, where spectroscopy serves as a cosmic tool, allowing us to explore the composition, motion, and evolution of celestial objects. 
This book is designed for curious minds seeking to understand the inner workings of the universe. Whether you are a student just beginning your scientific journey, a seasoned researcher, or simply an inquisitive reader, this book aims to provide you with a comprehensive and accessible overview of spectroscopy and its applications.
    Show book
  • Advanced Scrum Case Studies Vol 7 - Working from home - cover

    Advanced Scrum Case Studies Vol...

    Frederik Mark Fowler

    • 0
    • 0
    • 0 
    You are an Agile Coach and your client has asked you a question.  He is an engineering manager and the company has just announced a "work from home" policy.   Developers may now work from home instead of coming to the office. 
The Engineering Manager has asked you if there are any "Agile Metrics" he can use to make sure his developers stay busy and are not being lazy.  He is investigating software to record when people log in and log out, and count their keystrokes in between. 
What should you tell him to do? 
This case and the others in the series come from the real-world experiences of a group of Scrum professionals who meet regularly to discuss the Scrum Framework and how to apply it to actual situations they have encountered.  These discussions have been led since 2015 by Frederik Mark Fowler, A Doctor of Scrum and Holder of the Professional Scrum Master level III certification awarded by Scrum.org.  Fred has worked with the Scrum Framework for almost 20 years and has trained more then 300 people to become Scrum Masters and Product Owners.  For more information, visit www.Patreon.com/SiliconValleyScrum.
    Show book