Join us on a literary world trip!
Add this book to bookshelf
Grey
Write a new comment Default profile 50px
Grey
Subscribe to read the full book or read the first pages for free!
All characters reduced
Building Big Data Pipelines with Apache Beam - Use a single programming model for both batch and stream data processing - cover

Building Big Data Pipelines with Apache Beam - Use a single programming model for both batch and stream data processing

Jan Lukavský

Publisher: Packt Publishing

  • 0
  • 0
  • 0

Summary

Apache Beam is an open source unified programming model for implementing and executing data processing pipelines, including Extract, Transform, and Load (ETL), batch, and stream processing.

This book will help you to confidently build data processing pipelines with Apache Beam. You’ll start with an overview of Apache Beam and understand how to use it to implement basic pipelines. You’ll also learn how to test and run the pipelines efficiently. As you progress, you’ll explore how to structure your code for reusability and also use various Domain Specific Languages (DSLs). Later chapters will show you how to use schemas and query your data using (streaming) SQL. Finally, you’ll understand advanced Apache Beam concepts, such as implementing your own I/O connectors.

By the end of this book, you’ll have gained a deep understanding of the Apache Beam model and be able to apply it to solve problems.
Available since: 01/21/2022.
Print length: 342 pages.

Other books that might interest you

  • The Great Derangement - Climate Change and the Unthinkable - cover

    The Great Derangement - Climate...

    Amitav Ghosh

    • 0
    • 0
    • 0
    A “concise and utterly enlightening” look at why we can’t wrap our minds around climate change (Publishers Weekly).   Are we deranged? Award-winning essayist and novelist Amitav Ghosh argues that future generations may think so. How else to explain our imaginative failure in the face of global warming? The Great Derangement examines our inability—at the level of literature, history, and politics—to grasp the scale and violence of climate change. The extreme nature of today’s climate events, Ghosh asserts, make them peculiarly resistant to current modes of thinking and imagining. This is particularly true of serious literary fiction: hundred-year storms and freakish tornadoes simply feel too improbable; they are automatically consigned to genres like science fiction. In the writing of history, too, the crisis has sometimes led to gross simplifications, but the carbon economy is a tangled story with many contradictory and counterintuitive elements. Ghosh ends by suggesting that politics, much like literature, has become a matter of personal moral reckoning rather than an arena of collective action, and that limitation comes at great cost. The climate crisis asks us to imagine other forms of human existence—a task to which fiction, Ghosh argues, is the best suited of all cultural forms. His book serves as a great writer’s summons to confront the most urgent task of our time, and “makes the case that climate solutions can’t be left to scientists, technocrats, and politicians” (Los Angeles Review of Books).   “Perhaps the most penetrating cultural critic of a new age defined by climate change and the strange, inadequate, and often self-deluding ways we process its transformations in our storytelling.”—New York Magazine   “Resistance to the grim realities of climate change is so widespread that the crisis barely figures in literary fiction, notes writer Amitav Ghosh…The solution, he argues, lies in collective action as well as scientific and governmental involvement.”—Nature
    Show book
  • Iwígara - American Indian Ethnobotanical Traditions and Science - cover

    Iwígara - American Indian...

    Enrique Salmón

    • 0
    • 0
    • 0
    Tap into thousands of years of plant knowledgeThe belief that all life-forms are interconnected and share the same breath—known in the Rarámuri tribe as iwígara—has resulted in a treasury of knowledge about the natural world, passed down for millennia by native cultures. Ethnobotanist Enrique Salmón builds on this concept of connection and highlights eighty plants revered by North America's indigenous peoples. Salmón teaches us the ways plants are used as food and medicine, the details of their identification and harvest, their important health benefits, plus their role in traditional stories and myths. Discover how the timeless wisdom of iwígara can enhance your own kinship with the natural world.
    Show book
  • Summary of Michael Pollan’s How to Change Your Mind - cover

    Summary of Michael Pollan’s How...

    Falcon Press

    • 0
    • 0
    • 0
    Summary of Michael Pollan’s How to Change Your Mind explores the benefits that psychedelics can provide, both for those suffering from mental illness and for those trying to cultivate new perspectives and habits. Before these drugs were prohibited, there was an extensive history of research into their effects in North America and Europe, and studies that utilize lysergic acid diethylamide (LSD) and magic mushrooms continue today.
    Show book
  • Convert - Make your website sell more - cover

    Convert - Make your website sell...

    Jim Martin

    • 0
    • 1
    • 0
    Website conversions are elusive. Hard to obtain and harder to sustain. From Ecommerce to bookings or lead generation sites, we are in the game to optimise our websites in order to maximise the ad spend.
    What do we do when results aren't there, when agencies don't know what's failing and businesess need to revise their site from a different optic? 
    This book will give you an all-around idea of what's needed to find it out. What's at play and what are the things that you and your team haven't considered but are extremely relevant in order to bring conversions back.
    Show book
  • Take A Walk With Me - cover

    Take A Walk With Me

    Simon Ingram

    • 0
    • 0
    • 0
    “I felt honoured to be involved in the production/proof reading of Simon’s 4th book, Parkinson’s - Take a Walk With Me. The book is written with humour on a subject which could very easily be melancholy, and whilst not avoiding the truth about this degenerative neurological condition, Simon takes you on a journey with earnest compassion. A great read for everyone, especially for anyone remotely connected to Parkinson’s Disease, this is an uplifting, supportive and reaffirming read; life is still to be enjoyed no matter what the adversity.” - Sharon Timms
    Show book
  • The Cult of Water - cover

    The Cult of Water

    David Bramwell

    • 0
    • 0
    • 0
    Aided by a witch and the magician Alan Moore, David Bramwell takes an occult journey back in time up the river Don, in search of the supernatural secrets of our waterways and to solve the mystery of a drowned village which has long haunted his memories. Travelling through the industrial destruction of our landscape he arrives in a pre-Christian era when well and springs were worshipped as living as deities, bringing him face to face with Danu, the goddess of primordial waters, who gave her name to the Don. Can Bramwell face his demons and unravel the symbolic mysteries of our ancient ancestors? Who is the mysterious Vulcan? And will there be a pie and a pint waiting for him at the end of it all?
    Show book