Mastering Transformers - The Journey from BERT to Large Language Models and Stable Diffusion

Savaş Yıldırım, Meysam Asgari- Chenaghlu

Summary

Transformer-based language models such as BERT, T5, GPT, DALL-E, and ChatGPT have dominated NLP studies and become a new paradigm. Thanks to their accurate and fast fine-tuning capabilities, transformer-based language models have been able to outperform traditional machine learning-based approaches for many challenging natural language understanding (NLU) problems.
Aside from NLP, a fast-growing area in multimodal learning and generative AI has recently been established, showing promising results. Mastering Transformers will help you understand and implement multimodal solutions, including text-to-image. Computer vision solutions that are based on transformers are also explained in the book. You’ll get started by understanding various transformer models before learning how to train different autoregressive language models such as GPT and XLNet. The book will also get you up to speed with boosting model performance, as well as tracking model training using the TensorBoard toolkit. In the later chapters, you’ll focus on using vision transformers to solve computer vision problems. Finally, you’ll discover how to harness the power of transformers to model time series data and for predicting.
By the end of this transformers book, you’ll have an understanding of transformer models and how to use them to solve challenges in NLP and CV.

Available since: 06/03/2024.

Print length: 462 pages.

Science & Technology

Other books that might interest you

Göbekli Tepe - The World's First...

Hugh Newman

What is the earliest temple complex on Earth? Who built it? Is it really 7000 years older than Stonehenge and the Pyramids How did such a sophisticated civilisation evade detection for so long? In this groundbreaking little book, packed with original reseach and illustrations, megalithomaniac Hugh Newman tells the story of Göbekli Tepe, Karahan Tepe, Nevali Çori and other temples in Turkey, which are so old that their very existence challenges history as we know it.

Show book

The Allure of the Multiverse -...

Paul Halpern

The long history of one of physics' most enticing ideas: that the universe we know isn't the only one 
 
 
 
Our books, our movies—our imaginations—are obsessed with extra dimensions, alternate timelines, and the sense that all we see might not be all there is. In short, we can't stop thinking about the multiverse. As it turns out, physicists are similarly captivated.   
 
 
  
In The Allure of the Multiverse, physicist Paul Halpern tells the epic story of how science became besotted with the multiverse, and the controversies that ensued. The questions that brought scientists to this point are big and deep: Is reality such that anything can happen, must happen? How does quantum mechanics "choose" the outcomes of its apparently random processes? And why is the universe habitable? Each question quickly leads to the multiverse. Drawing on centuries of disputation and deep vision, from luminaries like Nietzsche, Einstein, and the creators of the Marvel Cinematic Universe, Halpern reveals the multiplicity of multiverses that scientists have imagined to make sense of our reality. Whether we live in one of many different possible universes, or simply the only one there is, might never be certain. But Halpern shows one thing for sure: how stimulating it can be to try to find out.

Show book

Doctors at War - The Clandestine...

Ellen Hampton

Doctors at War tells the stories of physicians in France working to impede the German war effort and undermine French collaborators during the Occupation from 1940 to 1945. Determined to defeat the Third Reich's incursion, one group of prominent Paris doctors founded a medical network to treat injured Resistance fighters who they then secretly transported to Allied countries to avoid forced labor in Germany. Another team of medics organized a cabal focused on intelligence gathering and sabotage that became one of the largest in wartime France, even after the Gestapo arrested and imprisoned its leaders. Deported to concentration camps, these physicians continued to frustrate Nazi efforts by rendering aid and keeping their fellow prisoners alive. Others joined rural guerrilla camps to care for the young conscripts fighting to block German reinforcements from reaching Normandy after the D-Day landing. 
 
 
 
These stories add a crucial dimension to the history of Occupied France. Written for both historians and general listeners of World War II history, Doctors at War stands as a dramatic, character-driven account of physicians' courage and resilience in the face of evil. It serves as a window into life under a fascist regime and the travails of doctors who negotiated the terrifying moral labyrinth that was the German military's occupation of France.

Show book

The Creation of Nuclear Weapons...

Cristian Tyler

The atomic bomb ended World War II, but its creation was one of the most secretive and controversial projects in human history. Behind closed doors, the world’s greatest scientists—including Albert Einstein, J. Robert Oppenheimer, and Enrico Fermi—raced to develop nuclear weapons before Nazi Germany or Imperial Japan. But what really happened in the laboratories and desert testing sites of the Manhattan Project? 
This audiobook takes you deep into the story of nuclear weapons, uncovering the secrets, breakthroughs, and moral dilemmas behind their creation. Discover: 
✅ How Einstein’s warning letter to FDR ignited a nuclear arms race 
✅ The top-secret laboratories and brilliant minds that built the first atomic bomb 
✅ The intense ethical debates among scientists about using nuclear weapons 
✅ How the bombings of Hiroshima and Nagasaki changed warfare forever 
The Creation of Nuclear Weapons – The Manhattan Project is a must-listen for history lovers, science enthusiasts, and anyone fascinated by the power and consequences of human innovation.

Show book

Alien Question The: The History...

Editors Charles River

The question of man’s place in the extended universe has been pondered by every known culture since the beginning of recorded history. Lacking the means to prove otherwise, discussions of an alternative to Earth’s solitary existence have remained conceptual. The ongoing debate is spurred by the appearance of unexplainable phenomena through the centuries in the atmosphere and the space beyond. Naturally, as technological advances and the creation of flying aircraft became realities, the sighting of UFOs increased, as did the interest in potential contact with aliens. While incidents like the one at Roswell led to conspiracies and a craze among those who insisted the government was hiding proof of extraterrestrials’ existence, governments across the world were actually secretly studying UFO sightings by the mid-20th century.
Given all of that, it would hardly be groundbreaking for scientists in the 20th century to have a lunchtime discussion in which the search for extraterrestrial life arises, and the question of where it might reside is innocuous enough. However, a furor was created somewhat innocently when physicist Enrico Fermi voiced his “casual lunchtime remark” in the presence of colleagues in 1950. The august company included Edward Teller, a Hungarian physicist, Herbert York, am American nuclear physicist whose lineage included Mohawk heritage, and Emil Konopinski, a nuclear physicist of Polish origin. Fermi himself, an Italian-American born in Rome, was renowned for developing a statistical base for subatomic phenomena, work on nuclear alterations caused by neutrons, and for leading the first controlled chain reaction from nuclear fission. In pursuit of managing the atom, he created the first nuclear reactor. A gifted theoretician, he advanced the field of statistical mechanics, and won the Nobel Prize over a decade before he asked his important question.

Show book

CISSP - Simple and Effective...

Walker Schmidt

This book is the best recipe for becoming an expert on information security. If you aspire to be a security expert by taking the CISSP exam, there is no shortage of books that claim to be the ultimate solution to information security. They dupe students into thinking that they are the only books on the market for this specific subject. 
Well, they may be dubbed as the ultimate but are they the most reader-friendly books for this dry subject? Will there be any juice to be consumed by the reader and fiber to digest? Are those books written easy to under language? If those book authors have crammed their work with technical jargon, I must plead with you to avoid this confusion. 
What makes this book different from the other books on the market is the fact that it is written in a lucid and coherent form. You will find all the topics well-connected and written in easy and simple language. The book contains the following topics: 
•Security Principles 
•Security Threats and Countermeasures 
•Business Continuity Planning 
•Incident Response Planning 
•Security Models and Controls 
•Secure Communications 
•And lots more!

Show book