VentureBeat

AI21 Labs juices up gen AI transformers with Jamba

Ever since the groundbreaking research paper "Attention is All You Need" debuted in 2017, the concept of transformers has dominated the generative AI landscape. Transformers however are not the only ...

Manifold-Constrained Hyper-Connections: The Architectural Breakthrough That Might Redefine LLM Training

If mHC scales the way early benchmarks suggest, it could reshape how we think about model capacity, compute budgets and the ...

Making LLMs Smart With Transformers: It’s A Really Big Deal

Here’s how: prior to the transformer, what you had was essentially a set of weighted inputs. You had LSTMs (long short term memory networks) to enhance backpropagation – but there were still some ...
InfoQ

Meta Open-Sources Byte Latent Transformer LLM with Improved Scalability

Meta open-sourced Byte Latent Transformer (BLT), an LLM architecture that uses a learned dynamic scheme for processing patches of bytes instead of a tokenizer. This allows BLT models to match the ...
Cyber Defense Magazine

The New AI Arsenal: Why LLMs and Transformers Matter for CISOs

As Chief Information Security Officers (CISOs) and security leaders, you are tasked with safeguarding your organization in an ...
Business Wire

Red Hat Launches the llm-d Community, Powering Distributed Gen AI Inference at Scale

Forged in collaboration with founding contributors CoreWeave, Google Cloud, IBM Research and NVIDIA and joined by industry leaders AMD, Cisco, Hugging Face, Intel, Lambda and Mistral AI and university ...