IEEE

The Larger the Merrier? Efficient Large AI Model Inference in Wireless Edge Networks

Abstract: The growing demand for large artificial intelligence model (LAIM) services is driving a paradigm shift from traditional cloud-based inference to edge-based inference for low-latency, privacy ...
VentureBeat

AI inference costs dropped up to 10x on Nvidia's Blackwell — but hardware is only half the equation

Lowering the cost of inference is typically a combination of hardware and software. A new analysis released Thursday by Nvidia details how four leading inference providers are reporting 4x to 10x ...
TechCrunch

AI inference startup Modal Labs in talks to raise at $2.5B valuation, sources say

Modal Labs, a startup specializing in AI inference infrastructure, is talking to VCs about a new round at a valuation of about $2.5 billion, according to four people with knowledge of the deal. Should ...
Reuters

Exclusive: ByteDance developing AI chip, in manufacturing talks with Samsung, sources say

ByteDance plans to produce at least 100,000 AI chips this year, sources say Negotiations with Samsung include access to scarce memory chip supplies, source says ByteDance's AI-related procurement to ...
Rock Paper Shotgun

Discord roll out global age verification system, including an "age inference" model that runs in the background

I hate Discord with the intensity of a supernova falling into a black hole. I hate its ungainly profusion of tabs and voice channels. I regret its cybersecurity breaches. I resent that the PRs use it ...
IEEE

Dynamic Semantic Compression for CNN Inference in Multi-Access Edge Computing: A Graph Reinforcement Learning-Based Autoencoder

Abstract: This paper studies the computational offloading of CNN inference in dynamic multi-access edge computing (MEC) networks. To address the uncertainties in communication time and edge servers’ ...