IEEE

ORION: Integrated Architecture Combining Object Detection Language Understanding Graph Reasoning for Visual Question Answering

Abstract: In the modern era, Visual Question Answering (VQA) requires an intelligent method to together understand images and natural language queries, making one of the most challenging tasks at the ...
IEEE

LLM on FPGA: Squeezing Language Models by Quantization and Multi-Query Attention and its Efficient Hardware Architecture

Abstract: We present an on-chip implementation of a compressed Transformer-based language model on a Xilinx Artix-7 FPGA. Our contributions include: (1) combining ultra-low-precision quantization (4 ...
GitHub

The Best of Both Worlds: Integrating Language Models and Diffusion Models for Video Generation

In this repository, we present LanDiff, a novel text-to-video generation framework that synergizes the strengths of Language Models and Diffusion Models. LanDiff offers these key features: LanDiff ...