GitHub

Flash Attention with Sink — GPT-OSS 20B Attention Implementation

flash-attention-with-sink implements an attention variant used in GPT-OSS 20B that integrates a "sink" step into FlashAttention. This repo focuses on the forward path and provides an experimental ...
GitHub

PDF Diff Viewer, a side-by-side, visual highlight, sync-scroll, PDF comparer, written in Python. Open source, mostly powered by PyMuPDF and Tkinter. Optional support for git ...

Windows binaries are provided; while no installation is needed, you need to decompress everything and then run "pdf_viewer_app.exe" within the folder "pdf_viewer_app". Make sure you have writing ...
IEEE

Personalized Causal Graph Reasoning for LLMs: An Implementation for Dietary Recommendations

Abstract: Large Language Models (LLMs) excel at general-purpose reasoning by leveraging broad commonsense knowledge, but they remain limited in tasks requiring personalized reasoning over ...
IEEE

Out-of-Core Implementation for Matrix and Graph Computations using MPI-Berkeley DB

Abstract: Two key challenges in scientific and engineering applications on peta- to exascale systems are: (i) developing scalable programming environments (SPEs) and (ii) solving largescale problems ...