Efficient Algorithms for Monte Carlo Particle Transport on AI Accelerator Hardware
The recent trend toward deep learning has led to the…
Position Interpolation Improves ALiBi Extrapolation
Linear position interpolation helps pre-trained models…
Scaling the “Memory Wall” for Multi-Dimensional Seismic Processing with Algebraic Compression on Cerebras CS-2 Systems
We exploit the high memory bandwidth of AIcustomized…
BTLM-3B-8K: 7B Parameter Performance in a 3B Parameter Model
We introduce the Bittensor Language Model, called…
Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language Models
We introduce Jais and Jais-chat, new state-of-the-art…
GenSLMs: Genome-scale language models reveal SARS-CoV-2 evolutionary dynamics
Our work seeks to transform how new and emergent variants…
Scaling Up and Out: Training Massive Models on Cerebras Systems using Weight Streaming
A look at how the Wafer-Scale Engine trains models much…
An AI Chip With Unprecedented Performance To Do the Unimaginable
AI accelerator chips have made machine learning a reality…
