Developer Blog - Cerebras https://www.cerebras.net/category/developer-blog/ Fri, 17 May 2024 21:37:53 +0000 en-US hourly 1 https://wordpress.org/?v=6.3.2 https://www.cerebras.net/wp-content/uploads/2022/05/cropped-cerebras-logo-fav-32x32.png Developer Blog - Cerebras https://www.cerebras.net/category/developer-blog/ 32 32 Cerebras Breaks Exascale Record for Molecular Dynamics Simulations https://www.cerebras.net/blog/cerebras-breaks-exascale-record-for-molecular-dynamics-simulations Fri, 17 May 2024 20:49:59 +0000 https://www.cerebras.net/?p=105480

The post Cerebras Breaks Exascale Record for Molecular Dynamics Simulations appeared first on Cerebras.

]]>
Supercharge your HPC Research with the Cerebras SDK https://www.cerebras.net/blog/supercharge-your-hpc-research-with-the-cerebras-sdk Wed, 01 May 2024 19:04:32 +0000 https://www.cerebras.net/?p=105438

The post Supercharge your HPC Research with the Cerebras SDK appeared first on Cerebras.

]]>
Accelerating Large Language Model Training with Variable Sparse Pre-training and Dense Fine-tuning https://www.cerebras.net/blog/accelerating-llm-training-with-variable-sparse-pre-training-and-dense-fine-tuning/ Sat, 22 Jul 2023 15:10:11 +0000 https://www.cerebras.net/?p=104832

The post Accelerating Large Language Model Training with Variable Sparse Pre-training and Dense Fine-tuning appeared first on Cerebras.

]]>
Variable Sequence Length Training for Long-Context Large Language Models https://www.cerebras.net/blog/variable-sequence-length-training-for-long-context-large-language-models/ Sat, 22 Jul 2023 15:00:49 +0000 https://www.cerebras.net/?p=104833

The post Variable Sequence Length Training for Long-Context Large Language Models appeared first on Cerebras.

]]>
SlimPajama: A 627B token, cleaned and deduplicated version of RedPajama https://www.cerebras.net/blog/slimpajama-a-627b-token-cleaned-and-deduplicated-version-of-redpajama Fri, 09 Jun 2023 16:00:58 +0000 https://www.cerebras.net/?p=104755

The post SlimPajama: A 627B token, cleaned and deduplicated version of RedPajama appeared first on Cerebras.

]]>
Efficient Large-Scale GPT Training Using a Cerebras Wafer-Scale Cluster https://www.cerebras.net/blog/efficient-large-scale-gpt-training-using-a-cerebras-wafer-scale-cluster Wed, 24 May 2023 02:28:24 +0000 https://www.cerebras.net/?p=104728

The post Efficient Large-Scale GPT Training Using a Cerebras Wafer-Scale Cluster appeared first on Cerebras.

]]>
Cerebras Architecture Deep Dive: First Look Inside the HW/SW Co-Design for Deep Learning [Updated] https://www.cerebras.net/blog/cerebras-architecture-deep-dive-first-look-inside-the-hw/sw-co-design-for-deep-learning Mon, 22 May 2023 17:48:15 +0000 https://www.cerebras.net/?p=103926

The post Cerebras Architecture Deep Dive: First Look Inside the HW/SW Co-Design for Deep Learning [Updated] appeared first on Cerebras.

]]>
Fine-Tuning with Cerebras AI Model Studio Launchpad https://www.cerebras.net/blog/fine-tuning-with-cerebras-ai-model-studio Mon, 17 Apr 2023 13:00:52 +0000 https://www.cerebras.net/?p=104681

The post Fine-Tuning with Cerebras AI Model Studio Launchpad appeared first on Cerebras.

]]>
Cerebras-GPT: A Family of Open, Compute-efficient, Large Language Models https://www.cerebras.net/blog/cerebras-gpt-a-family-of-open-compute-efficient-large-language-models/ Tue, 28 Mar 2023 13:00:15 +0000 https://www.cerebras.net/?p=104636

The post Cerebras-GPT: A Family of Open, Compute-efficient, Large Language Models appeared first on Cerebras.

]]>
Cerebras Announces Fine-Tuning on the Cerebras AI Model Studio https://www.cerebras.net/blog/cerebras-announces-fine-tuning-on-the-cerebras-ai-model-studio Thu, 16 Feb 2023 17:00:49 +0000 https://www.cerebras.net/?p=104367

The post Cerebras Announces Fine-Tuning on the Cerebras AI Model Studio appeared first on Cerebras.

]]>
What’s New in R0.6 of the Cerebras SDK https://www.cerebras.net/blog/whats-new-in-r0.6-of-the-cerebras-sdk Wed, 15 Feb 2023 14:00:15 +0000 https://www.cerebras.net/?p=104387

The post What’s New in R0.6 of the Cerebras SDK appeared first on Cerebras.

]]>
Real-Time Computational Physics with Wafer-Scale Processing [updated] https://www.cerebras.net/blog/real-time-computational-physics-with-wafer-scale-processing Tue, 07 Feb 2023 13:00:38 +0000 https://www.cerebras.net/?p=104080

The post Real-Time Computational Physics with Wafer-Scale Processing [updated] appeared first on Cerebras.

]]>
To Bfloat or not to Bfloat? That is the Question! https://www.cerebras.net/blog/to-bfloat-or-not-to-bfloat-that-is-the-question/ Mon, 30 Jan 2023 15:37:26 +0000 https://www.cerebras.net/?p=104340

The post To Bfloat or not to Bfloat? That is the Question! appeared first on Cerebras.

]]>
Cerebras Software Platform R1.7 is Out! https://www.cerebras.net/blog/cerebras-software-platform-r1.7-is-out Tue, 17 Jan 2023 22:46:47 +0000 https://www.cerebras.net/?p=104305

The post Cerebras Software Platform R1.7 is Out! appeared first on Cerebras.

]]>
Harnessing the Power of Sparsity for Large GPT AI Models https://www.cerebras.net/blog/harnessing-the-power-of-sparsity-for-large-gpt-ai-models Mon, 28 Nov 2022 14:00:57 +0000 https://www.cerebras.net/?p=104153

The post Harnessing the Power of Sparsity for Large GPT AI Models appeared first on Cerebras.

]]>
Genomics in Unparalleled Resolution: Cerebras Wafer-Scale Cluster Trains Large Language Models on the Full COVID Genome Sequence https://www.cerebras.net/blog/genomics-in-unparalleled-resolution-cerebras-wafer-scale-cluster-trains-large-language-models-on-the-full-covid-genome-sequence Mon, 14 Nov 2022 14:00:33 +0000 https://www.cerebras.net/?p=104111

The post Genomics in Unparalleled Resolution: Cerebras Wafer-Scale Cluster Trains Large Language Models on the Full COVID Genome Sequence appeared first on Cerebras.

]]>
What is Appliance Mode? https://www.cerebras.net/blog/what-is-appliance-mode Wed, 14 Sep 2022 13:00:49 +0000 https://www.cerebras.net/?p=104013

The post What is Appliance Mode? appeared first on Cerebras.

]]>
Context is Everything: Why Maximum Sequence Length Matters https://www.cerebras.net/blog/context-is-everything-why-maximum-sequence-length-matters/ Tue, 16 Aug 2022 02:23:54 +0000 https://www.cerebras.net/?p=103882

The post Context is Everything: Why Maximum Sequence Length Matters appeared first on Cerebras.

]]>
Training Multi-Billion-Parameter Models on a Single Cerebras System is Easy https://www.cerebras.net/blog/training-multi-billion-parameter-models-on-a-single-cerebras-system-is-easy Wed, 22 Jun 2022 13:00:03 +0000 https://www.cerebras.net/?p=103638

The post Training Multi-Billion-Parameter Models on a Single Cerebras System is Easy appeared first on Cerebras.

]]>
Multi-Billion-Parameter Model Training Made Easy with CSoft R1.3 https://www.cerebras.net/blog/multi-billion-parameter-model-training-made-easy-with-csoft-r1-3/ Wed, 01 Jun 2022 15:00:57 +0000 https://cerebras.net/?p=103540

The post Multi-Billion-Parameter Model Training Made Easy with CSoft R1.3 appeared first on Cerebras.

]]>
Tensor Shape: Increasing Model Throughput https://www.cerebras.net/blog/increasing-model-throughput-with-variable-tensor-shape-computations/ Wed, 01 Jun 2022 13:00:35 +0000 https://cerebras.net/?p=103526

The post Tensor Shape: Increasing Model Throughput appeared first on Cerebras.

]]>
Getting Started with PyTorch BERT Models https://www.cerebras.net/blog/getting-started-with-pytorch-bert-models-on-the-cerebras-cs-2-system/ Thu, 14 Apr 2022 21:09:49 +0000 https://cerebras.net/?p=2221

The post Getting Started with PyTorch BERT Models appeared first on Cerebras.

]]>
Supporting PyTorch on the Cerebras Wafer-Scale Engine https://www.cerebras.net/blog/supporting-pytorch-on-the-cerebras-wafer-scale-engine/ Wed, 13 Apr 2022 12:30:19 +0000 https://cerebras.net/?p=2186

The post Supporting PyTorch on the Cerebras Wafer-Scale Engine appeared first on Cerebras.

]]>
Cerebras Software Platform R1.2 is Out! https://www.cerebras.net/blog/cerebras-software-platform-r1.2-is-out Wed, 13 Apr 2022 12:30:03 +0000 https://cerebras.net/?p=2192

The post Cerebras Software Platform R1.2 is Out! appeared first on Cerebras.

]]>