Rebecca Lewington, Author at Cerebras https://www.cerebras.net/author/rebeccal/ Mon, 24 Jul 2023 19:52:21 +0000 en-US hourly 1 https://wordpress.org/?v=6.3.2 https://www.cerebras.net/wp-content/uploads/2022/05/cropped-cerebras-logo-fav-32x32.png Rebecca Lewington, Author at Cerebras https://www.cerebras.net/author/rebeccal/ 32 32 Cerebras and Opentensor introduce BTLM-3B-8K: 7B Performance in a 3 Billion Parameter Model https://www.cerebras.net/blog/btlm-3b-8k-7b-performance-in-a-3-billion-parameter-model/ Mon, 24 Jul 2023 19:50:56 +0000 https://www.cerebras.net/?p=104881

The post Cerebras and Opentensor introduce BTLM-3B-8K: 7B Performance in a 3 Billion Parameter Model appeared first on Cerebras.

]]>
100M USD Cerebras AI Cluster Makes it the Post-Legacy Silicon AI Winner https://www.servethehome.com/100m-usd-cerebras-ai-cluster-makes-it-the-post-legacy-silicon-ai-winner/#new_tab Thu, 20 Jul 2023 21:57:14 +0000 https://www.cerebras.net/?p=104827

The post 100M USD Cerebras AI Cluster Makes it the Post-Legacy Silicon AI Winner appeared first on Cerebras.

]]>
Cerebras Sells $100 Million AI Supercomputer, Plans Eight More https://www.eetimes.com/cerebras-sells-100-million-ai-supercomputer-plans-8-more/#new_tab Thu, 20 Jul 2023 21:54:47 +0000 https://www.cerebras.net/?p=104826

The post Cerebras Sells $100 Million AI Supercomputer, Plans Eight More appeared first on Cerebras.

]]>
Cerebras Systems Wins SEMI Award for North America for AI Accelerator Technology at SEMICON West 2023 https://www.semi.org/en/news-media-press-releases/semi-press-releases/cerebras-systems-wins-semi-award-for-north-america-for-ai-accelerator-technology-at-semicon-west-2023#new_tab Mon, 17 Jul 2023 16:52:42 +0000 https://www.cerebras.net/?p=104794

The post Cerebras Systems Wins SEMI Award for North America for AI Accelerator Technology at SEMICON West 2023 appeared first on Cerebras.

]]>
Huge chips. Big AI advantage. https://www.bizjournals.com/sanfrancisco/inno/stories/profiles/2023/06/09/cover-huge-chips-big-ai-advantage.html#new_tab Fri, 09 Jun 2023 15:00:01 +0000 https://www.cerebras.net/?p=104768

The post Huge chips. Big AI advantage. appeared first on Cerebras.

]]>
Understanding the impact of open-source language models https://bdtechtalks.com/2023/05/29/open-source-llms-cerebras-gpt/#new_tab Tue, 30 May 2023 15:37:59 +0000 https://www.cerebras.net/?p=104745

The post Understanding the impact of open-source language models appeared first on Cerebras.

]]>
Cerebras Architecture Deep Dive: First Look Inside the Hardware/Software Co-Design for Deep Learning https://8968533.fs1.hubspotusercontent-na1.net/hubfs/8968533/IEEE%20Micro%202023-03%20Hot%20Chips%2034%20Cerebras%20Architecture%20Deep%20Dive.pdf#new_tab Mon, 22 May 2023 20:15:11 +0000 https://www.cerebras.net/?p=104721 IEEE Micro Volume 34, Issue 3, focuses on papers from last year’s Hot Chips 34 conference.
This article describes the Cerebras architecture and how it is designed specifically with this purpose, from the ground up, as a wafer-sized chip to…

The post Cerebras Architecture Deep Dive: First Look Inside the Hardware/Software Co-Design for Deep Learning appeared first on Cerebras.

]]>
Cerebras’ Open-Source GPT Models Trained at Wafer Scale https://www.eetimes.com/cerebrass-open-source-gpt-models-trained-at-wafer-scale/#new_tab Fri, 21 Apr 2023 18:43:24 +0000 https://www.cerebras.net/?p=104696

The post Cerebras’ Open-Source GPT Models Trained at Wafer Scale appeared first on Cerebras.

]]>
New paper shows Cerebras-GPT family offers state-of-the-art training and downstream efficiency https://arxiv.org/abs/2304.03208#new_tab Fri, 07 Apr 2023 17:30:24 +0000 https://www.cerebras.net/?p=104672

The post New paper shows Cerebras-GPT family offers state-of-the-art training and downstream efficiency appeared first on Cerebras.

]]>
Cerebras-GPT: Open Compute-Optimal Language Models Trained on the Cerebras Wafer-Scale Cluster https://arxiv.org/abs/2304.03208#new_tab Fri, 07 Apr 2023 17:24:10 +0000 https://www.cerebras.net/?p=104639 We introduce Cerebras-GPT, a family of open compute-optimal language models scaled from 111M to 13B parameters. We train Cerebras-GPT models on the Eleuther Pile dataset following DeepMind Chinchilla scaling rules for efficient pre-training (highest accuracy for a given compute budget).…

The post Cerebras-GPT: Open Compute-Optimal Language Models Trained on the Cerebras Wafer-Scale Cluster appeared first on Cerebras.

]]>
Cerebras-GPT is trending! 500,000 downloads across our family of open source models https://huggingface.co/cerebras#new_tab Thu, 06 Apr 2023 16:54:21 +0000 https://www.cerebras.net/?p=104674

The post Cerebras-GPT is trending! 500,000 downloads across our family of open source models appeared first on Cerebras.

]]>
AI pioneer Cerebras opens up generative AI where OpenAI goes dark https://www.zdnet.com/article/ai-pioneer-cerebras-opens-up-generative-ai-where-openai-goes-dark/#new_tab Wed, 29 Mar 2023 18:48:37 +0000 https://www.cerebras.net/?p=104668

The post AI pioneer Cerebras opens up generative AI where OpenAI goes dark appeared first on Cerebras.

]]>
Cerebras Smashes AI Wide Open, Countering Hypocrites https://www.nextplatform.com/2023/03/29/cerebras-smashes-ai-wide-open-countering-hypocrites/#new_tab Wed, 29 Mar 2023 18:44:23 +0000 https://www.cerebras.net/?p=104667

The post Cerebras Smashes AI Wide Open, Countering Hypocrites appeared first on Cerebras.

]]>
AI computing startup Cerebras releases open source ChatGPT-like models https://www.reuters.com/article/ai-cerebras-languagemodel-idCAKBN2VU12I#new_tab Tue, 28 Mar 2023 21:40:45 +0000 https://www.cerebras.net/?p=104665

The post AI computing startup Cerebras releases open source ChatGPT-like models appeared first on Cerebras.

]]>
Cerebras Publishes 7 Trained Generative AI Models To Open Source https://www.forbes.com/sites/karlfreund/2023/03/28/cerebras-publishes-7-trained-generative-ai-models-to-open-source#new_tab Tue, 28 Mar 2023 21:38:09 +0000 https://www.cerebras.net/?p=104664

The post Cerebras Publishes 7 Trained Generative AI Models To Open Source appeared first on Cerebras.

]]>
Cost-effective Fork of GPT-3 Released to Scientists https://www.hpcwire.com/2023/03/28/cost-effective-fork-of-gpt-3-released-to-scientists/#new_tab Tue, 28 Mar 2023 21:35:11 +0000 https://www.cerebras.net/?p=104663

The post Cost-effective Fork of GPT-3 Released to Scientists appeared first on Cerebras.

]]>
Training Giant Neural Networks Using Weight Streaming on Cerebras Wafer-Scale Systems https://8968533.fs1.hubspotusercontent-na1.net/hubfs/8968533/Virtual%20Booth%20Docs/CS%20Weight%20Streaming%20White%20Paper.pdf#new_tab Fri, 24 Mar 2023 18:00:44 +0000 https://cerebras.net/?p=103260 In this paper, we survey existing approaches used to scale training to clusters of compute units and explore the limitations of each in the face of giant models. We present a new paradigm for giant model training, called weight streaming,…

The post Training Giant Neural Networks Using Weight Streaming on Cerebras Wafer-Scale Systems appeared first on Cerebras.

]]>
Cerebras introduces Sparse-IFT, a new technique to increase accuracy for the same compute https://www.cerebras.net/blog/can-sparsity-make-ai-models-more-accurate Wed, 22 Mar 2023 17:38:45 +0000 https://www.cerebras.net/?p=104633 Cerebras introduces SIFT, a sparse technique that increases accuracy without increasing compute…

The post Cerebras introduces Sparse-IFT, a new technique to increase accuracy for the same compute appeared first on Cerebras.

]]>
Sparse-IFT: Sparse Iso-FLOP Transformations for Maximizing Training Efficiency https://arxiv.org/abs/2303.11525#new_tab Wed, 22 Mar 2023 16:53:24 +0000 https://www.cerebras.net/?p=104632 Replacing dense layers with Sparse-IFT leads to significant improvements across computer vision (CV) and natural language processing (NLP) tasks, including ResNet-18 on ImageNet (+3.5%) and GPT-3 Small on WikiText-103 (-0.4 PPL), both matching larger dense model variants with 2x or…

The post Sparse-IFT: Sparse Iso-FLOP Transformations for Maximizing Training Efficiency appeared first on Cerebras.

]]>
SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models https://arxiv.org/abs/2303.10464#new_tab Tue, 21 Mar 2023 16:41:45 +0000 https://www.cerebras.net/?p=104624 Presented at the ICLR 2023 Workshop on Sparsity in Neural Networks.
In this work, we show the benefits of using unstructured weight sparsity to train only a subset of weights during pre-training (Sparse Pre-training) and then recover the representational capacity…

The post SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models appeared first on Cerebras.

]]>
Researchers Can Get Free Access to World’s Largest Chip Supporting GPT-3 https://www.hpcwire.com/2023/02/28/researchers-can-get-free-access-to-worlds-largest-chip-supporting-gpt-3/#new_tab Tue, 28 Feb 2023 21:21:42 +0000 https://www.cerebras.net/?p=104531

The post Researchers Can Get Free Access to World’s Largest Chip Supporting GPT-3 appeared first on Cerebras.

]]>
A Digital Twin for Intense Weather Gives Scientists a ‘Control Loop’ https://www.zdnet.com/article/a-digital-twin-for-intense-weather-gives-scientists-a-control-loop/#new_tab Wed, 08 Feb 2023 01:22:26 +0000 https://www.cerebras.net/?p=104370

The post A Digital Twin for Intense Weather Gives Scientists a ‘Control Loop’ appeared first on Cerebras.

]]>
Decarbonization Initiative at NETL Gets Computing Boost https://www.hpcwire.com/2023/02/07/decarbonization-initiative-at-netl-gets-computing-boost/#new_tab Tue, 07 Feb 2023 23:06:20 +0000 https://www.cerebras.net/?p=104369

The post Decarbonization Initiative at NETL Gets Computing Boost appeared first on Cerebras.

]]>
Cerebras Announces Pay-As-You-Go AI Training On Cirrascale Cloud https://www.forbes.com/sites/karlfreund/2022/12/05/cerebras-announces-pay-as-you-go-ai-training-on-cirrascale-cloud#new_tab Mon, 05 Dec 2022 15:29:13 +0000 https://www.cerebras.net/?p=104229

The post Cerebras Announces Pay-As-You-Go AI Training On Cirrascale Cloud appeared first on Cerebras.

]]>
SC22 is a Wrap! https://www.cerebras.net/blog/sc22-is-a-wrap Thu, 01 Dec 2022 02:18:29 +0000 https://www.cerebras.net/?p=104200

The post SC22 is a Wrap! appeared first on Cerebras.

]]>
Gordon Bell Nominee Used LLMs, HPC, Cerebras CS-2 to Predict Covid Variants https://www.hpcwire.com/2022/11/17/gordon-bell-nominee-used-llms-hpc-cerebras-cs-2-to-predict-covid-variants/#new_tab Fri, 18 Nov 2022 00:14:18 +0000 https://www.cerebras.net/?p=104218

The post Gordon Bell Nominee Used LLMs, HPC, Cerebras CS-2 to Predict Covid Variants appeared first on Cerebras.

]]>
Cerebras Wants Its Piece Of An Increasingly Heterogeneous HPC World https://www.nextplatform.com/2022/11/16/cerebras-wants-its-piece-of-an-increasingly-heterogenous-hpc-world/#new_tab Thu, 17 Nov 2022 00:38:17 +0000 https://www.cerebras.net/?p=104221

The post Cerebras Wants Its Piece Of An Increasingly Heterogeneous HPC World appeared first on Cerebras.

]]>
Hungry for AI? New supercomputer contains 16 dinner-plate-size chips https://arstechnica.com/information-technology/2022/11/hungry-for-ai-new-supercomputer-contains-16-dinner-plate-size-chips/#new_tab Tue, 15 Nov 2022 00:25:28 +0000 https://www.cerebras.net/?p=104219

The post Hungry for AI? New supercomputer contains 16 dinner-plate-size chips appeared first on Cerebras.

]]>
Genomics in Unparalleled Resolution: Cerebras Wafer-Scale Cluster Trains Large Language Models on the Full COVID Genome Sequence https://www.cerebras.net/blog/genomics-in-unparalleled-resolution-cerebras-wafer-scale-cluster-trains-large-language-models-on-the-full-covid-genome-sequence Mon, 14 Nov 2022 14:00:33 +0000 https://www.cerebras.net/?p=104111

The post Genomics in Unparalleled Resolution: Cerebras Wafer-Scale Cluster Trains Large Language Models on the Full COVID Genome Sequence appeared first on Cerebras.

]]>
Real-Time Computational Physics with Wafer-Scale Processing https://www.cerebras.net/blog/real-time-computational-physics-with-wafer-scale-processing Thu, 10 Nov 2022 18:02:11 +0000 https://www.cerebras.net/?p=103891

The post Real-Time Computational Physics with Wafer-Scale Processing appeared first on Cerebras.

]]>
Cerebras Goes Massive at Supercomputing 2022 https://www.cerebras.net/blog/cerebras-goes-massive-at-supercomputing-2022 Thu, 20 Oct 2022 03:47:15 +0000 https://www.cerebras.net/?p=104069

The post Cerebras Goes Massive at Supercomputing 2022 appeared first on Cerebras.

]]>
TensorFlow as a DSL for stencil-based computation on the Cerebras Wafer-Scale Engine https://arxiv.org/abs/2210.04795#new_tab Fri, 26 Aug 2022 17:10:18 +0000 https://www.cerebras.net/?p=104540 The Cerebras Wafer Scale Engine (WSE) is an accelerator that combines hundreds of thousands of AI-cores onto a single chip. Whilst this technology has been designed for machine learning workloads, the significant amount of available raw compute means that it…

The post TensorFlow as a DSL for stencil-based computation on the Cerebras Wafer-Scale Engine appeared first on Cerebras.

]]>
Cerebras Wafer-Scale Engine Inducted into the Computer History Museum https://www.cerebras.net/blog/cerebras-wafer-scale-engine-inducted-into-the-computer-history-museum/ Thu, 04 Aug 2022 03:16:54 +0000 https://www.cerebras.net/?p=103864

The post Cerebras Wafer-Scale Engine Inducted into the Computer History Museum appeared first on Cerebras.

]]>
Cerebras Makes It Easy to Harness the Predictive Power of GPT-J https://www.cerebras.net/blog/cerebras-makes-it-easy-to-harness-the-predictive-power-of-gpt-j Thu, 23 Jun 2022 00:18:38 +0000 https://www.cerebras.net/?p=103673

The post Cerebras Makes It Easy to Harness the Predictive Power of GPT-J appeared first on Cerebras.

]]>
Cerebras Systems Sets Record for Largest AI Models Ever Trained on A Single Device https://www.cerebras.net/press-release/cerebras-systems-sets-record-for-largest-ai-models-ever-trained-on-a-single-device/ Wed, 22 Jun 2022 13:00:17 +0000 https://www.cerebras.net/?p=103619

The post Cerebras Systems Sets Record for Largest AI Models Ever Trained on A Single Device appeared first on Cerebras.

]]>
Deep Learning Programming at Scale https://8968533.fs1.hubspotusercontent-na1.net/hubfs/8968533/Whitepapers/Cerebras-Whitepaper-ProgrammingAtScale.pdf#new_tab Mon, 06 Jun 2022 18:27:06 +0000 https://cerebras.net/?p=103263 Deep learning has become one of the most important computational workloads of our generation, advancing applications across industries from healthcare to autonomous driving. But it is also profoundly computationally intensive. (Updated June 2022.)…

The post Deep Learning Programming at Scale appeared first on Cerebras.

]]>
Leading Supercomputer Sites Choose Cerebras For AI Acceleration https://www.cerebras.net/press-release/leading-supercomputer-sites-choose-cerebras-for-ai-acceleration/ Tue, 31 May 2022 15:05:35 +0000 https://www.cerebras.net/?p=103587

The post Leading Supercomputer Sites Choose Cerebras For AI Acceleration appeared first on Cerebras.

]]>
NCSA Deploys Cerebras CS-2 in New HOLL-I Supercomputer for Large-Scale Artificial Intelligence https://www.cerebras.net/press-release/ncsa-deploys-cerebras-cs-2-in-new-holl-i-supercomputer-for-large-scale-artificial-intelligence/ Tue, 31 May 2022 14:00:25 +0000 https://www.cerebras.net/?p=103586

The post NCSA Deploys Cerebras CS-2 in New HOLL-I Supercomputer for Large-Scale Artificial Intelligence appeared first on Cerebras.

]]>
LRZ Adds Mega AI System as It Stacks up on Future Computing Systems https://www.hpcwire.com/2022/05/25/lrz-adds-mega-ai-aystem-as-it-stacks-up-on-future-computing-systems/#new_tab Fri, 27 May 2022 04:35:12 +0000 https://www.cerebras.net/?p=103579

The post LRZ Adds Mega AI System as It Stacks up on Future Computing Systems appeared first on Cerebras.

]]>
HPE, Cerebras build AI supercomputer for scientific research https://www.theregister.com/2022/05/25/hpe_cerebras_lrz/#new_tab Fri, 27 May 2022 04:31:27 +0000 https://www.cerebras.net/?p=103578

The post HPE, Cerebras build AI supercomputer for scientific research appeared first on Cerebras.

]]>
Leibniz Supercomputing Centre Accelerates AI Innovation in Bavaria with Next-Generation AI System from Cerebras Systems and Hewlett Packard Enterprise https://www.cerebras.net/press-release/leibniz-supercomputing-centre-accelerates-ai-innovation-in-bavaria-with-next-generation-ai-system-from-cerebras-systems-and-hewlett-packard-enterprise/ Wed, 25 May 2022 12:00:27 +0000 https://cerebras.net/?p=103548

The post Leibniz Supercomputing Centre Accelerates AI Innovation in Bavaria with Next-Generation AI System from Cerebras Systems and Hewlett Packard Enterprise appeared first on Cerebras.

]]>
Cerebras @ AI Field Day 2022 https://www.cerebras.net/event/cerebras-ai-field-day-2022/ Tue, 24 May 2022 00:25:55 +0000 https://cerebras.net/?p=103550

The post Cerebras @ AI Field Day 2022 appeared first on Cerebras.

]]>
2022 Best Tech Startups in Sunnyvale https://thetechtribune.com/10-best-tech-startups-in-sunnyvale/#new_tab Tue, 17 May 2022 17:12:59 +0000 https://cerebras.net/?p=103500

The post 2022 Best Tech Startups in Sunnyvale appeared first on Cerebras.

]]>
2022 Best Places to Work in the Bay Area https://www.bizjournals.com/sanfrancisco/event/167588/2022/best-places-to-work-in-the-bay-area-awards#new_tab Tue, 17 May 2022 17:08:39 +0000 https://cerebras.net/?p=103498

The post 2022 Best Places to Work in the Bay Area appeared first on Cerebras.

]]>
2022 Entrepreneur of the Year, Computer Hardware https://stevieawards.com/aba/entrepreneur-awards#new_tab Tue, 17 May 2022 16:58:02 +0000 https://cerebras.net/?p=103495

The post 2022 Entrepreneur of the Year, Computer Hardware appeared first on Cerebras.

]]>
2022 Best of Show for Cerebras CS-2 https://www.bio-itworld.com/news/2022/05/05/bio-it-world-judges-community-honor-six-outstanding-new-products#new_tab Tue, 17 May 2022 16:16:00 +0000 https://cerebras.net/?p=103493

The post 2022 Best of Show for Cerebras CS-2 appeared first on Cerebras.

]]>
Cerebras Wins Best Places to Work in the San Francisco Bay Area Award https://cerebras.net/join-us/#new_tab Fri, 13 May 2022 01:13:15 +0000 https://cerebras.net/?p=103458

The post Cerebras Wins Best Places to Work in the San Francisco Bay Area Award appeared first on Cerebras.

]]>
Bio-IT World Judges, Community Honor Six Outstanding New Products https://www.bio-itworld.com/news/2022/05/05/bio-it-world-judges-community-honor-six-outstanding-new-products#new_tab Fri, 06 May 2022 00:20:42 +0000 https://www.cerebras.net/?p=103571

The post Bio-IT World Judges, Community Honor Six Outstanding New Products appeared first on Cerebras.

]]>
Argonne Talks AI Accelerators for COVID Research https://www.hpcwire.com/2022/04/28/argonne-talks-ai-accelerators-for-covid-research/#new_tab Fri, 29 Apr 2022 00:03:11 +0000 https://www.cerebras.net/?p=103570

The post Argonne Talks AI Accelerators for COVID Research appeared first on Cerebras.

]]>
Cerebras Systems’ dinner plate-sized chips are revolutionizing the field of AI https://thenextweb.com/news/cerebras-systems-dinner-plate-sized-chips-are-revolutionizing-field-of-ai#new_tab Thu, 28 Apr 2022 23:59:47 +0000 https://www.cerebras.net/?p=103568 When the chip is the size of a big pizza pie… that’s Cerebras…

The post Cerebras Systems’ dinner plate-sized chips are revolutionizing the field of AI appeared first on Cerebras.

]]>
Multimodal Machine Learning for Government https://www.cerebras.net/blog/multimodal-machine-learning-for-government Tue, 26 Apr 2022 15:54:14 +0000 https://cerebras.net/?p=103543

The post Multimodal Machine Learning for Government appeared first on Cerebras.

]]>
Accelerating insights in large scale AI projects https://www.enterpriseai.news/2022/04/25/accelerating-insights-in-large-scale-ai-projects/#new_tab Mon, 25 Apr 2022 23:38:27 +0000 https://www.cerebras.net/?p=103566

The post Accelerating insights in large scale AI projects appeared first on Cerebras.

]]>
TotalEnergies Research & Technology USA Selects Cerebras Systems CS-2 to Accelerate Multi-Energy Research https://www.cerebras.net/press-release/totalenergies-research-technology-usa-selects-cerebras-systems-cs-2-to-accelerate-multi-energy-research/ Sat, 23 Apr 2022 05:01:19 +0000 https://cerebras.net/?p=103304 Update, March 13, 2022: a new paper by Mathias Jacquelin from our Kernel team and TotalEnergies’ Mauricio Araya-Polo and Jie Meng presents more detail on this remarkably efficient stencil algorithm and updated performance results. The CS-2 delivers more than 200x…

The post TotalEnergies Research & Technology USA Selects Cerebras Systems CS-2 to Accelerate Multi-Energy Research appeared first on Cerebras.

]]>
A Templated C++ Interface for ISL https://cerebras.net/wp-content/uploads/2021/04/IMPACT_2021_paper_2.pdf#new_tab Sat, 23 Apr 2022 04:24:02 +0000 https://cerebras.net/?p=103302 Polyhedral libraries typically support only a very limited collection of types for representing objects, corresponding to broad mathematical classes such as sets, binary relations and functions.…

The post A Templated C++ Interface for ISL appeared first on Cerebras.

]]>
Cerebras, TotalEnergies Announce Stencil Algorithm Leap https://www.hpcwire.com/2022/04/21/cerebras-totalenergies-announce-stencil-algorithm-leap/#new_tab Fri, 22 Apr 2022 16:38:27 +0000 https://cerebras.net/?p=103292

The post Cerebras, TotalEnergies Announce Stencil Algorithm Leap appeared first on Cerebras.

]]>
How healthcare and pharmaceutical research will accelerate through AI https://www.cerebras.net/in-the-news/how-healthcare-and-pharmaceutical-research-will-accelerate-through-ai/ Wed, 20 Apr 2022 22:28:48 +0000 https://cerebras.net/?p=103249

The post How healthcare and pharmaceutical research will accelerate through AI appeared first on Cerebras.

]]>
Cerebras Expands Support for Pytorch and Tensorflow Machine Learning Frameworks on the Wafer-Scale Engine 2 Processors that Power Its CS-2 System https://www.marktechpost.com/2022/04/20/cerebras-expands-support-for-pytorch-and-tensorflow-machine-learning-frameworks-on-the-wafer-scale-engine-2-processors-that-power-its-cs-2-system/#new_tab Wed, 20 Apr 2022 22:26:50 +0000 https://cerebras.net/?p=103247 Deep learning has emerged as our generation’s most critical computing job. Tasks that were once the unique realm of humans are now regularly executed at human or superhuman levels by computers.…

The post Cerebras Expands Support for Pytorch and Tensorflow Machine Learning Frameworks on the Wafer-Scale Engine 2 Processors that Power Its CS-2 System appeared first on Cerebras.

]]>
Accelerating Discovery: Andrew Feldman, Co-Founder and CEO, Cerebras Systems https://eclipse.vc/blog/accelerating-discovery-andrew-feldman-co-founder-and-ceo-cerebras-systems/?utm_campaign=Corporate%20PR%202022&utm_content=205225902&utm_medium=social&utm_source=twitter&hss_channel=tw-751545566778171392#new_tab Wed, 20 Apr 2022 21:51:11 +0000 https://cerebras.net/?p=103246 New hardware can substantially increase the speed and efficiency of deep neural network training. To guide the development of future hardware architectures, it is pertinent to explore the hardware and machine learning properties of alternative training algorithms.…

The post Accelerating Discovery: Andrew Feldman, Co-Founder and CEO, Cerebras Systems appeared first on Cerebras.

]]>
PSC UPGRADES NEOCORTEX AI SUPERCOMPUTER WITH NEW CEREBRAS ENGINES https://www.nextplatform.com/2022/04/14/psc-upgrades-neocortex-ai-supercomputer-with-new-cerebras-engines/#new_tab Thu, 14 Apr 2022 22:35:43 +0000 https://cerebras.net/?p=103251 If you were going to build an electronic brain in 2022, it might look something like the Neocortex supercomputer at the Pittsburgh Supercomputing Center at Carnegie Mellon University. That machine, which was only installed last year, has now got a…

The post PSC UPGRADES NEOCORTEX AI SUPERCOMPUTER WITH NEW CEREBRAS ENGINES appeared first on Cerebras.

]]>
Getting Started with PyTorch BERT Models https://www.cerebras.net/blog/getting-started-with-pytorch-bert-models-on-the-cerebras-cs-2-system/ Thu, 14 Apr 2022 21:09:49 +0000 https://cerebras.net/?p=2221

The post Getting Started with PyTorch BERT Models appeared first on Cerebras.

]]>
TotalEnergies and Cerebras Create Massively Scalable Stencil Algorithm https://www.cerebras.net/blog/totalenergies-and-cerebras-create-massively-scalable-stencil-algorithm/ Thu, 14 Apr 2022 14:30:40 +0000 https://cerebras.net/?p=2212

The post TotalEnergies and Cerebras Create Massively Scalable Stencil Algorithm appeared first on Cerebras.

]]>
Cerebras Systems Expands PyTorch Support, Delivers Capability for Giant Model Training https://www.cerebras.net/press-release/cerebras-systems-expands-pytorch-support-delivers-capability-for-giant-model-training/ Thu, 14 Apr 2022 05:50:52 +0000 https://cerebras.net/?p=103306 SUNNYVALE, Calif – April 13, 2022 — Cerebras Systems, the pioneer in high performance artificial intelligence (AI) computing, today released version 1.2 of the Cerebras Software Platform, CSoft, with expanded support for PyTorch and TensorFlow. In addition, customers…

The post Cerebras Systems Expands PyTorch Support, Delivers Capability for Giant Model Training appeared first on Cerebras.

]]>
Cerebras Software Platform R1.2 is Out! https://www.cerebras.net/blog/cerebras-software-platform-r1.2-is-out Wed, 13 Apr 2022 12:30:03 +0000 https://cerebras.net/?p=2192

The post Cerebras Software Platform R1.2 is Out! appeared first on Cerebras.

]]>
Powering Extreme-Scale HPC with Cerebras WaferScale Accelerators https://8968533.fs1.hubspotusercontent-na1.net/hubfs/8968533/Powering-Extreme-Scale-HPC-with-Cerebras.pdf#new_tab Wed, 06 Apr 2022 23:54:21 +0000 https://cerebras.net/?p=103256 In this paper, we will explore the challenges facing HPC developers today and show how the Cerebras architecture can help to accelerate sparse linear algebra and tensor workloads, stencilbased partial differential equation (PDE) solvers, N-body problems, and spectral algorithms such…

The post Powering Extreme-Scale HPC with Cerebras WaferScale Accelerators appeared first on Cerebras.

]]>
When Time is Money: Accelerating NLP Model Training at a Leading Financial Institution https://www.cerebras.net/blog/when-time-is-money-accelerating-nlp-model-training-at-a-major-financial-institution/ Mon, 21 Mar 2022 18:40:23 +0000 https://cerebras.net/?p=2142

The post When Time is Money: Accelerating NLP Model Training at a Leading Financial Institution appeared first on Cerebras.

]]>
nference Accelerates Self-Supervised Language Model Training with Cerebras CS-2 System https://www.cerebras.net/press-release/march-14-2022-nference-accelerates-self-supervised-language-model-training-with-cerebras-cs-2-system/ Tue, 15 Mar 2022 05:40:42 +0000 https://cerebras.net/?p=103305 SUNNYVALE, Calif. – Cerebras Systems, the pioneer in high performance artificial intelligence (AI) compute, and nference, an AI-driven health technology company, today announced a collaboration to accelerate natural language processing (NLP) for biomedical research and development by orders of…

The post nference Accelerates Self-Supervised Language Model Training with Cerebras CS-2 System appeared first on Cerebras.

]]>
TotalEnergies and Cerebras: Accelerating into a Multi-Energy Future (Updated) https://www.cerebras.net/blog/accelerating-into-a-multi-energy-future/ Wed, 02 Mar 2022 14:00:14 +0000 https://cerebras.net/?p=2029

The post TotalEnergies and Cerebras: Accelerating into a Multi-Energy Future (Updated) appeared first on Cerebras.

]]>
The Cerebras Software Development Kit: A Technical Overview https://f.hubspotusercontent30.net/hubfs/8968533/Cerebras%20SDK%20Technical%20Overview%20White%20Paper.pdf?utm_campaign=Tech%20Leadership%20PR%202022&utm_source=SDK_WP#new_tab Tue, 08 Feb 2022 01:06:52 +0000 https://cerebras.net/?p=103259 Cerebras has introduced a new software development kit (SDK) which allows anyone to take advantage of the strengths of the CS-2 system. Developers can use the Cerebras SDK to create custom kernels for their standalone applications or modify the kernel…

The post The Cerebras Software Development Kit: A Technical Overview appeared first on Cerebras.

]]>
Epigenomic language models powered by Cerebras https://arxiv.org/abs/2112.07571#new_tab Thu, 27 Jan 2022 04:25:10 +0000 https://cerebras.net/?p=103293 Large scale self-supervised pre-training of Transformer language models has advanced the field of Natural Language Processing and shown promise in cross-application to the biological `languages’ of proteins and DNA. Learning effective representations of DNA sequences using large genomic sequence corpuses…

The post Epigenomic language models powered by Cerebras appeared first on Cerebras.

]]>
GlaxoSmithKline and Cerebras are Advancing the State of the Art in AI for Drug Discovery https://www.cerebras.net/blog/glaxosmithkline-and-cerebras-are-advancing-the-state-of-the-art-in-ai-for-drug-discovery/ Wed, 26 Jan 2022 15:55:45 +0000 https://cerebras.net/?p=1957 Kim Branson, SVP & Global Head of Artificial Intelligence and Machine Learning, Meredith Trotter, and Stephen Young, GSK.
Natalia Vassilieva, Director of Product, Machine Learning, and Rebecca Lewington, Technology Evangelist, Cerebras Systems.
January 26, 2022
Artificial intelligence has the potential…

The post GlaxoSmithKline and Cerebras are Advancing the State of the Art in AI for Drug Discovery appeared first on Cerebras.

]]>
If You’re Doing Pharma and Life Sciences AI Research Without a Cerebras System, You’re Doing it Wrong https://www.cerebras.net/blog/if-youre-doing-pharma-and-life-sciences-research-without-cerebras-system-youre-doing-it-wrong/ Fri, 14 Jan 2022 17:45:29 +0000 https://cerebras.net/?p=2104

The post If You’re Doing Pharma and Life Sciences AI Research Without a Cerebras System, You’re Doing it Wrong appeared first on Cerebras.

]]>
Microprocessor at 50. The Path to Successful Wafer-Scale Integration: The Cerebras Story https://8968533.fs1.hubspotusercontent-na1.net/hubfs/8968533/IEEE%20Micro%202021-11%20Path%20to%20Wafer-Scale%20Integration.pdf#new_tab Fri, 19 Nov 2021 22:38:04 +0000 https://www.cerebras.net/?p=104723 IEEE Micro Volume 41, Issue 6, took a look back at the first 50 years of the microprocessor, and forward to what’s next. It featured this article by Gary Lauterbach, Co-Founder
and the Chief Technology Officer of Cerebras Systems, which…

The post Microprocessor at 50. The Path to Successful Wafer-Scale Integration: The Cerebras Story appeared first on Cerebras.

]]>
Cerebras Systems and G42 to Partner to Bring High-Performance AI Compute to the Middle East https://www.cerebras.net/press-release/cerebras-systems-and-g42-to-partner-to-bring-high-performance-ai-compute-to-the-middle-east/ Thu, 18 Nov 2021 06:56:51 +0000 https://cerebras.net/?p=103307 DUBAI – November 22, 2021 – Cerebras Systems, the pioneer in accelerating artificial intelligence (AI) compute, and G42, the leading UAE-based AI and cloud computing company, today announced at GMIS the signing of a memorandum of understanding (MOU)…

The post Cerebras Systems and G42 to Partner to Bring High-Performance AI Compute to the Middle East appeared first on Cerebras.

]]>
Intelligent Resolution: Integrating Cryo-EM with AI-driven Multi-resolution Simulations to Observe the SARS-CoV-2 Replication-Transcription Machinery in Action https://www.biorxiv.org/content/10.1101/2021.10.09.463779v1.full.pdf#new_tab Thu, 18 Nov 2021 05:25:03 +0000 https://cerebras.net/?p=103303 The severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2) replication transcription complex (RTC) is a multi-domain protein responsible for replicating and transcribing the viral mRNA inside a human cell. Attacking RTC function with pharmaceutical com- pounds is a pathway to treating COVID-19.…

The post Intelligent Resolution: Integrating Cryo-EM with AI-driven Multi-resolution Simulations to Observe the SARS-CoV-2 Replication-Transcription Machinery in Action appeared first on Cerebras.

]]>
Cerebras Goes Big at Supercomputing 2021 https://www.cerebras.net/blog/sc21 Tue, 16 Nov 2021 14:00:26 +0000 https://cerebras.net/?p=1846 Rebecca Lewington, Technology Evangelist | November 16, 2021
There’s a lot to do at the Cerebras Virtual Experience
The Supercomputing Conference is where the High-Performance Computing (HPC) world comes together to show off the latest advances in high performance computing,…

The post Cerebras Goes Big at Supercomputing 2021 appeared first on Cerebras.

]]>
Cerebras Systems Introduces Software Development Kit to Extend Breadth of Wafer-Scale Applications https://www.cerebras.net/press-release/cerebras-systems-introduces-software-development-kit-to-extend-breadth-of-wafer-scale-applications/ Tue, 16 Nov 2021 07:07:47 +0000 https://cerebras.net/?p=103308

The post Cerebras Systems Introduces Software Development Kit to Extend Breadth of Wafer-Scale Applications appeared first on Cerebras.

]]>
Cerebras Systems Raises $250M in Funding for Over $4B Valuation to Advance the Future of Artificial Intelligence Compute https://www.cerebras.net/press-release/cerebras-systems-raises-250m-in-funding-for-over-4b-valuation-to-advance-the-future-of-artificial-intelligence-compute/ Thu, 11 Nov 2021 07:17:18 +0000 https://cerebras.net/?p=103310

The post Cerebras Systems Raises $250M in Funding for Over $4B Valuation to Advance the Future of Artificial Intelligence Compute appeared first on Cerebras.

]]>
Scaling and Operationalizing AI in Government https://www.cerebras.net/blog/scaling-and-operationalizing-ai-in-government/ Mon, 18 Oct 2021 18:30:48 +0000 https://cerebras.net/?p=1725 Gil Haberman, Senior Director of Product Marketing
Scaling and Operationalizing AI in Government  
Today at AI World Government 2021, Andy Hock our VP of Product, shared our vision of how Cerebras Systems can empower government organizations to harness the power…

The post Scaling and Operationalizing AI in Government appeared first on Cerebras.

]]>
Cerebras – Eye On AI https://www.eye-on.ai/podcast-086#new_tab Mon, 18 Oct 2021 14:52:08 +0000 https://cerebras.net/?p=103552 Andrew Feldman, one of the founders and CEO of Cerebras Systems, talks about the company’s wafer-scale computer chip optimized for machine learning and about the network of chips that company has built that has as much computing power as a…

The post Cerebras – Eye On AI appeared first on Cerebras.

]]>
Cerebras Systems Enables Brain-scale AI https://f.hubspotusercontent30.net/hubfs/8968533/Cerebras%20Lays%20the%20Foundation%20for%20Brain-Scale%20AI.pdf#new_tab Wed, 22 Sep 2021 00:12:54 +0000 https://cerebras.net/?p=103261 This research paper explores Cerebras System’s approach to create a brain-scale AI and the new technologies that could enable that feat. But first, let’s put this discussion into the proper context. Just how big is a 120 trillion-parameter model?…

The post Cerebras Systems Enables Brain-scale AI appeared first on Cerebras.

]]>
Cirrascale Cloud Services® and Cerebras Systems Announce Availability of Cerebras Cloud @ Cirrascale for Unparalleled Artificial Intelligence Performance https://www.cerebras.net/press-release/cirrascale-cloud-services-and-cerebras-systems-announce-availability-of-cerebras-cloud-cirrascale-for-unparalleled-artificial-intelligence-performance/ Fri, 17 Sep 2021 06:40:04 +0000 https://cerebras.net/?p=103522

The post Cirrascale Cloud Services® and Cerebras Systems Announce Availability of Cerebras Cloud @ Cirrascale for Unparalleled Artificial Intelligence Performance appeared first on Cerebras.

]]>
Announcing Cerebras Cloud @ Cirrascale, Democratizing High-Performance AI Compute https://www.cerebras.net/blog/announcing-cerebras-cloud-cirrascale-democratizing-high-performance-ai-compute/ Thu, 16 Sep 2021 06:00:39 +0000 https://cerebras.net/?p=1641 Gil Haberman, Sr. Director of Product Marketing | September 16, 2021
Democratizing High-Performance AI Compute  
Today, we are thrilled to announce  the availability of Cerebras Cloud @ Cirrascale, delivering the world’s fastest AI accelerator as a cloud service! Nearly…

The post Announcing Cerebras Cloud @ Cirrascale, Democratizing High-Performance AI Compute appeared first on Cerebras.

]]>
Scaling Up and Out: Training Massive Models on Cerebras Systems using Weight Streaming https://www.cerebras.net/blog/scaling-up-and-out-training-massive-models-on-cerebras-systems-using-weight-streaming/ Tue, 14 Sep 2021 22:45:33 +0000 https://cerebras.net/?p=1648

The post Scaling Up and Out: Training Massive Models on Cerebras Systems using Weight Streaming appeared first on Cerebras.

]]>
Announcing the Cerebras Architecture for Extreme-Scale AI https://www.cerebras.net/blog/announcing-the-cerebras-architecture-for-extreme-scale-ai/ https://www.cerebras.net/blog/announcing-the-cerebras-architecture-for-extreme-scale-ai/#comments Tue, 24 Aug 2021 12:01:15 +0000 https://cerebras.net/?p=1586 Sean Lie, Co-Founder and Chief Hardware Architect | August 24, 2021
Today at the Hot Chips conference, we proudly unveiled the world’s first multi-million core AI cluster architecture! Our unique technology handles neural networks with up to an astonishing 120…

The post Announcing the Cerebras Architecture for Extreme-Scale AI appeared first on Cerebras.

]]>
https://www.cerebras.net/blog/announcing-the-cerebras-architecture-for-extreme-scale-ai/feed/ 2
Cerebras Systems Announces World’s First Brain-Scale Artificial Intelligence Solution https://www.cerebras.net/press-release/cerebras-systems-announces-worlds-first-brain-scale-artificial-intelligence-solution/ Tue, 24 Aug 2021 16:13:16 +0000 https://cerebras.net/?p=103523

The post Cerebras Systems Announces World’s First Brain-Scale Artificial Intelligence Solution appeared first on Cerebras.

]]>
An AI Chip With Unprecedented Performance To Do the Unimaginable https://www.cerebras.net/blog/an-ai-chip-with-unprecedented-performance-to-do-the-unimaginable/ Tue, 17 Aug 2021 03:36:14 +0000 https://cerebras.net/?p=1565 Dhiraj Mallick,  VP Engineering & Business Development | August 16, 2021
AI accelerator chips have made machine learning a reality in nearly every industry. With unprecedented pace of compute demand, model size and data growth, the need for high performance…

The post An AI Chip With Unprecedented Performance To Do the Unimaginable appeared first on Cerebras.

]]>
Stream-AI-MD: streaming AI-driven adaptive molecular simulations for heterogeneous computing platforms https://dl.acm.org/doi/10.1145/3468267.3470578#new_tab Tue, 06 Jul 2021 04:02:23 +0000 https://cerebras.net/?p=103299 Emerging hardware tailored for artificial intelligence (AI) and machine learning (ML) methods provide novel means to couple them with traditional high performance computing (HPC) workflows involving molecular dynamics (MD) simulations. We propose Stream-AI-MD, a novel instance of applying deep learning…

The post Stream-AI-MD: streaming AI-driven adaptive molecular simulations for heterogeneous computing platforms appeared first on Cerebras.

]]>
Limits to Scale-Out for Training Language Models https://f.hubspotusercontent30.net/hubfs/8968533/Cerebras-Whitepaper_ScalingNLPTraining-4.pdf#new_tab Fri, 25 Jun 2021 00:23:58 +0000 https://cerebras.net/?p=103262 Natural language processing has revolutionized how data is consumed, meaning that computational demand has skyrocketed. Companies in every industry are using graphics processing unit (GPU) clusters to keep up. But is this really the best solution?…

The post Limits to Scale-Out for Training Language Models appeared first on Cerebras.

]]>
Innovative AI Projects land in Edinburgh https://www.cerebras.net/blog/innovative-ai-projects-land-in-edinburgh/ Thu, 17 Jun 2021 23:39:09 +0000 https://cerebras.net/?p=1284 Rupal Hollenbeck, Formerly CMO at Cerebras Systems | June 17, 2021
Data scientists and AI researchers from the private and public sector gathered June 10th virtually at the EPCC to learn more about The Edinburgh International Data Facility, and specifically…

The post Innovative AI Projects land in Edinburgh appeared first on Cerebras.

]]>
Train Large BERT Models Faster with Cerebras Systems https://f.hubspotusercontent30.net/hubfs/8968533/Cerebras-Whitepaper_ScalingBERT_V6.pdf#new_tab Tue, 25 May 2021 00:39:22 +0000 https://cerebras.net/?p=103266 Unstructured text is one of the largest human-generated data sources. Web data, academic publications, emails, traditional media, texts, instant messages, digital records, social media — all hold an enormous volume of unstructured text.…

The post Train Large BERT Models Faster with Cerebras Systems appeared first on Cerebras.

]]>
Customer Blog: AstraZeneca’s Lars Lynne Hansen https://larslynnehansen.medium.com/accelerating-drug-discovery-research-with-new-ai-models-a-look-at-the-astrazeneca-cerebras-b72664d8783#new_tab Mon, 26 Apr 2021 17:48:02 +0000 https://cerebras.net/?p=1326

The post Customer Blog: AstraZeneca’s Lars Lynne Hansen appeared first on Cerebras.

]]>
Customer Blog: Accelerating Drug Discovery with New AI Models https://www.cerebras.net/drug-discovery/accelerating-drug-discovery-research-with-new-ai-models-a-look-at-the-astrazeneca-cerebras-collaboration/ Mon, 26 Apr 2021 00:30:35 +0000 https://cerebras.net/?p=1446 See the original article at: https://larslynnehansen.medium.com/accelerating-drug-discovery-research-with-new-ai-models-a-look-at-the-astrazeneca-cerebras-b72664d8783

The post Customer Blog: Accelerating Drug Discovery with New AI Models appeared first on Cerebras.

]]>
Cerebras Systems: Achieving Industry Best AI Performance Through A Systems Approach https://8968533.fs1.hubspotusercontent-na1.net/hubfs/8968533/Whitepapers/Cerebras-CS-2-Whitepaper.pdf#new_tab Wed, 07 Apr 2021 00:51:34 +0000 https://cerebras.net/?p=103454 The CS-2 is a system solution that consists of innovations across three dimensions: a) the second
generation Cerebras Wafer Scale Engine (WSE-2) — the industry’s largest and only multi-trilliontransistor processor, b) the Cerebras System and c) the Cerebras software platform.…

The post Cerebras Systems: Achieving Industry Best AI Performance Through A Systems Approach appeared first on Cerebras.

]]>
Memory Efficient 3D U-Net with Reversible Mobile Inverted Bottlenecks for Brain Tumor Segmentation https://www.springerprofessional.de/en/memory-efficient-3d-u-net-with-reversible-mobile-inverted-bottle/19007114#new_tab Sat, 06 Mar 2021 04:40:10 +0000 https://cerebras.net/?p=103295 We propose combining memory saving techniques with traditional U-Net architectures to increase the complexity of the models on the Brain Tumor Segmentation (BraTS) challenge. The BraTS challenge consists of a 3D segmentation of a 240 240 155 4 input image…

The post Memory Efficient 3D U-Net with Reversible Mobile Inverted Bottlenecks for Brain Tumor Segmentation appeared first on Cerebras.

]]>
Pipelined Backpropagation at Scale: Training Large Models without Batches https://proceedings.mlsys.org/paper/2021/hash/9b8619251a19057cff70779273e95aa6-Abstract.html#new_tab Mon, 01 Mar 2021 18:29:17 +0000 https://cerebras.net/?p=103242 New hardware can substantially increase the speed and efficiency of deep neural network training. To guide the development of future hardware architectures, it is pertinent to explore the hardware and machine learning properties of alternative training algorithms.…

The post Pipelined Backpropagation at Scale: Training Large Models without Batches appeared first on Cerebras.

]]>
System Integration of Neocortex, a Unique, Scalable AI Platform https://dl.acm.org/doi/abs/10.1145/3437359.3465604#new_tab Thu, 04 Feb 2021 05:21:34 +0000 https://cerebras.net/?p=103301 The Pittsburgh Supercomputing Center, in partnership with Cerebras Systems and Hewlett Packard Enterprise, has deployed Neocortex, an innovative computing platform that accelerates scientific discovery by vastly shortening the time required for deep learning training and fosters greater integration of deep…

The post System Integration of Neocortex, a Unique, Scalable AI Platform appeared first on Cerebras.

]]>
EPCC Selects Cerebras Systems AI Supercomputer to Rapidly Accelerate AI Research https://www.businesswire.com/news/home/20210203005062/en/EPCC-Selects-Cerebras-Systems-AI-Supercomputer-to-Rapidly-Accelerate-AI-Research#new_tab Thu, 04 Feb 2021 01:22:55 +0000 https://cerebras.net/?p=103524

The post EPCC Selects Cerebras Systems AI Supercomputer to Rapidly Accelerate AI Research appeared first on Cerebras.

]]>
Beyond AI for Wafer Scale Compute: Setting Records in Computational Fluid Dynamics https://www.cerebras.net/blog/beyond-ai-for-wafer-scale-compute-setting-records-in-computational-fluid-dynamics/ Wed, 18 Nov 2020 05:54:29 +0000 https://cerebras.net/?p=931 In collaborations with researchers at the National Energy Technology Laboratory (NETL), Cerebras showed that a single wafer-scale Cerebras CS-1 can outperform one of the fastest supercomputers in the US by more than 200 X. The problem was to solve a…

The post Beyond AI for Wafer Scale Compute: Setting Records in Computational Fluid Dynamics appeared first on Cerebras.

]]>
Fast Stencil-Code Computation on a Wafer-Scale Processor https://arxiv.org/abs/2010.03660#new_tab Fri, 23 Oct 2020 04:00:21 +0000 https://cerebras.net/?p=103298 The performance of CPU-based and GPU-based systems is often low for PDE codes, where large, sparse, and often structured systems of linear equations must be solved. Iterative solvers are limited by data movement, both between caches and memory and between…

The post Fast Stencil-Code Computation on a Wafer-Scale Processor appeared first on Cerebras.

]]>
NYSE Executive Vice Chairman, Betty Liu, in conversation with Andrew Feldman, CEO at Cerebras https://www.cerebras.net/blog/nyse-executive-vice-chairman-betty-liu-in-conversation-with-andrew-feldman-ceo-at-cerebras/ Thu, 01 Oct 2020 22:17:10 +0000 https://cerebras.net/?p=942 Featuring interviews with NYSE Executive Vice Chairman Betty Liu and business leaders from the comfort of their homes to educate the world on how leaders are pushing their business forward through this global pandemic.
https://www.facebook.com/103155091022/posts/10158506533766023/
https://www.linkedin.com/feed/update/urn:li:activity:6717432222690893825/
https://twitter.com/NYSE/status/1311667189972430848

 

View this…

The post NYSE Executive Vice Chairman, Betty Liu, in conversation with Andrew Feldman, CEO at Cerebras appeared first on Cerebras.

]]>
Cerebras Systems Accelerates Global Expansion with New Japan Office and Appointment of Hiromasa Ebi as Country Manager https://www.cerebras.net/press-release/cerebras-systems-accelerates-global-expansion-with-new-japan-office-and-appointment-of-hiromasa-ebi-as-country-manager/ Thu, 06 Aug 2020 22:29:39 +0000 https://cerebras.net/?p=944 AI Leader Strengthens Local Support for Regional Systems Integrators with Industry-Leading CS-1 System
TOKYO and LOS ALTOS – August 6, 2020 – Cerebras Systems, the pioneer in accelerating artificial intelligence (AI) compute, today announced its international expansion in Japan…

The post Cerebras Systems Accelerates Global Expansion with New Japan Office and Appointment of Hiromasa Ebi as Country Manager appeared first on Cerebras.

]]>
The curious case of developmental BERTology: On sparsity, transfer learning, generalization and the brain https://arxiv.org/abs/2007.03774#new_tab Wed, 08 Jul 2020 03:57:12 +0000 https://cerebras.net/?p=103297 In this essay, we explore a point of intersection between deep learning and neuroscience, through the lens of large language models, transfer learning and network compression.…

The post The curious case of developmental BERTology: On sparsity, transfer learning, generalization and the brain appeared first on Cerebras.

]]>
LLNL Pairs Cerebras Chip with “Lassen” AI Supercomputer to Accelerate Research https://www.cerebras.net/blog/llnl-pairs-worlds-largest-computer-chip-from-cerebras-with-lassen-supercomputer-to-accelerate-ai-research/ Tue, 21 Apr 2020 22:26:49 +0000 https://cerebras.net/?p=943 Lawrence Livermore National Laboratory (LLNL) and artificial intelligence computer company Cerebras Systems have integrated the world’s largest computer chip into the National Nuclear Security Administration’s (NNSA’s) Lassen system, upgrading the top-tier supercomputer with cutting-edge AI technology to create a world-class…

The post LLNL Pairs Cerebras Chip with “Lassen” AI Supercomputer to Accelerate Research appeared first on Cerebras.

]]>
Error Compensation Mechanism in Online Normalization https://www.cerebras.net/blog/error-compensation-mechanism-in-online-normalization-2/ Mon, 20 Apr 2020 22:28:21 +0000 https://cerebras.net/?p=103348 Vitality Chiley, Machine Learning Engineer | April 3, 2020
Online Normalization [1] is a normalization technique that uses moving average statistics to normalize activations in a neural network. As we have shown in our NeurIPS2019 paper, Online Normalization outperforms…

The post Error Compensation Mechanism in Online Normalization appeared first on Cerebras.

]]>
Generating SIMD Instructions for Cerebras CS-1 using Polyhedral Compilation Techniques https://cerebras.net/wp-content/uploads/2021/04/IMPACT_2020_paper_3.pdf#new_tab Sun, 23 Feb 2020 05:03:52 +0000 https://cerebras.net/?p=103300 The Cerebras CS-1 is a computing system based on a waferscale processor having nearly 400,000 compute cores. It is intended for training of and inference on deep neural networks.…

The post Generating SIMD Instructions for Cerebras CS-1 using Polyhedral Compilation Techniques appeared first on Cerebras.

]]>
Online Normalization for Training Neural Networks https://papers.nips.cc/paper/2019/hash/cb3ce9b06932da6faaa7fc70d5b5d2f4-Abstract.html#new_tab Fri, 29 Nov 2019 23:15:48 +0000 https://cerebras.net/?p=103346 Polyhedral libraries typically support only a very limited collection of types for representing objects, corresponding to broad mathematical classes such as sets, binary relations and functions.…

The post Online Normalization for Training Neural Networks appeared first on Cerebras.

]]>
Online Normalization for Training Neural Networks, NeurIPS 2019 https://papers.nips.cc/paper/2019/hash/cb3ce9b06932da6faaa7fc70d5b5d2f4-Abstract.html#new_tab Thu, 16 May 2019 03:48:47 +0000 https://cerebras.net/?p=103296 Online Normalization is a new technique for normalizing the hidden activations of a neural network. Like Batch Normalization, it normalizes the sample dimension. While Online Normalization does not use batches, it is as accurate as Batch Normalization.…

The post Online Normalization for Training Neural Networks, NeurIPS 2019 appeared first on Cerebras.

]]>