Cerebras Unleashes WSE-3 AI Chip: 4 Trillion Transistors Powering Next-Gen Supercomputing
March 13, 2024
Cerebras Systems introduced the Wafer Scale Engine 3 (WSE-3) AI chip, doubling the performance of the prior WSE-2 model.
The WSE-3 features an unprecedented 4 trillion transistors and 900,000 AI cores, along with 44GB of on-chip SRAM.
Cerebras' CS-3 supercomputer, utilizing WSE-3 chips, supports up to 24 trillion parameters and can cluster up to 2048 systems for extensive scaling capabilities.
Enhancements in Cerebras Software Framework include PyTorch 2.0 support and dynamic sparsity, which can speed up AI training by up to eightfold.
Strategic partnerships with entities such as Argonne National Laboratory and Mayo Clinic highlight the industry's confidence, alongside a significant backlog of orders for the CS-3.
The company's advancements aim to revolutionize AI chip technology with improvements in performance, scalability, and power efficiency, targeting applications in healthcare and beyond.
CEO Andrew Feldman's vision emphasizes reducing the cost of generative AI model inference and delivering a comprehensive, high-performance AI platform.
Summary based on 0 sources