G42 and Cerebras Systems partnered to reduce AI training time. They are building Condor Galaxy, a cluster of nine supercomputers with a total capacity of 36 exaFLOPs. The first supercomputer, CG-1, has already been deployed and used to train Jais, an advanced language model. The partnership provided the needed supercomputer time.
G42 and Cerebras were discussing collaboration since 2021. They saw the rise of large language models and decided to work together. They built enough compute power to change the worldwide inventory and added new language models. The collaboration will bring AI benefits to the Arab-speaking world, including Arabic chatbots, government use, scientific projects, healthcare, and financial services. They anticipate many other applications as well.
Cerebras has developed two technologies to speed up training for large AI models. One is called Wafer-Scale Cluster, which connects multiple systems to work together as a single accelerator. The other is the Condor Galaxy AI supercomputer, powered by Cerebras' Wafer-Scale Engine, the largest and most powerful AI processor. This design increases memory for AI models from gigabytes to terabytes by separating memory from compute.