The company has made considerable progress over the past year, including the release of the Grok-1 model and its subsequent updates. The funds from this round will be used to bring xAI's first products to market, build advanced infrastructure, and accelerate the research and development of future technologies.
The Grok-1 model is a highly advanced Al language model developed by xAl. It's known for its 314 billion parameters and utilizes a Mixture of Experts (MoE) architecture. The Grok-1 model was trained from scratch by xAl using a custom training stack on top of JAX and Rust, and it was open-sourced on March 17, 2024 2. The model is not fine- tuned for any specific application, such as dialogue, but rather provides a base model trained on a large amount of text data 2. The weights and architecture of Grok-1 are available under the Apache 2.0 license, and the model can be accessed and used by the public. Launched in July 2023, xAI is primarily focused on the development of advanced AI systems that are truthful, competent, and maximally beneficial for all of humanity. The company’s mission is to understand the true nature of the universe. With the open-source release of Grok-1, xAI has opened doors for advancements in various applications, optimizations, and extensions of the model.
Elon Musk, who is associated with xAI, has been an early and influential figure in the AI space. The company aims to develop AI systems that are truthful, competent, and maximally beneficial for humanity.
For those interested in joining xAI's mission, the company is currently hiring for various roles and those interested in experimenting with or contributing to the Grok-1 model, the code and weights are available on GitHub.
Advertisements