Golem Network Unveils Updated AI/GPU Roadmap
Felix Pinkston Jul 23, 2024 13:29
Golem Network announces an updated AI/GPU roadmap focusing on market-validated initiatives, enhancing GPU resource supply for AI industry needs.
Golem Network has released an updated version of its AI/GPU roadmap, aiming to foster development and maximize benefits for the AI market. The revised roadmap emphasizes initiatives with market validation, allowing the allocation of resources to the most impactful projects, according to Golem Network.
Solutions Tailored for the AI Industry
The updated roadmap includes several tailored solutions based on feedback from developers, startups, and AI-based companies.
Modelserve
Modelserve is a service designed to run AI model inference at scale, affordably. It offers seamless deployment and inference through scalable endpoints, ensuring efficient and cost-effective operations for AI applications.
Golem-Workers
This API enables direct access to AI Workers for fine-tuning small AI models on single nodes of the Golem Network. It supports a variety of tasks beyond AI/ML payloads, offering flexibility and power to users.
Ensuring the Supply of GPU Resources for AI Industry Needs
GPU Provider
The GPU Provider enables the rental of a Virtual Machine with GPU, deployment of an image, and performing any calculations requiring parallel processing, not limited to AI/ML tasks.
AI Provider GamerHash
AI Provider GamerHash facilitates the execution of specific AI tasks like inference.
Adapting Scope to Market Demands
Golem Network has adjusted its scope to better respond to market demands, prioritizing projects with demonstrated potential and pausing those with less traction. This tactical refocusing aims to enhance the success rate of selected initiatives, based on market feedback from developers, startups, and AI companies.
GPU Provider Linux
Since January 29, Golem Network has invited 67 individuals to beta test this service from over 300 waitlisted users. By the end of June, access to the GPU Provider in an experimental version was opened. Installation instructions are available in the documentation. Multi-GPU support is also being developed.
AI Provider Gamerhash
An internal Proof of Concept has been developed for AI Provider Gamerhash. More details can be found in this article.
Modelserve
Modelserve facilitates easy and affordable AI model inference at scale. Market validation with over a dozen companies has confirmed strong interest. Inference tests comparing consumer-grade and commercial-grade GPU cards highlighted the value of consumer-grade GPUs for smaller models like Whisper, Stable Diffusion, and small LLMs. Beta testing with several startups and companies has helped fine-tune the service. More information is available in the latest article about Modelserve.
Golem-Workers
Golem-Workers provides direct access to GPU resources on the Golem Network, offering greater flexibility than services focused solely on deployment and inference of AI models. Learn more in this article.
