Golem Network Unveils Updated AI/GPU Roadmap

Felix Pinkston  Jul 23, 2024 21:29  UTC 13:29

0 Min Read

Golem Network has released an updated version of its AI/GPU roadmap, aiming to foster development and maximize benefits for the AI market. The revised roadmap emphasizes initiatives with market validation, allowing the allocation of resources to the most impactful projects, according to Golem Network.

Solutions Tailored for the AI Industry

The updated roadmap includes several tailored solutions based on feedback from developers, startups, and AI-based companies.

Modelserve

Modelserve is a service designed to run AI model inference at scale, affordably. It offers seamless deployment and inference through scalable endpoints, ensuring efficient and cost-effective operations for AI applications.

Golem-Workers

This API enables direct access to AI Workers for fine-tuning small AI models on single nodes of the Golem Network. It supports a variety of tasks beyond AI/ML payloads, offering flexibility and power to users.

Ensuring the Supply of GPU Resources for AI Industry Needs

GPU Provider

The GPU Provider enables the rental of a Virtual Machine with GPU, deployment of an image, and performing any calculations requiring parallel processing, not limited to AI/ML tasks.

AI Provider GamerHash

AI Provider GamerHash facilitates the execution of specific AI tasks like inference.

Adapting Scope to Market Demands

Golem Network has adjusted its scope to better respond to market demands, prioritizing projects with demonstrated potential and pausing those with less traction. This tactical refocusing aims to enhance the success rate of selected initiatives, based on market feedback from developers, startups, and AI companies.

GPU Provider Linux

Since January 29, Golem Network has invited 67 individuals to beta test this service from over 300 waitlisted users. By the end of June, access to the GPU Provider in an experimental version was opened. Installation instructions are available in the documentation. Multi-GPU support is also being developed.

AI Provider Gamerhash

An internal Proof of Concept has been developed for AI Provider Gamerhash. More details can be found in this article.

Modelserve

Modelserve facilitates easy and affordable AI model inference at scale. Market validation with over a dozen companies has confirmed strong interest. Inference tests comparing consumer-grade and commercial-grade GPU cards highlighted the value of consumer-grade GPUs for smaller models like Whisper, Stable Diffusion, and small LLMs. Beta testing with several startups and companies has helped fine-tune the service. More information is available in the latest article about Modelserve.

Golem-Workers

Golem-Workers provides direct access to GPU resources on the Golem Network, offering greater flexibility than services focused solely on deployment and inference of AI models. Learn more in this article.



Read More