By TechCrunch | Created at 2025-02-25 15:53:26 | Updated at 2025-03-04 11:08:37
6 days ago
Just a few weeks after chipmaker Tenstorrent raised nearly $700 million in funding, developers can now try out Tenstorrent’s AI accelerators on Koyeb. Tenstorrent sells AI processors built around the RISC-V instruction set architecture, and has developed its own open-source neural network library, TT-NN, and open-source low-level programming model, TT-Metalium.
Tenstorrent is part of a group of companies trying to build alternatives to Nvidia GPUs and the company’s CUDA library. It competes with Axelera, Etched, Groq and others.
Koyeb was founded by former Scaleway executives, and focuses on developing a serverless cloud platform for developers looking for an abstraction layer at the cloud infrastructure level. It competes with the likes of Fly.io, Railway and Render.
Koyeb lets developers deploy applications across several virtual machines using a command line interface or a git push after integrating with the code repository. It supports Docker containers and many popular languages.
One of Koyeb’s main features is that it can automatically scale an application to hundreds of servers if needed, and when there’s less traffic, it can automatically scale down server infrastructure.
In recent months, Koyeb has been focusing specifically on AI apps. Due to the serverless nature of its platform, it can offer a low-latency experience for AI workloads.
On the hardware front, Koyeb has deployed Tenstorrent’s PCIe boards in its data centers. Developers can access Tenstorrent’s low-level TT-Metalium SDK to write host and kernel programs.
Developers will find two new types of instances in Koyeb’s documentation and admin panels:
- The TT-N300S instance has 24GB of GDDR6 memory, 192MB of SRAM, and provides up to 466 FP8 TFLOPS. It is paired with 64GB of RAM and 4 vCPUs.
- The TT-Loudbox instance has four N300S. Developers get 96GB of GDDR6, 768MB of SRAM, and up to 1,864 FP8 TFLOPS. It features 256GB of RAM and 16 vCPUs.
With this release, Koyeb is trying to position itself as a hardware-agnostic cloud platform. “This reminds us of ARM’s debut on the server market with high-performance chips,” Koyeb’s co-founder and CEO Yann Leger told TechCrunch.
“Since we introduced ARM to the market with Scaleway back in the days, offering fully customized servers in 2013-2014, we have the experience of deploying various architectures and operating diverse hardware,” he added.
As for Tenstorrent, the AI chipmaker is looking for partners to build a developer ecosystem around its open-source programming model. It will take a village to offer an alternative to Nvidia’s AI stack.
Romain Dillet is a Senior Reporter at TechCrunch. He has written over 3,000 articles on technology and tech startups and has established himself as an influential voice on the European tech scene. He has a deep background in startups, privacy, security, fintech, blockchain, mobile, social and media. With twelve years of experience at TechCrunch, he’s one of the familiar faces of the tech publication that obsessively covers Silicon Valley and the tech industry. In fact, his career started at TechCrunch when he was 21. Based in Paris, many people in the tech ecosystem consider him as the most knowledgeable tech journalist in town. Romain likes to spot important startups before anyone else. He was the first person to cover N26, Revolut and DigitalOcean. He has written scoops on large acquisitions from Apple, Microsoft and Snap. When he’s not writing, Romain is also a developer — he understands how the tech behind the tech works. He also has a deep historical knowledge of the computer industry for the past 50 years. He knows how to connect the dots between innovations and the effect on the fabric of our society. Romain graduated from Emlyon Business School, a leading French business school specialized in entrepreneurship. He has helped several non-profit organizations, such as StartHer, an organization that promotes education and empowerment of women in technology, and Techfugees, an organization that empowers displaced people with technology.
Subscribe for the industry’s biggest tech news
