Cloud Hosting

The most sought-after resource in the tech industry right now isnt a specific type of engineer. Its not even money. Its an AI chip made by Nvidia called the H100.

Securing these GPUs is considerably harder to get than drugs, Elon Musk has said. Whos getting how many H100s and when is top gossip of the valley rn, OpenAIs Andrej Karpathy posted last week.

Ive spent this week talking with sources throughout the AI industry, from the big AI labs to cloud providers and small startups, and come away with this: everyone is operating under the assumption that H100s will be nearly impossible to get through at least the first half of next year. The lead time for new orders, if you can get them, is roughly six months, or an eternity in the AI space. Meanwhile, the cloud providers are just starting to make their H100s widely available and charging an arm and a leg for the limited capacity they have. For the most part, these hosting providers also require extremely costly, lengthy upfront commitments.

Read the original here:

Inside the hunt for AI chips - The Verge