Cloud Hosting

Its been a rough month for generative AI (genAI). First, AWS launched Amazon Q, its answer to Microsofts Copilot, only to have its own employees warnof severe hallucinationsand data leaks. Then Google launched Gemini, its answer to ChatGPT, to much fanfare and an incredible demo, only to acknowledge after the factthat the demo was fake. Oh, andMeta releasednew open source tools for AI safety(hurray!) yet somehow failed to acknowledge the most egregiously unsafe aspect of genAI tools: their susceptibility to prompt injection attacks.

I could go on, but what would be the point? These and other failures dont suggest that genAI is vacuous or a hype-plagued dumpster fire. Theyre signs that we as an industry have allowed the promise of AI to overshadow current reality. That reality is pretty darn good. We dont need to keep overselling it.

What we might need, despite its imperfect fit for genAI, is open source.

I recently wrote that AWSs release of Amazon Q is a watershed moment for the company: an opportunity to close the gap or, in some cases, outpace competitors. Mission accomplished.

Almost. One big problem, among several others that Duckbill Chief Economist Corey Quinn highlights, is that although AWS felt compelled to position Q as significantly more secure than competitors like ChatGPT, its not. I dont know that its worse, but it doesnt help AWSs cause to position itself as better and then not actually be better. Quinn argues this comes from AWS going after the application space, an area in which it hasnt traditionally demonstrated strength:

As soon as AWS attempts to move up the stack into the application space, the wheels fall off in major ways. It requires a competency that AWS does not have and has not built up since its inception.

Perhaps. But even if we accept that as true, the larger issue is that theres so much pressure to deliver on the hype of AI that great companies like AWS may feel compelled to take shortcuts to get there (or to appear to get there).

The same seems to be true of Google. The company has spent years doing impressive work with AI yet still felt compelled to take shortcuts with a demo. As Parmy Olson captures, Googles video made it look like you could show different things to Gemini Ultra in real time and talk to it. You cant.Grady Booch says, That demo was incredibly edited to suggest that Gemini is far more capable than it is.

Why would these companies pretend their capabilities are greater than they actually are? The reasons arent hard to discern. The pressure to position oneself as the future of AI is tremendous. And its not just AWS and Google. Listen in on recent earnings calls for public companies; every executive cant seem to say AI enough. The AI gold rush is on, and everyone wants to stake their claim.

GenAI is still nascent in its capabilities. For all the breathless reporting of this or that new model and all that it offers, the reality always dramatically lags behind the hype. Instead of fixing GenAIs most pressing problemprompt injectionwere exacerbating the problem by inducing more enterprises to use fundamentally non-secure software.

We may need open source to help.

I dont mean that if we just open source everything, AI will magically be perfect. That hasnt happened for cloud or any other area of enterprise IT, so why would genAI be any different? Not to mention that as much as we like to throw around the term open source in the context of AI, its not even clear what we mean, as Ive written.

Its likely that the industry, as Meta has done with its Purple Llama initiative, will focus on comparatively unimportant challenges. Simon Willison laments, The lack of acknowledgment of the threat of prompt injection attacks in this new Purple Llama initiative from Meta AI Is baffling to me.

In addition, systems like Gemini are multifaceted and complex. There must be lots of engineering tricks and hard-coded rules, and we would never know how many models are inside the systems before open sourcing, notesProfessor Xin Eric Wang. This complexity means open sourcing a large language model or genAI system currently raises as many questions as it answers.

The Open Source Initiative (OSI) is grappling with these issues. OSI Executive Director Stefano Maffulli stresses: What does it mean for a developer to have access to a model, and what are the rights that should be exercis[ed], and what do you need in order to have the possibility to modify [and redistribute] that model?

Its all unclear.

What is clear is that the efforts to make open source relevant for genAI are incredibly important. We need more transparency and less black-box opacity. Microsoft, AWS, Google, and others will still feel compelled to position themselves as leaders, but open source separates fact from fiction. Code doesnt lie.

Lets rewind those Q, Copilot, and Gemini announcements, but imagine if instead of just private previews and demos, there was code. Think about how that would change the dynamic. Think about the humility it would compel. Given that by far the most common early adopters of genAI within the enterprise are developers,as an OReilly survey uncovered, companies should speak their language: code. Most developers never look at the code for an open source project, but making it available so some do is important. It earns trust in ways that overzealous announcements dont.

Open source isnt a perfect answer to the troubles genAI vendors are having. But the aspiration to greater transparency, which open source fosters, is desperately needed.

Go here to read the rest:
Generative AI is off to a rough start - InfoWorld