Bruno Zerbib is not your traditional Orange board member. His colleagues past and present have often spent their whole careers at the French telecom incumbent, even joining it immediately after they attended one of the grandes coles, France's higher-education Ligue 1. The man now wearing the mantle of chief technology and innovation officer had not been employed by Orange in a significant role before June last year. Zerbib's resume shows he has spent most of this century living and working in California for some of the world's best-known Silicon Valley firms. His accent carries undertones of America.
This atypical profile partly explains his appointment, according to one company source. US Internet giants and the technologies they have unleashed are quickly reshaping Orange and other telcos, just as those same telcos previously reshaped economies through mobile and data connectivity. A CTIO with experience on the other side of the fence both geographically and industrially may look invaluable as outside technological forces including generative artificial intelligence (GenAI), accelerated computing and the public cloud pose unanswered questions for telcos.
It is AI in its various forms that has, unsurprisingly, become one of the big priorities for Zerbib amid a lack of telecom-industry consensus on the right next steps. Germany's Deutsche Telekom, the biggest service provider in Europe, thinks operators should build their own large language models (LLMs). Vodafone does not. Japan's Softbank is investing in Nvidia's graphical processing units (GPUs), the versatile chips used in hyperscaler facilities for LLM training. Many are wary. The phenomenon of "inferencing," the rollout of AI applications once LLMs are fully trained, could bring revenue opportunities for telcos at the network "edge," some hope. Others with an eye on recent history are skeptical.
The camp of the Nvidia skeptics
When it comes to Nvidia, Zerbib clearly belongs in the camp of the skeptics. "This is a very weird moment in time where power is very expensive, natural resources are scarce and GPUs are extremely expensive," he told Light Reading during an interview at this year's Mobile World Congress, held last month in Barcelona. "You have to be very careful with our investment because you might buy a GPU product from a famous company right now that has a monopolistic position." Low-cost alternatives are coming, said Zerbib.
He is not the only telco individual right now who sounds worried about this Nvidia monopoly. The giant US chipmaker's share price has doubled since mid-October, valuing Nvidia at nearly $2.2 trillion on the Nasdaq. But a 6% drop on March 8, sparked by wider economic concerns, illustrates its volatility. Its gross margin, meanwhile, has rocketed by 10 percentage points in just two years. The 77% figure it reported last year screams monopoly. And Nvidia controls not just the GPUs but also the Infiniband technology that connects clusters of them in data centers. Howard Watson, who does Zerbib's job at the UK's BT, wants to see Ethernet grow muscle as an Infiniband alternative.
But Zerbib spies the arrival of alternatives to GPUs "for a fraction of the price, with much better performance" in the next couple of years. In his mind, that would make an Orange investment in GPUs now a very bad bet. "If you invest the money at the wrong time, depreciation might be colossal and the write-off could be huge," he said.
What, then, could be the source of these GPU rivals? Established chipmakers and chip design companies such as Intel and Arm have pitched other platforms for AI inferencing. But disruption is likely to come from the hyperscalers or the startups they eventually buy, according to Zerbib. "Right now, the hyperscalers are spending billions on this," he said. "There are startups working on alternatives, waiting to be acquired by hyperscalers, and then you are going to have layers of optimization."
While Zerbib did not throw out any names, Google's own tensor processing units (TPUs) have already been positioned as a GPU substitute for some AI workloads. More intriguing is a startup called Groq, founded in 2016 by Jonathan Ross, an erstwhile Google executive who led the development of those TPUs. Tareq Amin, the CEO of Aramco Digital and a former telco executive (at Japan's Rakuten), thinks Groq's language processing units (LPUs) might be more efficient than GPUs for AI at the edge.
Efficiency is paramount for Zerbib as Orange strives to reach a "net zero" target by 2040. "We need to reduce by ten the amount of resource consumption for a given number of parameters," he said. "It is unacceptable. Right now, we are going to hit a wall. We cannot talk about sustainability and then generate a three-minute video that is equivalent to someone taking a car and doing a long trip. It makes no sense."
Models of all sizes
Today, he says he prefers to invest in people rather than GPUs. For Orange so far that has meant equipping about 27,000 members of staff (Orange had 137,000 employees worldwide at the end of last year) with AI skills. Unlike certain other telcos, however, Orange appears to have no interest in building an LLM from scratch. Instead, Zerbib is an advocate of fine-tuning for telecom purposes the LLMs that already exist.
Orange has, accordingly, spent money on building an AI tool it can effectively plug into the most appropriate LLM for any given scenario. "We have built internally a tool that is an abstraction layer on top of all those LLMs and based on the use case is going to route to the right LLM technology," said Zerbib. "We are very much proponents of open models, and we believe that we need to take huge models that have been trained at scale by people that have invested billions in infrastructure."
Available like items of clothing in numerous different sizes, future language models including those adapted by Orange are likely to be worn at multiple types of facilities, he clearly believes. Zerbib breaks them down into three categories: small language models, featuring up to 10 billion parameters and deployable on user devices; medium-sized models, which include up to 100 billion parameters and can be hosted at the network edge; and the very largest, trillion-parameter LLMs that will continue to reside in the cloud.
With GenAI, an employee could feasibly communicate "in layman's terms" with a telco's NOCs and SOCs (its network and service operations centers) to find out "what is going on," said Zerbib. Language models running at the network edge might also support applications for customers. "Let's say you have a French administration that needs to offer certain services to constituents throughout the country, and they want to make sure they do that with GenAI and have a distributed architecture to do it everywhere," said Zerbib. "Well, this is an opportunity for a telco to say we might provide an infrastructure to run those distributed LLMs that will handle social administration."
The most obvious AI attractions are still on the cost side. AI-generated insights should clearly help telcos reduce customer churn, minimize network outages and "essentially extract more value from the infrastructure for the same amount of capital investment," as Zerbib describes it. The telco dream, though, is of AI as a catalyst for sales growth. "There is a question mark with slicing, with the emergence of new use cases and low-latency capabilities," said Zerbib. "We might be able to monetize that." Conscious of the telecom sector's historical tendency to oversell, Zerbib is for now putting a heavy emphasis on that "might."
See the original post here:
Orange CTO: Now's not the time to invest in Nvidia GPUs for AI - Light Reading
- What Is Machine Learning? | How It Works, Techniques ... [Last Updated On: September 5th, 2019] [Originally Added On: September 5th, 2019]
- Start Here with Machine Learning [Last Updated On: September 22nd, 2019] [Originally Added On: September 22nd, 2019]
- What is Machine Learning? | Emerj [Last Updated On: October 1st, 2019] [Originally Added On: October 1st, 2019]
- Microsoft Azure Machine Learning Studio [Last Updated On: October 1st, 2019] [Originally Added On: October 1st, 2019]
- Machine Learning Basics | What Is Machine Learning? | Introduction To Machine Learning | Simplilearn [Last Updated On: October 1st, 2019] [Originally Added On: October 1st, 2019]
- What is Machine Learning? A definition - Expert System [Last Updated On: October 2nd, 2019] [Originally Added On: October 2nd, 2019]
- Machine Learning | Stanford Online [Last Updated On: October 2nd, 2019] [Originally Added On: October 2nd, 2019]
- How to Learn Machine Learning, The Self-Starter Way [Last Updated On: October 17th, 2019] [Originally Added On: October 17th, 2019]
- definition - What is machine learning? - Stack Overflow [Last Updated On: November 3rd, 2019] [Originally Added On: November 3rd, 2019]
- Artificial Intelligence vs. Machine Learning vs. Deep ... [Last Updated On: November 3rd, 2019] [Originally Added On: November 3rd, 2019]
- Machine Learning in R for beginners (article) - DataCamp [Last Updated On: November 3rd, 2019] [Originally Added On: November 3rd, 2019]
- Machine Learning | Udacity [Last Updated On: November 3rd, 2019] [Originally Added On: November 3rd, 2019]
- Machine Learning Artificial Intelligence | McAfee [Last Updated On: November 3rd, 2019] [Originally Added On: November 3rd, 2019]
- Machine Learning [Last Updated On: November 3rd, 2019] [Originally Added On: November 3rd, 2019]
- AI-based ML algorithms could increase detection of undiagnosed AF - Cardiac Rhythm News [Last Updated On: November 19th, 2019] [Originally Added On: November 19th, 2019]
- The Cerebras CS-1 computes deep learning AI problems by being bigger, bigger, and bigger than any other chip - TechCrunch [Last Updated On: November 19th, 2019] [Originally Added On: November 19th, 2019]
- Can the planet really afford the exorbitant power demands of machine learning? - The Guardian [Last Updated On: November 19th, 2019] [Originally Added On: November 19th, 2019]
- New InfiniteIO Platform Reduces Latency and Accelerates Performance for Machine Learning, AI and Analytics - Business Wire [Last Updated On: November 19th, 2019] [Originally Added On: November 19th, 2019]
- How to Use Machine Learning to Drive Real Value - eWeek [Last Updated On: November 19th, 2019] [Originally Added On: November 19th, 2019]
- Machine Learning As A Service Market to Soar from End-use Industries and Push Revenues in the 2025 - Downey Magazine [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Rad AI Raises $4M to Automate Repetitive Tasks for Radiologists Through Machine Learning - - HIT Consultant [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Machine Learning Improves Performance of the Advanced Light Source - Machine Design [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Synthetic Data: The Diamonds of Machine Learning - TDWI [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- The transformation of healthcare with AI and machine learning - ITProPortal [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Workday talks machine learning and the future of human capital management - ZDNet [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Machine Learning with R, Third Edition - Free Sample Chapters - Neowin [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Verification In The Era Of Autonomous Driving, Artificial Intelligence And Machine Learning - SemiEngineering [Last Updated On: November 26th, 2019] [Originally Added On: November 26th, 2019]
- Podcast: How artificial intelligence, machine learning can help us realize the value of all that genetic data we're collecting - Genetic Literacy... [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- The Real Reason Your School Avoids Machine Learning - The Tech Edvocate [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- Siri, Tell Fido To Stop Barking: What's Machine Learning, And What's The Future Of It? - 90.5 WESA [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- Microsoft reveals how it caught mutating Monero mining malware with machine learning - The Next Web [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- The role of machine learning in IT service management - ITProPortal [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- Global Director of Tech Exploration Discusses Artificial Intelligence and Machine Learning at Anheuser-Busch InBev - Seton Hall University News &... [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- The 10 Hottest AI And Machine Learning Startups Of 2019 - CRN: The Biggest Tech News For Partners And The IT Channel [Last Updated On: November 28th, 2019] [Originally Added On: November 28th, 2019]
- Startup jobs of the week: Marketing Communications Specialist, Oracle Architect, Machine Learning Scientist - BetaKit [Last Updated On: November 30th, 2019] [Originally Added On: November 30th, 2019]
- Here's why machine learning is critical to success for banks of the future - Tech Wire Asia [Last Updated On: December 2nd, 2019] [Originally Added On: December 2nd, 2019]
- 3 questions to ask before investing in machine learning for pop health - Healthcare IT News [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Machine Learning Answers: If Caterpillar Stock Drops 10% A Week, Whats The Chance Itll Recoup Its Losses In A Month? - Forbes [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Measuring Employee Engagement with A.I. and Machine Learning - Dice Insights [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Amazon Wants to Teach You Machine Learning Through Music? - Dice Insights [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- Machine Learning Answers: If Nvidia Stock Drops 10% A Week, Whats The Chance Itll Recoup Its Losses In A Month? - Forbes [Last Updated On: December 8th, 2019] [Originally Added On: December 8th, 2019]
- AI and machine learning platforms will start to challenge conventional thinking - CRN.in [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Machine Learning Answers: If Twitter Stock Drops 10% A Week, Whats The Chance Itll Recoup Its Losses In A Month? - Forbes [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Machine Learning Answers: If Seagate Stock Drops 10% A Week, Whats The Chance Itll Recoup Its Losses In A Month? - Forbes [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Machine Learning Answers: If BlackBerry Stock Drops 10% A Week, Whats The Chance Itll Recoup Its Losses In A Month? - Forbes [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Amazon Releases A New Tool To Improve Machine Learning Processes - Forbes [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Another free web course to gain machine-learning skills (thanks, Finland), NIST probes 'racist' face-recog and more - The Register [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Kubernetes and containers are the perfect fit for machine learning - JAXenter [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- TinyML as a Service and machine learning at the edge - Ericsson [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- AI and machine learning products - Cloud AI | Google Cloud [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Machine Learning | Blog | Microsoft Azure [Last Updated On: December 23rd, 2019] [Originally Added On: December 23rd, 2019]
- Machine Learning in 2019 Was About Balancing Privacy and Progress - ITPro Today [Last Updated On: December 25th, 2019] [Originally Added On: December 25th, 2019]
- CMSWire's Top 10 AI and Machine Learning Articles of 2019 - CMSWire [Last Updated On: December 25th, 2019] [Originally Added On: December 25th, 2019]
- Here's why digital marketing is as lucrative a career as data science and machine learning - Business Insider India [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- Dell's Latitude 9510 shakes up corporate laptops with 5G, machine learning, and thin bezels - PCWorld [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- Finally, a good use for AI: Machine-learning tool guesstimates how well your code will run on a CPU core - The Register [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- Cloud as the enabler of AI's competitive advantage - Finextra [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- Forget Machine Learning, Constraint Solvers are What the Enterprise Needs - - RTInsights [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- Informed decisions through machine learning will keep it afloat & going - Sea News [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- The Problem with Hiring Algorithms - Machine Learning Times - machine learning & data science news - The Predictive Analytics Times [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- New Program Supports Machine Learning in the Chemical Sciences and Engineering - Newswise [Last Updated On: January 13th, 2020] [Originally Added On: January 13th, 2020]
- AI-System Flags the Under-Vaccinated in Israel - PrecisionVaccinations [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- New Contest: Train All The Things - Hackaday [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- AFTAs 2019: Best New Technology Introduced Over the Last 12 MonthsAI, Machine Learning and AnalyticsActiveViam - www.waterstechnology.com [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Educate Yourself on Machine Learning at this Las Vegas Event - Small Business Trends [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Seton Hall Announces New Courses in Text Mining and Machine Learning - Seton Hall University News & Events [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Looking at the most significant benefits of machine learning for software testing - The Burn-In [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Leveraging AI and Machine Learning to Advance Interoperability in Healthcare - - HIT Consultant [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Adventures With Artificial Intelligence and Machine Learning - Toolbox [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Five Reasons to Go to Machine Learning Week 2020 - Machine Learning Times - machine learning & data science news - The Predictive Analytics Times [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Uncover the Possibilities of AI and Machine Learning With This Bundle - Interesting Engineering [Last Updated On: January 22nd, 2020] [Originally Added On: January 22nd, 2020]
- Learning that Targets Millennial and Generation Z - HR Exchange Network [Last Updated On: January 23rd, 2020] [Originally Added On: January 23rd, 2020]
- Red Hat Survey Shows Hybrid Cloud, AI and Machine Learning are the Focus of Enterprises - Computer Business Review [Last Updated On: January 23rd, 2020] [Originally Added On: January 23rd, 2020]
- Vectorspace AI Datasets are Now Available to Power Machine Learning (ML) and Artificial Intelligence (AI) Systems in Collaboration with Elastic -... [Last Updated On: January 23rd, 2020] [Originally Added On: January 23rd, 2020]
- What is Machine Learning? | Types of Machine Learning ... [Last Updated On: January 23rd, 2020] [Originally Added On: January 23rd, 2020]
- How Machine Learning Will Lead to Better Maps - Popular Mechanics [Last Updated On: January 30th, 2020] [Originally Added On: January 30th, 2020]
- Jenkins Creator Launches Startup To Speed Software Testing with Machine Learning -- ADTmag - ADT Magazine [Last Updated On: January 30th, 2020] [Originally Added On: January 30th, 2020]
- An Open Source Alternative to AWS SageMaker - Datanami [Last Updated On: January 30th, 2020] [Originally Added On: January 30th, 2020]
- Machine Learning Could Aid Diagnosis of Barrett's Esophagus, Avoid Invasive Testing - Medical Bag [Last Updated On: January 30th, 2020] [Originally Added On: January 30th, 2020]
- OReilly and Formulatedby Unveil the Smart Cities & Mobility Ecosystems Conference - Yahoo Finance [Last Updated On: January 30th, 2020] [Originally Added On: January 30th, 2020]