(San Francisco) Earlier this year, Mark Austin, vice president of data science at AT&T, noticed that some of its developers had started using ChatGPT at work. When they had a glitch, they asked ChatGPT to explain the nature of the bug or fix their code.
That’s a big change, Austin thought. But since ChatGPT is public, he wondered if it was safe for businesses to use it.
In January, AT&T therefore tried Azure OpenAI Services, Microsoft’s product allowing companies to create their own conversational robots powered by artificial intelligence (AI). AT&T used it to create its own AI bot, Ask AT&T, which helps its developers automate coding. AT&T Customer Service has also adopted Ask AT&T for summarizing calls and other tasks.
As soon as employees see what the robot can do, they love it.
Mark Austin, Vice President of Data Science at AT&T
Forms that previously took hours to fill out take two minutes with Ask AT&T. Employees can focus on more complex tasks. As for the developers who use the robot, they are 20% to 50% more productive.
Like AT&T, many companies are looking for ways to harness the power of generative AI, a technology that has been buzzing around Silicon Valley for months. Generative AI can produce its own text, photos and videos in response to natural language requests. These capabilities help automate tasks like keeping minutes of a meeting and reduce paperwork.
Faced with this new demand, technology companies are rushing to launch generative AI products for enterprises. Since 1er April, Amazon, Box, and Cisco announced generative AI-powered products that will produce code, analyze documents, and summarize meetings. Salesforce has also just launched generative AI products used in sales, marketing and in its Slack messaging service. Oracle has announced an AI product in human resources.
These companies are increasing their investment in AI development. In May, Oracle and Salesforce Ventures, the venture capital arm of Salesforce, invested in Cohere, a Toronto-based startup specializing in generative AI in business. Oracle also resells Cohere’s technology.
Generative AI “is a breakthrough in enterprise software,” says Aaron Levie, CEO of Box.
It’s an incredibly exciting opportunity where, for the first time, you can truly begin to understand what’s in your data in a way never before possible.
Aaron Levie, CEO of Box
Many of these tech companies emulate Microsoft, which has invested $13 billion in OpenAI, the designer of ChatGPT. In January, Microsoft made the Azure OpenAI service available to its customers, giving them access to OpenAI’s technology to build their own versions of ChatGPT. In May, the service had 4,500 customers, said John Montgomery, vice president of Microsoft.
Basically, tech companies are currently releasing four types of generative AI products for businesses, which are functions and services that: generate code for software engineers; create new content such as sales emails and product descriptions for marketing teams; research company data to answer employee questions; summarize meeting notes and long documents.
These tools will be “used by people to do what they’re already doing,” says analyst Bern Elliot, vice president of IT research and consulting firm Gartner.
Risks
But generative AI at work comes with risks. AI bots can produce inaccuracies, provide inappropriate answers, and make data leaks possible. And AI remains largely unregulated.
Faced with these challenges, technology companies have taken action. To prevent data leaks and increase security, some offer generative AI products that do not retain customer data.
When Salesforce launched AI Cloud, a service comprising nine generative AI products for enterprises, in June, the company included a firewall meant to hide sensitive company information and prevent leaks. Salesforce promises that what users type into AI Cloud will not be used to enrich the underlying AI.
Similarly, Oracle claims that customer data will be kept in a secure environment while training its AI model and promises that it will not be able to see this information.
Starting at US$360,000 per year
Salesforce offers AI Cloud starting at US$360,000 per year, with the cost increasing with usage. Microsoft charges for the Azure OpenAI service based on the version of OpenAI technology chosen by the customer and the volume of usage.
For now, generative AI is mostly used in low-risk work scenarios — not in highly regulated industries — with a human in the loop, points out Beena Ammanath, director of the Deloitte AI Institute research center. A recent Gartner survey of 43 companies indicates that more than half of respondents had no internal generative AI policy.
It is not enough to learn how to use these new tools effectively. It is also necessary to prepare the personnel for the new types of tasks which could develop. New skills will be needed.
Beena Ammanath, director of the Deloitte AI Institute research center
Panasonic Connect, a subsidiary of Japan’s Panasonic, began using Microsoft’s Azure OpenAI service in February to create its own chatbot. Today, his employees solicit him 5,000 times a day on topics as varied as writing emails or writing code.
Panasonic Connect thought its engineers would be the main users of the AI robot. In fact, litigation, accounting and quality assurance have also called on him to summarize legal documents, improve product quality and perform other tasks, says Judah Reynolds, marketing and communications manager at Panasonic Connect. .
“Everyone started using it in ways we hadn’t anticipated,” he says. People really benefit from it. »
This article was originally published in the New York Times.