Trends

Rise of Managed AI Services in Cloud Environments

AuthorBTW Editorial

Reading Time3 min

PublishedFebruary 23, 2024

Primary DomainN/A

Content TypeN/A

TopicN/A

EntityN/A

RegionN/A

Time HorizonN/A

ImpactN/A

ConfidenceN/A

Headline

Context

Cloud security platform provider Wiz has revealed that over 70% of cloud environments are now utilizing managed AI services. Either directly use OpenAI or through Azure SDKs , indicates a rapid integration of generative AI tools into cloud business models. The study has examined more than 150,000 public cloud accounts, highlighting Microsoft’s Azure as a frontrunner in this space. In fact, 70% of the Azure environments analyzed included instances of Azure AI Services, representing approximately 39% of all cloud environments. The report also noted a significant 228% growth in Azure OpenAI usage over a four-month period in 2023.

Evidence

Pending intelligence enrichment.

Analysis

While Azure’s leadership position is expected, especially given the recent availability of AWS’ fully managed offering, Amazon Bedrock, the report acknowledged the strong presence of Amazon SageMaker, closely trailing Azure AI Services. Although Amazon Bedrock was not included in the analysis, Wiz suggested that at least 15% of organizations were beginning to adopt it. Also read: OpenAI shines, auto industry transforms: CES 2024 unveils AI’s impact Interestingly, the majority of users leveraging managed AI services are still in the experimentation phase according to Wiz’s categorization. However, there is a notable portion of active users (28%) and power users (10%) who are pushing the boundaries of AI implementation. The analysis methodology employed by Wiz focused on correlating the number of instances of a specific service across various cloud environments. Power users, defined as those with 50 or more instances, are facing challenges such as high costs associated with training and fine-tuning, as well as strict quotas imposed by some providers on the number of deployable AI service instances.

Key Points

With a rapid integration of generative AI tools into cloud business models, more than 70% of cloud environments are now utilizing managed AI services.
Microsoft’s Azure has emerged as a leader in the field of AI services, with approximately 70% of analyzed Azure environments incorporating Azure AI Services, accounting for around 39% of all cloud environments.
Wiz, the cloud security platform provider, has highlighted the significance of considering costs associated with training and inference in the upcoming year.