Enterprise AI Strategy: The 5% That Generate Value

This is Part 1 of a three-part series on Enterprise AI Strategy. Part 2 covers risk, security, and regulatory considerations. Part 3 addresses implementation, portability, and decision frameworks.

---

Note: This content had corrections applied after publication.

Executive Summary

The question “Should we build our own LLM?” is increasingly being asked at board and executive committee level. In most cases, it is the wrong question.

For global enterprises—including fashion and retail groups as well as enterprise software providers—the strategic decision is not whether to own a Large Language Model, but which layers of the LLM value chain warrant ownership, control, or influence given risk exposure, regulatory obligations, and competitive differentiation. According to BCG’s 2025 research across 1,250 firms worldwide, only 5% of companies are achieving AI value at scale, whilst 60% report minimal revenue and cost gains despite substantial investment.

Evidence from 2024–2025 enterprise deployments reveals a clear pattern: full ownership of foundation models is economically and operationally viable only for a very small class of organisations. McKinsey’s 2025 State of AI research found that organisations achieving meaningful enterprise-wide impact from AI—those attributing 5% or more EBIT impact—represent just 6% of respondents. More than one-third of these high performers are committing more than 20% of their digital budgets to AI technologies, and they are scaling across the business, but crucially, they focus on transformative workflows rather than model ownership.

However, the landscape has shifted materially in 2025. Open source models have achieved near-parity with proprietary alternatives, and regional providers offer dramatically different cost structures. CTOs and CISOs must now evaluate a broader spectrum of options whilst navigating complex trade-offs between capability, cost, data sovereignty, and regulatory compliance.

This series reframes the debate in terms relevant to CTOs and CISOs: control vs. ownership, resilience vs. dependency, and differentiation vs. distraction.

---

The Current State: Reframing the Ownership Question

The Critical Distinction Executives Must Make

“Building an LLM” is often used imprecisely to describe several materially different activities. Understanding these distinctions is essential for strategic decision-making:

Layer	What It Actually Means	Strategic Implication
Foundation model	Training a large, general-purpose model from scratch	Multi-year commitment running to tens or hundreds of millions of pounds; limited relevance outside platform vendors
Fine-tuned model	Adapting an existing model to domain data	Targeted advantage with ongoing operational complexity
RAG systems	Injecting proprietary knowledge at inference time	High leverage, lower risk, faster time to value
Private inference	Hosting models in controlled environments	Shifts—not removes—security and compliance risk
Self-hosted open source	Deploying open-weight models on own infrastructure	Data sovereignty with operational complexity; significant cost reduction potential at high volumes

Research from Epoch AI indicates that training costs for frontier models—the most advanced foundation models representing the current state of the art, such as GPT-5, Gemini, and Claude—have grown at a rate of 2.4x per year since 2016. For earlier frontier models with published cost data, Epoch AI estimates GPT-4’s final training run cost approximately £32 million ($40 million) using amortised hardware and energy costs, whilst Google’s Gemini Ultra required approximately £24 million ($30 million). Stanford’s AI Index 2024, using cloud compute pricing methodology, reports higher figures of £62 million ($78 million) for GPT-4 and £152 million ($191 million) for Gemini Ultra. Current frontier models are substantially more expensive: Anthropic’s CEO indicated in 2024 that models costing close to £800 million ($1 billion) were already in training, and that training runs costing £8 billion ($10 billion) could follow between 2025 and 2027.

Key Insight: Most enterprises do not need to own models to control outcomes. The organisations capturing the most value from AI are those redesigning workflows and accelerating innovation—not those building infrastructure. However, the economics of hosting versus consuming models via API have shifted substantially in favour of self-hosted options for high-volume workloads.

Why “In-House” Does Not Automatically Mean “Secure”

From a CISO perspective, the assumption that internal hosting equals lower risk is increasingly flawed. Deloitte’s 2024 State of Generative AI in the Enterprise research found that three of the top four barriers to successful deployment were risk-related: regulatory compliance (36%), difficulty managing risks (30%) and the lack of a governance model (29%).

Persistent AI-specific risks regardless of hosting model include:

• Shadow AI proliferation: Microsoft and LinkedIn’s 2024 Work Trend Index found that 75% of knowledge workers use AI at work and 78% of AI users bring their own AI tools, often without governance frameworks in place. Netskope’s 2025 Cloud and Threat Report found the volume of data enterprise users sent to generative AI apps rose more than 30-fold in a year, from 250 MB to 7.7 GB a month on average.

• Prompt injection and data leakage: Among organisations using generative AI, 47% have experienced problems ranging from hallucinated outputs to cyber security issues, privacy exposure, and intellectual property leakage.

• Training data exposure: Nearly half (46%) of all data-policy violations involve developers pasting proprietary source code into generative AI tools.

• Uncontrolled model drift: Without mature MLOps pipelines, model behaviour can degrade over time, creating compliance and operational risks. Enterprise-grade MLOps platforms—including UK-based providers such as Seldon for deployment monitoring and governance—offer control and visibility layers that mitigate these operational risks.

Private infrastructure reduces third-party exposure but increases internal attack surface unless accompanied by mature MLOps pipelines, continuous red-teaming of model behaviour, fine-grained access control at the prompt and retrieval layer, and auditability aligned to regulatory expectations (including the EU AI Act).

Technology Impact: For many enterprises, hyperscaler-hosted models with strong contractual controls may present lower operational risk than poorly governed internal deployments. The key differentiator is governance maturity, not infrastructure ownership.

Business Impact: Organisations with comprehensive technology and cyber security governance in place report tighter alignment between boards, executives, and security teams, as well as greater confidence in their ability to protect AI deployments.

The Governance Reality: In Deloitte’s survey of 2,773 leaders, more than two-thirds said 30% or fewer of their generative AI experiments would be fully scaled in the next three to six months. The bottleneck is rarely model availability—it is integration, security reviews, compliance checks, and organisational change management.

---

Open Source AI: A Credible Alternative

The Performance Gap Has Closed

The competitive landscape for foundation models shifted dramatically during 2025. Open source and open-weight models now achieve performance comparable to—and in some cases exceeding—proprietary alternatives from major technology vendors.

Meta’s Llama 4 family (released April 2025) demonstrates this convergence. The Llama 4 Scout variant (109 billion total parameters, 17 billion active) supports context windows up to 10 million tokens, whilst its larger sibling, Llama 4 Maverick, delivers benchmark performance competitive with GPT-4o across reasoning, coding, and multilingual tasks. Llama models have now surpassed 1.2 billion downloads, up from 650 million in December 2024. Major enterprises including AT&T and Block have deployed Llama in production for customer support, and IBM offers Llama to its clients through its watsonx platform.

DeepSeek-R1 demonstrates that frontier-level reasoning capabilities are no longer exclusive to established Western providers. The model achieves performance comparable to OpenAI’s o1 on mathematical and coding benchmarks, with its Mixture-of-Experts architecture (671 billion total parameters, 37 billion active per token) enabling inference at dramatically lower cost structures. The strategic implications of regional providers—including considerations around data sovereignty, regulatory alignment, and security—are examined in Part 2 of this series.

Alibaba’s Qwen family and Mistral AI’s models (France) further expand the viable options for enterprises seeking alternatives to hyperscaler dependency.

The Economic Case for Self-Hosted Open Source

For enterprises with substantial AI inference volumes, self-hosted open source models present compelling economics:

Cost structure comparison: Generating one million output tokens via the GPT-4o API costs approximately £8 ($10), with input tokens at around £2 ($2.50) per million. Self-hosting an open-weight model replaces per-token charges with GPU, infrastructure and staff costs, so the unit cost falls as utilisation rises—enterprises can achieve substantial inference cost reductions by migrating sustained, high-volume workloads to self-hosted open source models.

Total cost of ownership considerations: Self-hosting introduces infrastructure, operations, and talent costs that offset some API savings, and specialist staff can represent a substantial share of the total. These economics favour self-hosting primarily for organisations with high inference volumes where API costs would otherwise exceed infrastructure investment.

Practical deployment pathway: Smaller model variants significantly reduce infrastructure requirements. Llama 4 Scout can operate on a single Nvidia H100 GPU with Int4 quantisation; smaller models such as Llama 3.1 8B can run on a single consumer GPU once quantised. Quantisation techniques (reducing model weights from 16-bit to 4-bit precision) cut weight memory by around 75% with minimal quality degradation. Inference-optimised frameworks such as vLLM and Text Generation Inference can substantially improve throughput on equivalent hardware.

McKinsey’s April 2025 research found that 40% of enterprise leaders prefer hosting AI models on their own infrastructure, citing data privacy, reduced breach risk through vendor elimination, and customised security protocols as primary motivations. Three-quarters of respondents expect to increase their use of open source AI technologies over the next several years.

Strategic Positioning for Global Enterprises

Open source AI addresses several strategic concerns for organisations operating across multiple jurisdictions:

Reduced single-vendor dependency: Self-hosted models enable architectural portability without vendor lock-in. Organisations can switch between model providers or hosting environments with minimal disruption, provided RAG and fine-tuning workflows isolate proprietary data from any single vendor.

Data sovereignty compliance: Self-hosted models on local infrastructure ensure data never leaves jurisdictional boundaries—eliminating concerns about international data transfers that complicate GDPR compliance with externally-hosted API services.

Regulatory alignment: The EU AI Act applies equally to proprietary and open-source models deployed in EU markets. However, self-hosted deployments provide greater control over documentation, audit trails, and compliance evidence required for high-risk system certification. Regulatory timelines and requirements are covered in Part 2.

European alternatives: Mistral AI (France) offers commercially competitive foundation models developed within EU jurisdiction. The Mixtral-8x22B model activates only 39 billion of its 141 billion parameters per token through a Mixture-of-Experts architecture, while supporting native function calling and 64,000-token context windows. Specialists such as Mind Foundry (UK) provide interpretable AI solutions for high-stakes applications in regulated industries.

---

Competitive Advantage: Where It Actually Emerges

Fashion and Retail Enterprises

Competitive advantage does not come from owning a general-purpose LLM. It comes from proprietary data (customer behaviour, SKU dynamics, supplier relationships), domain-specific decision contexts (seasonality, markdown optimisation, sustainability reporting), and speed of experimentation rather than architectural purity.

McKinsey research indicates that generative AI could add £120–220 billion ($150–275 billion) to the fashion industry’s profits through applications in marketing copy generation, visual content creation, and personalised customer engagement. However, capturing this value requires focusing on high-impact use cases rather than infrastructure ownership.

Abercrombie & Fitch offers a related lesson: it cut inventory by around 30% year on year in Q2 2023 whilst lifting operating margin to 9.6%, through tighter buying and a chase model rather than any proprietary technology—exactly the kind of disciplined merchandising AI can now accelerate. McKinsey research found that early adopters of AI-enabled supply-chain management improved inventory levels by 35%, logistics costs by 15% and service levels by 65%.

Enterprise Software Providers

For platform-scale software companies (Oracle, SAP, Salesforce), the calculus shifts. These organisations justify model investment through customer leverage (hundreds of thousands of enterprise customers demanding AI capabilities), distribution advantage (embedded models with high switching costs), and R&D amortisation across substantial user bases.

Critical Question for Software CTOs: Does your customer base create the volume and leverage to justify bespoke models, or does partnership with foundation model providers deliver equivalent functionality at lower risk?

Oracle’s approach illustrates strategic positioning—embedding AI capabilities across its enterprise software stack whilst maintaining partnerships with foundation model providers.

The Domain-Specific LLM Opportunity

For enterprises with genuinely differentiated data assets, domain-specific LLMs represent a middle path. These models can outperform general-purpose alternatives on specialised tasks whilst requiring substantially less investment than foundation model development.

Fashion-specific examples include visual search optimisation using proprietary product imagery, trend prediction models leveraging first-party demand signals, and sustainability scoring models drawing on supply chain data not available to general-purpose LLMs.

European enterprises pursuing domain-specific models can consider partnerships with regional AI developers—such as Mistral AI (France) for foundation model capabilities or Mind Foundry (UK) for high-stakes applications requiring interpretability—as part of a diversified model portfolio that reduces single-vendor dependency.

Key Discipline: The differentiation must be provable and defensible. If the same outcome can be achieved through RAG or fine-tuning, the case for domain-specific models weakens considerably.

---

The Economic Reality: Understanding the Margin Constraints

Fashion and retail enterprises operate on fundamentally different economics than software companies considering AI investment.

Fashion retail margins are structurally thin: Net margins are typically far lower than in software, with luxury brands at the higher end and high-volume operators at the lower end. Pure-play online retailers have been under particular pressure: ASOS reported a pre-tax loss of £281.6 million for the year to August 2025, whilst omnichannel Next plc passed £1 billion in pre-tax profit for the first time. This compares unfavourably to the margins achievable by established software businesses.

AI investment must demonstrate rapid payback: Unlike software companies that can treat AI development as a multi-year R&D bet, fashion retailers require demonstrable return within much shorter planning cycles. BCG’s 2024 finding that 74% of companies have yet to show tangible value from their use of AI reflects this pressure acutely.

Open source cost structures favour high-volume workloads: The economics of self-hosted open source models become attractive primarily for enterprises with substantial inference volumes. An organisation running millions of daily chatbot interactions can achieve significant savings by switching from per-token cloud pricing to GPU-leased instances. For lower-volume use cases, API-based consumption typically remains more cost-effective when accounting for infrastructure and operational overhead.

Implications for CTOs: AI strategies that prioritise operational efficiency (inventory optimisation, demand forecasting, markdown management) will generate faster payback than customer-facing applications that require longer adoption curves. Additionally, organisations should approach AI investments with the same rigour applied to other capital expenditure, including sensitivity analysis and clear decision gates. Robust FinOps practices are essential for AI cost analysis and control.

---

What’s Next

This article has established the strategic and economic foundations for enterprise AI decision-making. In Part 2, we examine the risk landscape—including regional provider evaluation, AI supply chain security, and regulatory considerations that CTOs and CISOs must navigate.

---

References

[1] BCG, “The Widening AI Value Gap: Build for the Future 2025” (September 2025).

[2] McKinsey, “The State of AI: How Organizations are Rewiring to Capture Value” (March 2025).

[3] McKinsey, “The State of AI in 2025: Agents, Innovation, and Transformation” (November 2025).

[4] McKinsey, Mozilla Foundation, and Patrick J. McGovern Foundation, “Open Source Technology in the Age of AI” (April 2025).

[5] Deloitte, “State of Generative AI in the Enterprise” (2024).

[6] Epoch AI, “The Rising Costs of Training Frontier AI Models” (February 2025).

[7] Stanford AI Index, “Artificial Intelligence Index Report 2024”.

[8] Meta AI, “The Future of AI: Built with Llama” (December 2024).

[9] Netskope Threat Labs, “Cloud and Threat Report: Generative AI 2025” (2025).

[10] Microsoft and LinkedIn, “2024 Work Trend Index Annual Report” (May 2024).

[11] Meta AI, “The Llama 4 Herd: The Beginning of a New Era of Natively Multimodal AI Innovation” (April 2025).

[12] McKinsey, “Generative AI: Unlocking the Future of Fashion” (March 2023).

[13] McKinsey, “Succeeding in the AI Supply-Chain Revolution” (April 2021).

[14] BCG, “AI Adoption in 2024: 74% of Companies Struggle to Achieve and Scale Value” (October 2024).

[15] ASOS plc, “Final Results for the 52 Weeks to 31 August 2025” (2025).

Image generated by Night Cafe Studio AI