Comcast Business Guest Blog: Key Network Considerations for Supporting Enterprise AI Applications

Artificial Intelligence is making its enterprise pivot from hype and fear of missing out (FOMO) to strategic priority. Models have evolved dramatically, becoming smaller, faster, more specialized, and significantly more capable. As such, tech leaders are ramping up their AI investments— 78% of enterprises expect to expand AI budgets this year—and the pressure on enterprise networks is intensifying.

Ambitious AI projects will falter if the underlying network can’t keep up. To move AI from pilot to production at scale, technology leaders are rethinking how their networks handle data flow, security, and resilience.

The AI Workloads Changing the Game

Different AI deployments enable distinct business capabilities and open new doors to enhanced experiences and operations—but they also each place unique demands on the supporting network infrastructure. Key emerging AI workloads include:

• Real-time analytics & decisioning: AI-powered analytics systems (e.g. fraud detection in finance or supply chain optimization in manufacturing) ingest streams of data and return insights instantly. These use cases demand fast, low-latency data delivery so decisions can be made in split seconds.
• Edge AI inference: In retail and healthcare, for example, AI models run on edge devices to analyze local data. This pushes significant processing to the network edge, requiring reliable, high-throughput links to central clouds for aggregated learning and coordination.
• Generative AI at the edge: New services like virtual assistants, interactive kiosks, or customer service bots in physical locations use generative AI models. To feel responsive and human, these applications need fast, local processing or ultra-reliable connectivity to cloud AI platforms.
• Autonomous “agentic” AI: Looking ahead, autonomous AI agents and processes will act on their own to complete tasks, with Gartner predicting that 15% of all day-to-day work decisions will be made by agentic AI by 2028, and 33% of enterprise software applications will include the technology.

What AI Really Needs from the Network

To support these next-generation workloads, networks must deliver a mix of capabilities well beyond basic connectivity:

• Low Latency & High Throughput: Models crunching data in real time need data to arrive without delay or loss. In fact, networking experts predict AI will drive a dramatic jump in data traffic, with direct generative AI data traffic reaching exabyte scale by 2033.
• Resilience & Consistency: Self-healing capabilities, intelligent routing around faults, and built-in redundancy are must-haves to keep AI services running 24/7.
• Cross-environment data integration: Today’s AI often lives in a multi-cloud, hybrid, and edge-based ecosystem. Data might be generated on an IoT device in the field, processed by an AI model in a public cloud, and then stored in a private data center. The network must integrate disparate environments, moving data across cloud and on-premises boundaries without friction.

Aligning Architecture with AI Deployment Goals

How can organizations evolve their network architecture to meet these demands? Several strategic shifts are underway:

• Distributed compute awareness: AI workflows increasingly span from cloud to edge, so networks must be designed with decentralization in mind. That means networks will be connecting a far-flung web of AI components. Software-defined wide area networking (SD-WAN) can help meet this need by dynamically routing traffic based on real-time conditions and policies.
• AI-aware traffic optimization: Organizations are implementing AI-aware network controls that recognize traffic patterns and optimize accordingly. This might mean automatically prioritizing an important machine-learning data feed over routine email traffic, or caching frequently used AI datasets at network edges to reduce repetitive data transfers.

Securing AI at the Network Layer

AI deployments amplify the importance of robust network security. These systems often handle sensitive data and help power critical decisions, making them attractive targets to would-be attackers. Key focus areas include:

• Zero trust principles: Adopting a zero trust architecture means that no user or device is implicitly trusted—every connection is authenticated and authorized. This model is essential in AI environments where machines (like IoT sensors or AI microservices) are talking to other machines.
• Network segmentation: Strong segmentation of the network can contain threats if they arise. Practically, this means isolating AI workloads and data pipelines in their own network segments, separate from the broader network.
• AI-powered threat detection: Just as AI is used to optimize network performance, it’s also quickly changing the game for network security monitoring. Incorporating machine learning-based can help identify anomalies in traffic that signify breaches or data exfiltration in progress.

Comcast Business is the #1 provider of Managed SD-WAN for enterprises, with the largest market share and more sites added in 2024 than any other provider ranked on Vertical Systems Group’s U.S. Carrier Managed Leader Board, and has been as the fastest-growing Managed SD-WAN provider for the sixth year in a row. Learn how we are helping enterprise leaders build a technology foundation for their transformation journeys.