Technical analysis

Why ordinary internet service cannot get this data there in time.

The requirement under analysis: sustained bulk delivery of machine data from each site to two fixed destinations at average payload rates of roughly 44 to 131 Gbps per dense site depending on the delivery window, within a bounded data-age SLA, with protected telemetry and engineered backlog recovery. What follows is the transport-layer mechanics, not a judgment about carrier quality.


1. What an internet path is actually made of

Only the first hop is dedicated. The rest is shared with everyone.

A dedicated internet circuit is dedicated for exactly one segment: the access loop from the site to the carrier's first aggregation point. Everything after that is statistically shared. A typical path from a rural site to a cloud or GPU ingress crosses ten to twenty routed hops across three to five separately owned administrative domains. Every domain boundary is a queue, a policy point, and a potential congestion point, and every element past the first is outside the site contract.

Path segmentWho controls itCapacity committed to this flowObservable to you
Access loop, site to carrierSite carrierYes, the port rateYes
Carrier metro aggregation and coreSite carrierNo, statistically multiplexedNo
Carrier peering or transit handoffTwo parties, bilateralNo, sized to average demandNo
Transit backbonesTransit providersNoNo
Transit to destination peering portTwo parties, bilateralNo, historically the hottest pointNo
Destination ingress edge and fabricCloud or GPU providerNo, policed and rate-managedNo

On the private path, every segment from site demarcation to destination cross-connect is a contracted product with committed capacity, held by one operator, instrumented end to end.

2. Internet routing picks the cheapest path, not the fastest

Internet paths are selected by a policy protocol. Selection is driven by each network's commercial preference, typically its cheapest egress, and by path length. No step in that selection consults latency, loss, jitter, or link utilization, so traffic keeps being sent into a saturated interconnection port indefinitely, because saturation is invisible to the protocol. Each network also hands traffic off at its nearest exit to minimize its own carriage cost, which routinely produces asymmetric paths: the forward and return directions of one flow cross different infrastructure, with different behavior, defeating both performance reasoning and fault isolation.

The path is also not stable. Routes change without notice through maintenance, failures, and commercial renegotiations, so the path measured during a pilot is not guaranteed to be the path in production. Every network in the middle is optimizing its own cost of carriage. None is optimizing, or even aware of, your delivery objective. On the private path there is no path selection between site and destination at all: traffic follows engineered circuits whose route, capacity, latency, and failover behavior are fixed by design and stated in each Site Deployment Plan.

3. Delivery times have to be predictable

End-to-end latency has two components: propagation, fixed by distance, and queueing, variable and accruing at every congested hop. On a multi-domain path, queueing delay varies with everyone else's traffic: diurnal peaks, buffer bloat at access and interconnection points, and congestion events produce round-trip variance the site's dedicated loop does nothing to prevent. For interactive traffic jitter is an annoyance. Here it is contractual, because the SLA is expressed as maximum data age at the destination, and delivery-time predictability is exactly what queueing variance destroys. A path whose round-trip time breathes between 35 ms and 120 ms with the internet's load cannot support a bounded delivery commitment.

35 to 120 ms
typical internet round-trip variance under load
18 to 47 ms
engineered per-site route baselines, stated per site
Sub-millisecond
jitter on the private path, held at peak

4. A little packet loss wrecks transfer speed

Lose a fraction of a percent, and speed falls off a cliff.

Sustained bulk transfer is governed by the loss-throughput relationship: per-flow throughput is proportional to segment size divided by round-trip time times the square root of loss. Two structural consequences follow. Fractions of a percent of loss on a long path cut per-flow rates by an order of magnitude. And the internet path caps segment size at the standard 1500-byte frame, because jumbo frames do not survive multi-domain transit, while the private path runs jumbo frames end to end, raising the per-flow ceiling roughly sixfold at identical round-trip time and loss.

Path loss ratePer-flow ceiling, 40 ms round trip, 1500-byte framesParallel flows needed for 44 Gbps
0.001%, well-run path, off-peak~113 Mbps~390
0.01%, ordinary internet weather~36 Mbps~1,200
0.1%, congested peering at peak~11 Mbps~3,900
1%, congestion event~3.6 Mbps~12,300

Parallel flows mitigate the per-flow ceiling but do not repair the underlying capacity: thousands of competing flows converging on the same congested port amplify queueing, raise the loss rate they are trying to outrun, and inflate transfer time through retransmission, which also duplicates carried volume. Loss at peak is precisely when the fleet is offloading. The private path is engineered to loss at or below 0.001% with fixed round-trip time and jumbo framing, so the same 44 Gbps objective is met with a handful of flows, and the loss and latency budget for each route is a stated, tested acceptance criterion.

5. Every site ends up squeezing through the same few points

Every shared segment above is oversubscribed by design: it is sized to average demand across all customers, not to any customer's committed rate, because that is what makes internet service economical. The binding constraints in practice are the bilateral interconnection ports, carrier to transit and transit to cloud, which are sized commercially, run hot at peak, and are augmented on negotiation timescales measured in quarters, by parties with no contract to your program.

The fleet then makes this worse with its own success: every added site sends bulk flows to the same two destinations, so the program's traffic fans in on identical choke points and congests itself, with degradation correlated across all sites, at peak, simultaneously. Every architecture has bottlenecks. The distinction is whether they are owned, measured, provisioned, observable, and expandable, or merely encountered downstream. The private design does not eliminate convergence, it relocates it to the A/B Aggregation Core, where aggregate demand is the arithmetic sum of contracted tiers, capacity is contracted non-blocking, utilization is reviewed quarterly, and upgrades follow a published tier ladder ahead of saturation.

6. You cannot see, or fix, most of the path

Operationally, the internet path ends at the carrier edge. There is no telemetry into a transit provider's queue depths, no ticket to file on someone else's peering port, no restoration target that attaches to the segment actually failing, and, given asymmetric routing, often no certainty about which segment that is. Fault isolation across three to five administrative domains is a negotiation, not a procedure. The private path is instrumented per segment, and delivery telemetry, bytes generated, queued, transmitted, received at aggregation, and accepted at destination, localizes any shortfall to source, storage, transport, core, or destination ingest, under one operator's SLA with stated restoration targets, credits, and chronic-outage rights.

7. What you need, and what each option actually does

What the program needsWhat internet access actually doesWhat the private path does
Sustained 44 to 131 Gbps payload per dense sitePer-flow ceilings set by loss and round-trip time; shared segments sized to average demandNon-oversubscribed committed capacity, jumbo framing, engineered loss budget
Bounded data age at destinationQueueing variance and route instability make delivery time unpredictableFixed engineered round-trip time per route, sub-millisecond jitter, stated in the deployment plan
Protected telemetry classNo end-to-end quality of service: class markings are not honored across domainsThree service classes enforced end to end: protected, shaped, recovery
Backlog recovery after impairmentRecovery flows compete at the same congested choke points at peakDeliberate spare capacity engineered per site for drain rate
Fault isolation and remedyThree to five domains, asymmetric paths, no cross-domain SLAOne operator, per-segment telemetry, single SLA with restoration targets
Path and cost governanceRouting selects for each intermediary's cost; paths change without noticeEngineered circuits; route, capacity, and failover fixed by design

Conclusion

None of these mechanisms reflects poor carrier engineering. Each is the internet working as designed. Routing economics, statistical multiplexing, nearest-exit handoff, and best-effort interconnection are what make universal reachability affordable, and they are exactly the properties that make bounded, sustained, high-volume delivery between fixed endpoints unachievable as a contractual commitment.

Internet access optimizes reachability at lowest cost. This program requires assured delivery within a data-age budget. Those are different engineering problems, and the private managed fabric exists because the second cannot be solved with the tools of the first. The mismatch is not paid for in network terms: it is paid in idle GPU capacity waiting on delayed data, and in training and program milestones that slip behind it.

Figures shown are illustrative planning and engineering values. Per-site values are set in each Site Deployment Plan.