I’ve written before about the fact that SaaS companies need to think a lot more about the infrastructure that brings their customers to them – that infrastructure (mainly) being the Internet.

One of the things that I hadn’t thought about, but that came up in discussions with people about networks, is the fairly stunning statement that the Internet is not flat. This is stunning because it flies in the face of all my Internet experiences, a  point I argued and won.


To the average user of the Internet, this statement is not true. The Internet you connect to is flat, one pipe (or modem) in, and you see everything on the net. Content goes up and down your pipe and you pay your flat fee or Mb usage and away you go. No concept of the tyranny of distance exists except for speed.

company flat

But for web properties this is not the case.  When you are a big property (that is have a lot of traffic) the web isn’t flat, in fact its made up of a bunch of geographic hops that funnel traffic to and from you. This traffic (known as backhaul) costs carriers to move around and because of this they like to charge for it. Typically the calculation is based on the distance the traffic has to move x the amount of traffic. Note that this ignores international peering which i’ll get to because its really important in a NZ context.

Some web properties don’t like to pay for this traffic. The subscribe to the belief that the Internet is flat and try to get around it. This has a couple of consequences, firstly they tend to underspec their connections to their user population and end up delivering really poor user experiences, see blip TV for an example.

The second consequence is that they go with low cost providers. I can’t speak for the rest of the world but here that means signing up with international carriers who are using marginal pricing to leverage their fixed investment to get to this part of the world OR are using assets already written down when they filed for chapter 11 in the US. 

This provides the web property with cheap bandwidth but actually means the user requests are now spanning the world, that is going all the way to the US and back to see a web page owned by a NZ company. End result is slower response times for users or higher cost international bandwidth which if you follow the logical path gets factored into the end users flat fee or Mb usage costs.

End result – someone pays.

My point of this post? The web properties need to give more thought to the Internet infrastructure that they rely on to do business. They should factor in the end user experience when making their technical and commercial decisions around where to locate their Datacentres and how they buy bandwidth. It costs real money to make the Internet run and there are no free rides

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.