Posts Tagged 'internet'

Steve’s incredible gift to the world…

boingboing.net's excellent tribute

No, it’s not the iPad, the iPhone, or even the iPod. It’s definitely the Mac. Steve Jobs real gift to the world was bringing the Mac to the market in 1984. The Macintosh was a major step in making personal computers pleasant and easy enough to use to gain mass market appeal. If the Mac hadn’t been released then, the industry, our industry, would not be where it is today. You likely would not be reading this, you would not be on Facebook or Twitter, you wouldn’t know many of the people you know, especially those met online.

The Mac was never the market leader, but it’s existence opened peoples eyes. Computers HAD to be easy to use like the Macintosh, cryptic commands typed into dark screens weren’t going to cut it. This changed the game, the competition released competing products and the personal computer industry as we know it was born.

That’s was what Steve did. He didn’t invent anything brilliant. He took fantastic people and technologies and integrated them into products that created market sectors that didn’t exist. He took huge gambles, that industry experts almost always said would not pay off. Sometimes they didn’t. But others really did change the world. I know it’s trendy to hate Jobs, Apple, heck, anything popular with hipsters. Just don’t forget the value of what Jobs accomplished with his much too short life. Certainly the world would look very different today if the modern computer as we know it was still sitting in the halls of Xerox and the labs of Universities for another 5 or 10 years as everyone continued to type cryptic commands into their terminals…

Rest in peace Steve, you changed my life, and for that I will be eternally grateful.

The internet isn’t free

I was reading an EFF article advocating free open wifi for all and it got me thinking. When did people get the idea that internet should be free? Certainly it wasn’t from working at an ISP, getting peering, negotiating bandwidth pricing, buying gear, leasing fiber… Having done all of the above, let me rant! (Ok so I’m ranting about broadband quotas and torrent throttling like always)

Let’s say I buy a full non-burstable gigabit link from one of the cheaper telcos like Cogent or Level 3. Depending on your market, you will end up paying $4-8/megabit for it. Thats not including termination, port fees, the hardware required to route it, cost of transport (i.e. your fiber conduit rental) , etc and those things can certainly add up to 5-20% of the total cost, but for the sake of simplification we’ll ignore them. 1 gigabit, when run to the horrible limit (resulting in very unhappy customers) is 328, 718 gigabytes/month of actual data moved, and frankly is a lot of traffic in any sense. (Lets leave peering out of this discussion, the larger an ISP the more of their footprint they can get through peering, but it really doesn’t help the independents and even mid-sized guys without international fiber to meet in lots of POPs and IXs)

Now presume I don’t want to oversell it what so ever. I want to sell enterprise grade DSL to businesses who demand a reasonable 10mbps guaranteed. This is a very common scenario. If I split my gigabit link up to 10megabit customers, the most I can fit on it and guarantee their performance is 100 customers. If we take our cost to buy just the transit, ignoring any of the related costs, we’re going to run $40-80/customer. Tack on termination of the DSL/cable (hardware, very expensive), lines to the customer (very very expensive) and of course support, you are looking at easily 2x that cost. While a business will have no trouble stomaching this cost+ profit for us, a consumer obviously will not.

This is where over-selling comes in. If I assume that my 10 megabit users will use roughly 50 gigabytes per month of data, that means I can fit in 6400 subscribers onto that link. (Nobody would run their links at 100%, this would add at least 20-30% to the total cost of bandwidth to buy overhead, but we’ll ignore it for simplification sake) 6400 subscribers, each now are only using a dollar or so of our transit, and with support, hardware and line costs fixed, we can sell the service for $40, cover our costs and make profit. Yes profit. People seem to forget, a company needs to make profit or its share holders will terminate them. Profit is not evil or crooked.

This all worked great in the early 2000s. Bandwidth was cheap, space and power to build telecom sites was cheap, and fiber transport was nearly free. Bandwidth is still cheap, but everything else has gone up an arm and a leg. None of that really matters though, because the real problem is that we don’t use the internet like we did 10 years ago. Who can stand to watch Youtube or Netflix at less than 720p? How many households have a kid (adult) running BitTorrent all the time? And really, who wants a sub-25 megabit link nowadays?

Providers cannot oversell at the levels they did even 5 years ago. While we may say boo hoo why do I care what XYZ evil company makes (not fair, remember these are people working like anyone else), remember we also want startup and new ISPs to compete. They have it even rougher as their cost/subscriber is higher.

Basically it comes down to this. The cost to provide internet, in North America, has not gotten massively cheaper, but per capita we are using much much more. In order for providers to maintain their levels of overselling they are imposing quotas and throttling p2p. People hate quotas and DPI, but trust me, people hate rate increases more. Yes it would be totally cool if we all had gigabit fiber to the doorstep, but sadly this is a huge undertaking, and companies like Rogers or Bell is going to invest in it, wide spread, only to have the government force them to let other providers use the links/equipment at cost. It’s not in the private sector’s best interest to do this. (typo fixed ;) thanks everyone!)

So yea, we have out dated infrastructure since we put it in much earlier than say Asia and Europe. I think, the real solution is for the government to step in and use tax dollars to improve it (OMG, I can’t believe I said that) if we really want deregulated residential internet. Run fiber to the homes, maintain it, charge providers at-cost to use it, and yea we’ll have great competitive internet again.

Yes I advocated for publicly funded internets, I must need coffee.

Of Nick and domain spammers

As far as I’m concerned, there is nothing worse than those who crawl through domain whois records for the purpose of emailing me. I get a lot of it. Funny thing is, it’s strictly forbidden in ICANN’s (the sole registrar accreditation body) rules. ICANN’s Registrar Accreditation Agreement section 3.3.6.3 states:

“Registrar’s access agreement shall require the third party to agree not to use the data to allow, enable, or otherwise support any marketing activities, regardless of the medium used. Such media include but are not limited to e-mail, telephone, facsimile, postal mail, SMS, and wireless alerts.”

In fact this has been on the books since 2003. Yet on a daily basis I receive whois-crawled spam. Now yes, you can definitely whois any domain and readily spam the owner. But these people are not just spamming one or two domains, they’re spamming thousands, if not tens of thousands at a time. (As with all spam, you’ve got to fish a lot to catch anything). Access to this requires what ICANN calls ‘bulk whois’, which pretty much any registrar with an API will provide you. However it is up to them to prevent people from using this as a means to spam people. While I realize it is not trivial to track the spam back to the registrar allowing the mass harvest, it’s not like there is an infinite number of registrars. Tracking down the people providing this information to spammers would not be impossible. Considering ICANN is pretty much useless for everything else (it took them how long to stop turning a blind eye to domain tasting? oh right, 10 years), they could at least enforce this policy, track down offending registrars and remove their accreditation. (I kid, ICANN will never do this, their rules are pretty much toothless, and this article is really just to ridicule spammers who take themselves seriously)

Now, whois-crawled spam is a bit different than your usual spam. No viagra, OEM software or luxury watches. No, whois spammers usual take themselves a lot more seriously, which makes it all the funnier because they’re just as pathetic as the guy selling Chinese V1ag4ra. Let’s look at a few of  the types of assholes who take part in this practice. (and some of my favourite examples)

Web hosts offering quality web hosting at low low prices:

(Click to expand)

The idea behind this type of domain spammer is pretty simple. You own a domain name, everyone who owns a domain name has some sort of hosting for it, everyone likes cheaper hosting. Amusingly sales@ and abuse@ evul.net get *tons* of it, which is usually very poorly targeted (and ironic when it goes to abuse@). However, the spam pictured above was actually well targeted, because its offering local large scale hosting, the kind that evul.net might want. However there in lies the problem, why as a web site owner (or a web host like evul.net) would you ever want hosting from a *spammer*. It immediately calls into question the ethics, let alone the quality of such a provider. They all end up getting spamcop’d and in the case of this one, I wrote to the idiots to personally express my disgust, they are locally known and slimy. Hopefully enough spamcop reports will get these wannabe providers upstreams to slap them, as they’re almost always sent from North America.

SEO/marketing experts asking for links:

(Click to expand)

This one gets me. It’s pretty brainless. We get a ton of these at work for any blog that we have our email address on the whois for. The idea is that if you ask nicely enough for a link (they *always* come from female, likely fake, names) someone will give you that link, and your google pagerank will be increased! In reality you are a spammer. It must work enough of the time that it makes it worth while for these people to do it. I try and spamcop these guys, but it’s like pissing in the ocean: the email sources and spamvertised sites are almost always in South America, Asia or eastern Europe. (This particular one came from some ISP in Argentina) I have a feeling they are usually fronts for something else, (get a pseudo legit page pageranked up, use it to then push other pages up) as no legit page bulk emails out begging for links.

People selling ads/ad network services:

(Click to expand)

I save the best for last. These are the most ironic and we get them from time to time at work. People spam our own sites essentially offering their own advertising services. It’s even better (ironic), like in the above example, when they are spamming an obvious campaign site, showing there is likely no human intervention in the spam. They’re just looking for well pageranked sites and spamming the owners. This again begs the question, who actually receives one of these and takes them up on their most reputable (lol) offers. Sadly some people must to make it worth while. Since these are all pseudo legit (wannabe) marketing companies, they’re almost always in the US, so spamcop for great justice.

We received a good one from a company selling a Twitter trending solution recently, again well targeted against an actual twitter-based campaign site, but it begs the question of how new are these people to the internet. How is it, that in 2010 there are people out there who still believe their business has any legitimacy as soon as they send out unsolicited-bulk email to the same people who have been fighting such email for nearly *20 years*. In short, stop buying services/products you see in spam, have sweet dreams of useless ICANN actually enforcing the bulk-whois-marketing rule instead of ignoring registrars who allow it willy-nilly, and spamcop everything for great justice.

And to “Data Centers Canada Inc.”, “Comodus” and “Linkstar”, congrats you are spammers, any hopes you had of every being taken seriously as legit businesses went down the drain when you sent out unsolicited bulk email to domain owners, no matter how well targeted it was.

Of Nick and Google, again…

Ugh! I totally forgot something important in my article about Google this morning. Though thats okay because it was a pretty long rant already, however at this point I am posting an abnormal number of times in a single day…

Some Italian high school students uploaded a video of an autistic classmate to Google video. Let me start by saying this is terrible and cruel, and I cannot even imagine how cruel bullying must be in a post internet world. Google complied with the Italian law enforcement and handed over the details of the users who uploaded it. This is correct practice. If someone breaks the law, even if its over the internet, they are prosecutable, and content hosts are responsible to comply with law enforcement. I have done this many times and complied with Canadian law enforcement on some very interesting cases.

Apparently though this is not enough in Italy. Four Google Italy employees, including one who had left the company in 2008 were arrested, of which 3 were convicted of violating the videoed boy’s privacy rights. The courts demand that Google should have vetted the privacy of the content that was uploaded before sharing it with the world. REALLY? I mean are they serious? I’m sure they must realize how many videos are uploaded to Google/Youtube/etc every minute of every day? And to check to make sure EVERYONE in the video has signed a release as to their privacy? Heck its not feasible at a few videos per day, let alone the 20 hours of video uploaded to Youtube alone every minute of every day. This would be stupid coming from an armchair politician bitching on an internet forum, let alone the policy makers of an entire country. Seriously this worries me about the sanity of the law makers and future of the country.

It doesn’t stop at video, it could be pictures uploaded to Facebook, of which there are over a hundred million PER DAY. Should Facebook check EVERY photo to make sure nobodies privacy is being encroached upon? Get a clue!

My other complaint is why does every local government think they should be able to police the internet? I think Google should just pull its local offices out of Italy and then just let Italy decide if they want to block Google or not. Let all these insane countries play internet nanny for their citizens, maybe they can get a bulk deal on Cisco gear along with China and Australia… Hey Italy thanks for Ferrari but no thanks for your draconian attempts at internet policy!

Read Google’s own blog post on the matter…

Of Nick and hosting geo-diversity…

If you look at the biggest websites and internet applications, you can pretty much divide them into two groups. Those that are geographically diverse and those that aren’t. It’s kinda shocking that in 2010, the majority of major internet properties still are located in a single (large) datacenter. Though to be fair there is a good reason for that, geo-diversity has many challenges. Problems like directing traffic to the fastest/closest/cheapest/most available location are pretty easy to solve: most people go with BGP AnyCast, targeted DNS responses, or a combination of both. The real challenge though is making sure your actual served content is coherent among all the locations. It would be terrible for a user to upload a photo, sent the URL to their friends, only for the friends to see nothing or worse, the wrong image.

For static content, this is easy, even RSYNCs will be scalable to push out changes to your content amongst your farm. User uploaded content is quite a bit trickier. Within a single datacenter you can efficiently (though not always affordably) solve this using shared storage, iSCSI or NFS. Then applications pretty much can work as if they’re on a single server, session management can be tackled by using cookie or host persistence on the load balancers to make sure a user stays on the same server. What about servers in different locations though? NFS and iSCSI will not be terribly effective over transit.

You will have to push content between your locations then. If you are trying to geographically distribute your own application, you would just write functionality in to immediately push any user uploaded content out to other locations as its created.  Google/Youtube are great examples of this. When you hit content they’ve hosted, it isn’t even hosted on every server, and they direct you to the closest server that has said content. If that content isn’t available locally to you yet, or at all, they can stream it over their own fiber backhaul and out your closest Google POP.

But what if you are hosting a variety of 3rd party software. To my knowledge none of the popular blog packages, forum software, etc has any sort of geo-diversity designed into them. You could of course fork them and write your own, but then you end up supporting N different software packages for your N clients, not affordable or reasonable.  Rsync would do this task but unfortunately it is very intensive and doesn’t scale particularly well because it md5′s your entire tree constantly to see if things changed. As your content scales, the rsyncs would get slower and slower just seeing if changes occurred, eventually leading to massive delays on syncing out user created content.

In the end, its a cool problem, a problem that not too many people have tackled so far. We came up with our own solution, which I unfortunately probably shouldn’t disclose. I wrote the basis of the software last month, though it still needs some bug fixes, testing and more modules to be written for it. It is a difficult problem to tackle, but having worked in telecommunications, no facility is bullet proof, no power is bullet proof, no connectivity is bullet proof, no hardware is bullet proof: geo-diversity is a must going forward in this highly demanding world where everyone expects connectivity and content 24/7

Recent Photos

Red List’s Species of the Day