Twitter: Service vs. Platform

Ruby on Rails scalability is indeed a hot topic. First off and being utterly blunt, Alex is talking out of his ass, he clearly has no experience with building scalable web sites.

The way I see it, scalability is really more a platform and architecture challenge than a language specific problem. MySpace was originally written in ColdFusion, then upgraded to ASP, then .NET.
Check out this article on history of how MySpace scaled http://www.baselinemag.com/article2/0,1397,2082921,00.asp

The focus is to identify the bottlenecks (not just blinding blaming a whole language) and then adapting the architecture to deal with it. Developers and management alike tend to think that there is only 1 right architecture to scale, that’s so not true, every high volume website has their own unique set of challenges.

Here’s another article from someone who seems to have a better understanding of scaling RoR
http://poocs.net/2006/3/13/the-adventures-of-scaling-stage-1

By the way, there is no business using Mongrel in a site with massive traffic, go to lighttpd or Apache with fastcgi, etc.

My account was suddenly canceled. I went through the procedure to restore it and it is still canceled in spite of the promise to restore it in a few moments. The 2 desperate messages to Twitter have not been answered.

Nice post! Optimization does count!

Jeff, I was about to email you this link, but figured it would be better to make it public:

Twitter’s Growing Pains
http://www.technologyreview.com/Infotech/21103/?a=f

Not sure if there’s any new info here, but it was posted today.

Kyle

This could be a solution for them, http://www.espace.com.eg/neverblock
This library would solve many of the concurrency issues held by Ruby. Regretfully the implementation done till now is for Ruby 1.9 as it builds over the fibers implementations in 1.9

C# is byte code, just like Java is. And its not as fast as C++, either. Like Java, its very close, but its not as fast overall as C++.

@diego - You know that MySpace runs on ASP.NET, right? They’re probably around 2 billion page hits a day by now.

As others have pointed out, though, this has got to be all about the database. This is a simple app with very little processing. The majority of the load is in the database. Language speed probably has little to do with it.

Could you please cite a source for those performance numbers?

MySpace runs on BlueDragon (a ColdFusion clone), not ASP.NET

http://www.myspace.com/codinghorror.cfm