How to design scalable applications? [closed]

Answer 1

Over the past year I've had to come up to speed on this question for a project my company's working on, and I've found these resources extremely helpful: Todd Hoff's highscalability.com; Scalable Internet Architectures, by Theo Schlossnagle; and Building Scalable Web Sites, by Cal Henderson. Highscalability.com in particular will point you to many good presenations, tutorials, books, and papers, and is a great place to start. All of the advice is practical, and based on experience at sites like Flickr, Twitter, and Google.

BTW, scalability is not performance. A perfectly scalable system is one that has a fixed marginal cost to add additional users or capacity.

Answer 2

• I tend to think that scalability is closely related to maintainability. And it seems to be often overlooked that people spend only a short time developing applications and the rest of the time maintaining it.

• Also, scaling has almost certainly to do with data (which is more agile than code - so you like to have more and more of it), thats why your storage access cost should stay between O(1) and O(n).

• The perfectly scalable application for me is one that I could copy from an environment to another (similar) environment, configure a few values and run it to extend the execution realm of the whole application.

Answer 3

This is exactly what you need! Application Architecture Guide was created by Microsoft Patterns and Practices team to help architects...

Answer 4

Before you start with technique you should know the application scope dead cold. What does the customer / business unit expect in terms of performance, and what are the critical areas of failure? Scott Hanselman had a great podcast regarding the subject.

Some of tidbits offered: don't use caching unless you have to; serving up files is faster than assembling fragments from a database; know how to handle peek server times; know what your peaks will be.

Again, know the scope of the usage first in order to know if you should scale.

Answer 5

Whatever you do you cannot design the system right from the start to be scalable for all your needs. Often once you have your system running you will find bottlenecks where you least expect them (ie: local network bandwidth). Anyway, my advice is definitely highscalability.com as well :)

Answer 6

I would suggest this book for that:

http://www.amazon.com/Scalable-Internet-Architectures-Developers-Library/dp/067232699X/ref=sr_1_1?ie=UTF8&s=books&qid=1243267630&sr=8-1

Even though this is primarily a PHP book, the ideas are the same for any web stack.