The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

learn more… | top users | synonyms

0
votes
3answers
230 views

Is it possible to rate limit based on host headers? i.e. not just on ip address

I have a web service endpoint that I am building where people will post an xml file to, and it will really get pounded with over 1K requests per second. Now they are sending in these xml files via ...
0
votes
2answers
223 views

How wordpress.com do scalability

Out of curiosity, I wanted to know, how Wordpress.com scale their architecture, specifically: how they handle sub-domains. I believe they have millions of subdomains.CMIIW. How do they scale their ...
0
votes
1answer
328 views

Memcached server: Is it a good practice to point two server urls to the same server?

I have a system where there are connections to a memcache server from several different files and servers. I would like to stay with one server but keep the option of increasing the number of ...
-3
votes
1answer
165 views

How scalable is mySQL server? [closed]

I am debating on whether I should have three separate wordpress installs with three separate databases, or whether it would be okay to use multisite (which only uses one central db). I am concerned ...
3
votes
5answers
2k views

Apache on Windows in production environment? Why not?

"Everyone" know that Apache is for Linux/Unix and on Windows IIS is the way to go. However, I'm not a pro at Linux and it would be an enormous relief for me to use just the same setup in the ...
0
votes
1answer
645 views

nginx / node.js / postgres, scalability problems?

I have an app running with: one instance of nginx as the frontend (serving static file) a cluster of node.js application for the backend (using cluster and expressjs modules) one instance of ...
4
votes
8answers
3k views

Multiple servers vs 1 big server performance

My team of developers has suggested a server structure for an upcoming project we are developing. Our structure is "logical", meaning that the various logical components of the application (it is a ...
1
vote
2answers
419 views

Scalable Web Application Hardware Topology Best Practice

I'm working with an existing web application developed in Ruby with a MySQL back-end, but I think the generic hardware topology question will apply to a wide variety of server architectures. I'm ...
2
votes
3answers
330 views

Scaling Out SQL Server 2008 R2

I am looking into the possibilities of how to scale out the sql server 2008R2. simply scaling up wont be enough. "p2p replication" and "distributed partitioned views" look interesting, but both ...
1
vote
1answer
445 views

Which requests cause a w3wp process to grow considerably?

On a production environment, how can one discover which Asp.Net http requests, whether aspx or asmx or custom, are causing the most memory pressure within a w3wp.exe process? I don't mean memory leaks ...
0
votes
2answers
429 views

Why should one use amazon-elb?

Amazon-elb is a scalability solution that works like a proxy to several instances of my amazon ec2 servers. I wonder if it would'nt be more effective to have a roundrobin DNS to resolve my name into a ...
3
votes
3answers
2k views

Database scalability with write-heavy application

I have a write-heavy application. The application is best compared to surveys - the customer creates custom questionares and this is saved to the database. Most of the requests are from their users ...
1
vote
1answer
407 views

Multiple AWS EC2 Instance with Single Database

Currently we are using One EC2 instance to run our Services. And we are planning to add one more instance to put our application Server. Is it better to put the database in separate instance and query ...
1
vote
2answers
890 views

KVM on multiple servers

I'm using KVM for virtualization on a couple of Ubuntu servers but each physical server runs a bunch of VMs. Is there a way I can scale my VMs across physical servers? Does KVM support this? Is there ...
-3
votes
1answer
60 views

Doubts about best choices for a webserver [closed]

I have this config. Quad core i7 930 (x64) 6gb ram WEBSITE architecture php language for website mysql and it is possible the use of cassandra SSL protocol three hundred thousand visits (daily) ...
1
vote
2answers
245 views

How to theoretically prevent hardware failures in a collection of 10,000 servers?

From a book about warehouse-scale computers: Although it might be theoretically possible to prevent hardware failures in a collection of 10,000 servers, it would surely be extremely expensive. ...
3
votes
3answers
147 views

SQL Server 2008 Enterprise edition 64 bit scalability

I am currently running SQL Server 2008 64-bit Enterprise Edittion on a VM ware environment with 4 CPUs and 32GB RAM. I want to scale it up. Is there a limit on how many CPUs and RAM I can go up to? I ...
1
vote
3answers
216 views

What is the best way to seed 20.000+ torrents [closed]

What is the best (most stable) way to seed 20.000+ torrents on 1 server?
3
votes
2answers
867 views

Is Amazon EC2 for me?

I'm working on an image hosting website tailored to a particular niche. The website is made with Django. I'm currently planning to run it on Linode. So far so good. The problem is: I will need to ...
0
votes
1answer
414 views

Scalability problem (Tornado). Can't figure it out, holding up launch

Thanks guys, any ideas/insight are appreciated b/c this is driving me crazy. Problem: Only about 3 or 4 users can use the server simultaneously before app grinds to a halt. Currently we see massive ...
10
votes
6answers
4k views

What is a typical method to scale out a software load balancer?

I often see web app architectures with a SLB / reverse-proxy in front of a bunch of app servers. What happens when the number of connections to the SLB requires too many resources for a single SLB to ...
0
votes
1answer
82 views

Utilizing two servers (LAMP)

I currently have my web app on a single cloud server. Been doing this for a few months now and I have EVERYTHING on this instance (app, cron scripts, mysql, svn, dev environment, etc). The site is ...
1
vote
1answer
68 views

Is it a good idea to separate the Database and the website files in 2 shared hosting?

Do you think If I did separate the db and the files will make it performs better? and is this easy thing to do? What if I upgrade later on to 2 VPS as well, can I do the same thing without affecting ...
0
votes
1answer
234 views

Approximately, how many writes can a EC2 large dedicated Mongo server handle?

Let's assume that it was only writes. Each "document" inserted is less than 140 characters. How many writes can this database handle?
2
votes
1answer
1k views

Setting up a Rails 2.3.x app on EC2 for easy scalability

I'm running a simple rails stack on a single dedicated machine. We're reaching our full capacity and have absolutely no setup for scaling, just one app on one machine. I did some research and came up ...
23
votes
6answers
3k views

Scaling databases with cheap SSD hard drives

I hope that many of you are working with high traffic database-driven websites, and chances are that your main scalability issues are in the database. I noticed a couple of things lately: Most large ...
1
vote
2answers
256 views

Open source cloud computing with scalable virtual machines

I'm searching for open source software to create my own cloud computing environment, like Ubuntu UEC or Eucalyptus. What I need is that each virtual machine can use resources from multiple nodes ...
0
votes
2answers
463 views

https scalability for concurrent connections

I am a building a site right now that has a lot of chat messages and social communication moving between users in both real-time and accessed through archives (text material, not images). I want to ...
2
votes
2answers
1k views

How to load balance > C100K?

Suppose that a hypotetical webapp keeps one connections per user (eg: chat app using comet, long pooling, etc...). How can i load balance such thing to scale beyond the connection limit of a single ...
0
votes
2answers
213 views

Cherokee Web Server and large files

Is Cherokee Web Server (several servers behind a load balancer) suitable for delivering large files (in the range of 20 - 500 MB) to a big number of clients (several thousands) ?
3
votes
1answer
450 views

Ideal server specs/software for mail, file, and database storage

I'm trying to figure out what the ideal set up would for a few servers. 1) Website 1) Mail server 1) Database server 1) file server In this given scenario, say there is a site that will offer each ...
3
votes
1answer
813 views

M-M or M-S replication of EBS volume across multiple EC2 instances

I would like to share EBS backed file system of size up to 20GB in 200K files across multiple EC2 instances. Master-master would be ideal, but I'd be happy with master-slave solution too. I know that ...
1
vote
2answers
148 views

Push sub-database to master-database?

Say, I have a big database globalclients which is very very big. Now, I divide this big database to 100 sub-databases, as: chinaclients japanclients koreaclients indiaclients brazilclients etc. ...
0
votes
1answer
183 views

Can sql server scalable shared databases work with a vmware (ESX server) shared disc?

I've recently found out about sql server scalable shared database technology and I'd like to test it out in a vmware environment. Our production environment is SAN based but we don't have a test ...
6
votes
1answer
1k views

IPSec software that can use multiple CPU cores

Can anyone recommend a good IPSec software that can use multiple CPU cores to achieve performance ~2Gbps on Linux dual-CPU quad-core E5620 Xeon setup (total 16HT cores)? I have tried OpenSwan and ...
0
votes
1answer
332 views

Too Many/A Lot of Public SSH Keys

A new thing I have been tasked with trying/exploring is setting up a server that will essentially have 200 to 300 people ssh'ing into a single user to run a task. They might only need to do it once a ...
3
votes
2answers
4k views

What are the best strategies for scaling up my web application to be able to cope with a large volume of users?

I want to get some advice / best practices for how to go about developing a strategy for scaling up my a web application. I waffle on a bit here and show my limited knowledge but want to fill in my ...
2
votes
2answers
111 views

web app reaching emailing limits - what is the next step up?

Recently i have been working on a popular web app that currently has around 70k members and a lot of traffic, i migrated the site to a new extra large EC2 instance and it seems to be a massive ...
1
vote
1answer
638 views

COM+/Desktop Heap errors in IIS affecting sites at random?

We have a Win2K3 server that is hosting 30+ sites. Each site is configured to have its own unique application pool -- so that we can manually recycle specific sites if needed and not kill sessions ...
4
votes
2answers
303 views

The CPU and memory is limited in the Cloud, So where is the scalability?

I don't understand cloud, the CPU is limited, Memory is also limited, where is the scalability? Isn't it just the same like VPS with more expensive cost for bandwidth? So what scaling advantage is ...
1
vote
2answers
406 views

What techniques do you use to design and scale a web app horizontally (in EC2)?

Specifically I'm looking for techniques for scaling a web application which has no central database server, in the cloud, but general advice is great. I have come across GlusterFS, which looks great, ...
0
votes
2answers
111 views

Run untrusted program from apache

I have a problem to which I already have an implemented solution, but I'm not sure whether it's the best one. In the interests of not biasing any possible responses, I won't say how I've chosen to ...
1
vote
4answers
333 views

How should I host a site that could potentially get a short spike in traffic of 1000%+

This is a purely theoretical question, but what if I had a site that would normally only get a couple thousand hits a day, but for a few days each month that could shoot to several hundred thousand or ...
3
votes
1answer
763 views

Nginx vs Apache & mod_php for PHP and php+fpm vs fastcgi

It seems to be universally recommended to run Nginx as a reverse proxy in front of Apache but there seems to be a devision in opinion on whether Apache + mod_php or Nginx are better for serving ...
30
votes
9answers
2k views

What's the piece of hardware listening on Facebook's or Wikipedia's IP address?

I am trying to understand how massive sites like Facebook or Wikipedia work, for my intellectual curiosity. I read about various techniques for building scalable sites, but I am still puzzled about ...
6
votes
3answers
995 views

What are the typical methods used to scale up/out email storage servers?

What I've tried: I have two email storage architectures. Old and new. Old: courier-imapds on several (18+) 1TB-storage servers. If one of them show signs of running out of disk space, we migrate ...
1
vote
1answer
460 views

How to scale out image hosting/serving?

I asked this question on stackoverflow and it was suggested that I try it here: I'm building a website where users can upload photos and I'd also convert uploaded photos into thumbnails. Planning ...
3
votes
2answers
1k views

Mongodb: What does webscale means?

Mongodb is known to be webscale. I tried looking on the internet about what webscale actually means but ends with no luck. So, what does webscale really means? And how is it any different than any ...
0
votes
2answers
626 views

Windows Server 2008 Web vs Standard [duplicate]

Possible Duplicate: Windows Server 2008 Web vs Standard Please tell me what choice will be best between Windows Server 2008 R2 Web edition and Windows Server 2008 R2 Standard edition for ...
0
votes
2answers
372 views

Windows Server 2008 Web vs Standard

Please tell me what choice will be best between Windows Server 2008 R2 Web edition and Windows Server 2008 R2 Standard edition for NoSQLDatabase/BackendComputing scaling farm? I am pretty sure that ...