The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

learn more… | top users | synonyms (1)

8
votes
6answers
3k views

What is a typical method to scale out a software load balancer?

I often see web app architectures with a SLB / reverse-proxy in front of a bunch of app servers. What happens when the number of connections to the SLB requires too many resources for a single SLB to ...
0
votes
1answer
204 views

Approximately, how many writes can a EC2 large dedicated Mongo server handle?

Let's assume that it was only writes. Each "document" inserted is less than 140 characters. How many writes can this database handle?
0
votes
1answer
176 views

Can sql server scalable shared databases work with a vmware (ESX server) shared disc?

I've recently found out about sql server scalable shared database technology and I'd like to test it out in a vmware environment. Our production environment is SAN based but we don't have a test ...
3
votes
1answer
586 views

M-M or M-S replication of EBS volume across multiple EC2 instances

I would like to share EBS backed file system of size up to 20GB in 200K files across multiple EC2 instances. Master-master would be ideal, but I'd be happy with master-slave solution too. I know that ...
1
vote
2answers
137 views

Push sub-database to master-database?

Say, I have a big database globalclients which is very very big. Now, I divide this big database to 100 sub-databases, as: chinaclients japanclients koreaclients indiaclients brazilclients etc. ...
1
vote
2answers
127 views

Best resources to learn about Best Practice Scaling of IT Architecture

Looking for resources to learn the best practices and basics of scaling a backend infrastructure for an application or a web app. I am interested in Amazon Web Services and really enjoy architecting ...
0
votes
0answers
70 views

MySQL replication for scalability

Consider the following hypothetical scenario: A Web application receives 25% write traffic and 75% read traffic. Given that this application can tolerate reads that slightly stale, an easy way to ...
0
votes
1answer
274 views

Too Many/A Lot of Public SSH Keys

A new thing I have been tasked with trying/exploring is setting up a server that will essentially have 200 to 300 people ssh'ing into a single user to run a task. They might only need to do it once a ...
3
votes
2answers
2k views

What are the best strategies for scaling up my web application to be able to cope with a large volume of users?

I want to get some advice / best practices for how to go about developing a strategy for scaling up my a web application. I waffle on a bit here and show my limited knowledge but want to fill in my ...
1
vote
1answer
68 views

Is it a good idea to separate the Database and the website files in 2 shared hosting?

Do you think If I did separate the db and the files will make it performs better? and is this easy thing to do? What if I upgrade later on to 2 VPS as well, can I do the same thing without affecting ...
2
votes
2answers
108 views

web app reaching emailing limits - what is the next step up?

Recently i have been working on a popular web app that currently has around 70k members and a lot of traffic, i migrated the site to a new extra large EC2 instance and it seems to be a massive ...
1
vote
1answer
529 views

COM+/Desktop Heap errors in IIS affecting sites at random?

We have a Win2K3 server that is hosting 30+ sites. Each site is configured to have its own unique application pool -- so that we can manually recycle specific sites if needed and not kill sessions ...
0
votes
4answers
265 views

IMAP scalability

I am creating a system which allows members to email content to it and have it instantly and automatically parsed. I asked a question regarding using a custom SMTP server for intercepting mail. One ...
3
votes
2answers
313 views

Good Books About Scaling Up Databases/Servers/etc.? [closed]

I've applied for an internship at a startup company that expects its user base to grow by a large factor in a small amount of time, and so part of their project is to scale everything up so that ...
4
votes
1answer
823 views

IPSec software that can use multiple CPU cores

Can anyone recommend a good IPSec software that can use multiple CPU cores to achieve performance ~2Gbps on Linux dual-CPU quad-core E5620 Xeon setup (total 16HT cores)? I have tried OpenSwan and ...
4
votes
2answers
283 views

The CPU and memory is limited in the Cloud, So where is the scalability?

I don't understand cloud, the CPU is limited, Memory is also limited, where is the scalability? Isn't it just the same like VPS with more expensive cost for bandwidth? So what scaling advantage is ...
0
votes
2answers
103 views

Run untrusted program from apache

I have a problem to which I already have an implemented solution, but I'm not sure whether it's the best one. In the interests of not biasing any possible responses, I won't say how I've chosen to ...
1
vote
4answers
325 views

How should I host a site that could potentially get a short spike in traffic of 1000%+

This is a purely theoretical question, but what if I had a site that would normally only get a couple thousand hits a day, but for a few days each month that could shoot to several hundred thousand or ...
3
votes
1answer
730 views

Nginx vs Apache & mod_php for PHP and php+fpm vs fastcgi

It seems to be universally recommended to run Nginx as a reverse proxy in front of Apache but there seems to be a devision in opinion on whether Apache + mod_php or Nginx are better for serving ...
1
vote
2answers
207 views

How to theoretically prevent hardware failures in a collection of 10,000 servers?

From a book about warehouse-scale computers: Although it might be theoretically possible to prevent hardware failures in a collection of 10,000 servers, it would surely be extremely expensive. ...
0
votes
3answers
415 views

What Sort of Server Setup Am I Likely to Need? - School A/V streaming

My prior experience with servers has generally been limited to home file-sharing servers, low-traffic web-servers, and the like. This leaves me with the technical knowledge of how to set up a system, ...
7
votes
5answers
6k views

Optimize apache for 10K+ wordpress views a day on 2GB RAM E6500 CPU

I have a dedicated server with apache/php on ubuntu serving my Wordpress blog with about 10K+ pageviews a day. I have W3TC plug in installed with APC. But every now and then server stop responding or ...
3
votes
6answers
2k views

Scalable WordPress Host for High-Volume Site?

I need recommendations for a scalable web host for a high volume WordPress web site. For my purposes, high-volume might be 100K-500K visitors/hour. Might think towards a 1M/hour burst rate as a "high ...
6
votes
3answers
738 views

What are the typical methods used to scale up/out email storage servers?

What I've tried: I have two email storage architectures. Old and new. Old: courier-imapds on several (18+) 1TB-storage servers. If one of them show signs of running out of disk space, we migrate ...
1
vote
5answers
944 views

How many site visitors can my server handle? [duplicate]

Possible Duplicate: How do you do Load Testing and Capacity Planning for Web Sites I have a website, and I want to host it on my own computer, but I'm wondering if it's good enough. The ...
1
vote
1answer
401 views

How to scale out image hosting/serving?

I asked this question on stackoverflow and it was suggested that I try it here: I'm building a website where users can upload photos and I'd also convert uploaded photos into thumbnails. Planning ...
-1
votes
1answer
334 views

Servers / ram for social network- how many? [duplicate]

Possible Duplicate: Can you help me with my capacity planning? I am launching my social network soon and am looking into hosting. The question I am lost considering is: Do I need separate ...
3
votes
5answers
1k views

Apache on Windows in production environment? Why not?

"Everyone" know that Apache is for Linux/Unix and on Windows IIS is the way to go. However, I'm not a pro at Linux and it would be an enormous relief for me to use just the same setup in the ...
0
votes
2answers
1k views

best practice with memcache/php - multi memcache nodes

So I am working on a web app - that has to be built for scalability. It stores frequent MySQL querys into the cache. I have pretty much everything built and ready to go - but I am concerned on best ...
1
vote
3answers
205 views

What is the best way to seed 20.000+ torrents [closed]

What is the best (most stable) way to seed 20.000+ torrents on 1 server?
1
vote
2answers
601 views

Mongodb: What does webscale means?

Mongodb is known to be webscale. I tried looking on the internet about what webscale actually means but ends with no luck. So, what does webscale really means? And how is it any different than any ...
0
votes
2answers
353 views

Windows Server 2008 Web vs Standard

Please tell me what choice will be best between Windows Server 2008 R2 Web edition and Windows Server 2008 R2 Standard edition for NoSQLDatabase/BackendComputing scaling farm? I am pretty sure that ...
0
votes
2answers
598 views

Windows Server 2008 Web vs Standard [duplicate]

Possible Duplicate: Windows Server 2008 Web vs Standard Please tell me what choice will be best between Windows Server 2008 R2 Web edition and Windows Server 2008 R2 Standard edition for ...
1
vote
3answers
962 views

Scalable database architecture for heavy read and heavy write?

I am developing a web application which will require scaling to multiple servers. I'll need multiple web servers running my application code, and there will be heavy reads and heavy writes to the ...
1
vote
2answers
875 views

Does IIS 7/7.5 304 (Not Modified) involve disk IO?

I am wondering how does IIS (7/7.5) work in terms of 304 ((Not Modified) response code. For example when an image is cached on client side (i.e. a web browser) with the Last-Modified HTTP header set, ...
1
vote
3answers
171 views

How to make PHP more scalable on Unix Apache

I'm looking for free/low cost ways to make PHP running on our Unix Solaris servers (under Apache) more scalable and reliable. Do you recommend the free version of the Zend Server? Are there other ...
0
votes
2answers
419 views

https scalability for concurrent connections

I am a building a site right now that has a lot of chat messages and social communication moving between users in both real-time and accessed through archives (text material, not images). I want to ...
1
vote
2answers
325 views

How to configure reverse proxy/loadbalancer for custom routing

Suppose I have 3 webservers behind a reverse proxy/loadbalancer. Currently I use Apache 2 but don't mind switching. Those webservers are not equal. They have different sets of local data meaning that ...
0
votes
2answers
206 views

Cherokee Web Server and large files

Is Cherokee Web Server (several servers behind a load balancer) suitable for delivering large files (in the range of 20 - 500 MB) to a big number of clients (several thousands) ?
0
votes
2answers
133 views

What is the best high-performance solution for server side

We are building the server side of some gaming platform where a great load of mobile devices (thousands, if not tens of thousands) connect to a server, send some small information each second (let's ...
2
votes
5answers
142 views

Will having 3 servers + load balancer help in my situation?

I want to upgrade my server because of the high mysql loads causing slowness + whenever there were backup processes running on the DB, the DB would be inaccessible, so wanted some solution. My current ...
3
votes
2answers
3k views

How to set up multiple web and database servers?

My websites have been growing in terms of traffic and the load on the mysql has been increasing. I wanted a solution that would help deal with the increased load on mysql (all queries already ...
0
votes
1answer
153 views

Scaling horizontally

I know next to nothing about having more than one server work together. Right now I've been playing around with the cloud servers offering from rackspace. All the time when people talk about these ...
-2
votes
3answers
711 views

How much server capacity by thousand of registered users one must provide for a social networking site? [closed]

I am involved in the worldwide launch of a social networking site. For how many server capacity we must plan ? what are the average ratios per thousand registered users ? what are the assumptions ...
2
votes
2answers
167 views

Best way to prepare for one time digg-like effect

I have a web site which will be featured in a place which will send a large peak of one-time traffic in a couple of weeks. The server hosting the website also hosts the control panel my customers ...
1
vote
1answer
121 views

Are there any pitfalls with having multiple MySQL databases on 1 server node?

I want to prepare my database for sharding in the future. But right now I only need 1 node. What I'd like to do is to shard the database into virtual shards, say 12 shards, and put all of them onto ...
0
votes
3answers
4k views

How many sessions can you cram into a terminal server?

I have a customer who plans to deploy an app to one server and have 100 or so users remote desktop into that server. It's currently planned at 4GB RAM. Obviously there are problems to explain with ...
2
votes
1answer
379 views

How to scale out by elvolving from database partitions to sharding?

Say I have a MySQL table: CREATE TABLE tweets ( tweet_id INT NOT NULL AUTO_INCREMENT, author_id INT NOT NULL, text CHAR(140) NOT NULL, PRIMARY KEY (tweet_id) ) PARTITION BY HASH(tweet_id) PARTITIONS ...
1
vote
0answers
100 views

How can I scale my RoR applications?

I am developing a Ruby On Rails application and would like to deploy in a production environment. I have multiple identically configured Ubuntu web servers I can use but I don't know how to scale ...
1
vote
3answers
165 views

What kind of server is used by sites like Pandora or Last.fm to serve media files?

What kind of server is used by sites like Pandora or Last.fm to serve media files? I am assuming they would have something other than webserver for storing and serving media files... what are some of ...