The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

learn more… | top users | synonyms (1)

-3
votes
1answer
163 views

How scalable is mySQL server? [closed]

I am debating on whether I should have three separate wordpress installs with three separate databases, or whether it would be okay to use multisite (which only uses one central db). I am concerned ...
3
votes
5answers
1k views

Apache on Windows in production environment? Why not?

"Everyone" know that Apache is for Linux/Unix and on Windows IIS is the way to go. However, I'm not a pro at Linux and it would be an enormous relief for me to use just the same setup in the ...
0
votes
1answer
553 views

nginx / node.js / postgres, scalability problems?

I have an app running with: one instance of nginx as the frontend (serving static file) a cluster of node.js application for the backend (using cluster and expressjs modules) one instance of ...
4
votes
8answers
2k views

Multiple servers vs 1 big server performance

My team of developers has suggested a server structure for an upcoming project we are developing. Our structure is "logical", meaning that the various logical components of the application (it is a ...
1
vote
2answers
315 views

Scalable Web Application Hardware Topology Best Practice

I'm working with an existing web application developed in Ruby with a MySQL back-end, but I think the generic hardware topology question will apply to a wide variety of server architectures. I'm ...
2
votes
3answers
302 views

Scaling Out SQL Server 2008 R2

I am looking into the possibilities of how to scale out the sql server 2008R2. simply scaling up wont be enough. "p2p replication" and "distributed partitioned views" look interesting, but both ...
1
vote
1answer
398 views

Which requests cause a w3wp process to grow considerably?

On a production environment, how can one discover which Asp.Net http requests, whether aspx or asmx or custom, are causing the most memory pressure within a w3wp.exe process? I don't mean memory leaks ...
0
votes
2answers
400 views

Why should one use amazon-elb?

Amazon-elb is a scalability solution that works like a proxy to several instances of my amazon ec2 servers. I wonder if it would'nt be more effective to have a roundrobin DNS to resolve my name into a ...
3
votes
3answers
966 views

Database scalability with write-heavy application

I have a write-heavy application. The application is best compared to surveys - the customer creates custom questionares and this is saved to the database. Most of the requests are from their users ...
1
vote
1answer
327 views

Multiple AWS EC2 Instance with Single Database

Currently we are using One EC2 instance to run our Services. And we are planning to add one more instance to put our application Server. Is it better to put the database in separate instance and query ...
8
votes
3answers
8k views

postgreSQL vs Cassandra vs MongoDB vs Voldemart?

Which database to decide upon? Any comparisions? Existing: postgresql Issues Not easily scalable horizontal. Needs sharding etc Clustering does not solve the data growth problem ...
1
vote
2answers
594 views

KVM on multiple servers

I'm using KVM for virtualization on a couple of Ubuntu servers but each physical server runs a bunch of VMs. Is there a way I can scale my VMs across physical servers? Does KVM support this? Is there ...
-3
votes
1answer
58 views

Doubts about best choices for a webserver [closed]

I have this config. Quad core i7 930 (x64) 6gb ram WEBSITE architecture php language for website mysql and it is possible the use of cassandra SSL protocol three hundred thousand visits (daily) ...
1
vote
2answers
212 views

How to theoretically prevent hardware failures in a collection of 10,000 servers?

From a book about warehouse-scale computers: Although it might be theoretically possible to prevent hardware failures in a collection of 10,000 servers, it would surely be extremely expensive. ...
3
votes
3answers
136 views

SQL Server 2008 Enterprise edition 64 bit scalability

I am currently running SQL Server 2008 64-bit Enterprise Edittion on a VM ware environment with 4 CPUs and 32GB RAM. I want to scale it up. Is there a limit on how many CPUs and RAM I can go up to? I ...
1
vote
3answers
208 views

What is the best way to seed 20.000+ torrents [closed]

What is the best (most stable) way to seed 20.000+ torrents on 1 server?
3
votes
2answers
813 views

Is Amazon EC2 for me?

I'm working on an image hosting website tailored to a particular niche. The website is made with Django. I'm currently planning to run it on Linode. So far so good. The problem is: I will need to ...
1
vote
0answers
120 views

Browsers can't handle the real time updates my app is sending, slows everything waay down

Posted this a couple days ago, have made some more progress. Thanks for the help, this is delaying our launch and I'm under a lot of pressure. UPDATE: I don't think it's the server side, I think ...
0
votes
1answer
337 views

Scalability problem (Tornado). Can't figure it out, holding up launch

Thanks guys, any ideas/insight are appreciated b/c this is driving me crazy. Problem: Only about 3 or 4 users can use the server simultaneously before app grinds to a halt. Currently we see massive ...
8
votes
6answers
3k views

What is a typical method to scale out a software load balancer?

I often see web app architectures with a SLB / reverse-proxy in front of a bunch of app servers. What happens when the number of connections to the SLB requires too many resources for a single SLB to ...
0
votes
1answer
80 views

Utilizing two servers (LAMP)

I currently have my web app on a single cloud server. Been doing this for a few months now and I have EVERYTHING on this instance (app, cron scripts, mysql, svn, dev environment, etc). The site is ...
1
vote
1answer
68 views

Is it a good idea to separate the Database and the website files in 2 shared hosting?

Do you think If I did separate the db and the files will make it performs better? and is this easy thing to do? What if I upgrade later on to 2 VPS as well, can I do the same thing without affecting ...
0
votes
1answer
209 views

Approximately, how many writes can a EC2 large dedicated Mongo server handle?

Let's assume that it was only writes. Each "document" inserted is less than 140 characters. How many writes can this database handle?
2
votes
1answer
1k views

Setting up a Rails 2.3.x app on EC2 for easy scalability

I'm running a simple rails stack on a single dedicated machine. We're reaching our full capacity and have absolutely no setup for scaling, just one app on one machine. I did some research and came up ...
22
votes
6answers
3k views

Scaling databases with cheap SSD hard drives

I hope that many of you are working with high traffic database-driven websites, and chances are that your main scalability issues are in the database. I noticed a couple of things lately: Most large ...
1
vote
2answers
240 views

Open source cloud computing with scalable virtual machines

I'm searching for open source software to create my own cloud computing environment, like Ubuntu UEC or Eucalyptus. What I need is that each virtual machine can use resources from multiple nodes ...
0
votes
2answers
424 views

https scalability for concurrent connections

I am a building a site right now that has a lot of chat messages and social communication moving between users in both real-time and accessed through archives (text material, not images). I want to ...
2
votes
2answers
903 views

How to load balance > C100K?

Suppose that a hypotetical webapp keeps one connections per user (eg: chat app using comet, long pooling, etc...). How can i load balance such thing to scale beyond the connection limit of a single ...
0
votes
2answers
207 views

Cherokee Web Server and large files

Is Cherokee Web Server (several servers behind a load balancer) suitable for delivering large files (in the range of 20 - 500 MB) to a big number of clients (several thousands) ?
3
votes
1answer
418 views

Ideal server specs/software for mail, file, and database storage

I'm trying to figure out what the ideal set up would for a few servers. 1) Website 1) Mail server 1) Database server 1) file server In this given scenario, say there is a site that will offer each ...
3
votes
1answer
631 views

M-M or M-S replication of EBS volume across multiple EC2 instances

I would like to share EBS backed file system of size up to 20GB in 200K files across multiple EC2 instances. Master-master would be ideal, but I'd be happy with master-slave solution too. I know that ...
1
vote
2answers
144 views

Push sub-database to master-database?

Say, I have a big database globalclients which is very very big. Now, I divide this big database to 100 sub-databases, as: chinaclients japanclients koreaclients indiaclients brazilclients etc. ...
0
votes
1answer
178 views

Can sql server scalable shared databases work with a vmware (ESX server) shared disc?

I've recently found out about sql server scalable shared database technology and I'd like to test it out in a vmware environment. Our production environment is SAN based but we don't have a test ...
5
votes
1answer
933 views

IPSec software that can use multiple CPU cores

Can anyone recommend a good IPSec software that can use multiple CPU cores to achieve performance ~2Gbps on Linux dual-CPU quad-core E5620 Xeon setup (total 16HT cores)? I have tried OpenSwan and ...
1
vote
2answers
134 views

Best resources to learn about Best Practice Scaling of IT Architecture

Looking for resources to learn the best practices and basics of scaling a backend infrastructure for an application or a web app. I am interested in Amazon Web Services and really enjoy architecting ...
0
votes
0answers
71 views

MySQL replication for scalability

Consider the following hypothetical scenario: A Web application receives 25% write traffic and 75% read traffic. Given that this application can tolerate reads that slightly stale, an easy way to ...
0
votes
1answer
287 views

Too Many/A Lot of Public SSH Keys

A new thing I have been tasked with trying/exploring is setting up a server that will essentially have 200 to 300 people ssh'ing into a single user to run a task. They might only need to do it once a ...
3
votes
2answers
3k views

What are the best strategies for scaling up my web application to be able to cope with a large volume of users?

I want to get some advice / best practices for how to go about developing a strategy for scaling up my a web application. I waffle on a bit here and show my limited knowledge but want to fill in my ...
17
votes
10answers
19k views

Running 100 virtual machines on a single VMWare host server

I've been using VMWare for many years, running dozens of production servers with very few issues. But I never tried hosting more than 20 VMs on a single physical host. Here is the idea: A stripped ...
2
votes
2answers
109 views

web app reaching emailing limits - what is the next step up?

Recently i have been working on a popular web app that currently has around 70k members and a lot of traffic, i migrated the site to a new extra large EC2 instance and it seems to be a massive ...
1
vote
1answer
545 views

COM+/Desktop Heap errors in IIS affecting sites at random?

We have a Win2K3 server that is hosting 30+ sites. Each site is configured to have its own unique application pool -- so that we can manually recycle specific sites if needed and not kill sessions ...
3
votes
2answers
335 views

Good Books About Scaling Up Databases/Servers/etc.? [closed]

I've applied for an internship at a startup company that expects its user base to grow by a large factor in a small amount of time, and so part of their project is to scale everything up so that ...
4
votes
2answers
287 views

The CPU and memory is limited in the Cloud, So where is the scalability?

I don't understand cloud, the CPU is limited, Memory is also limited, where is the scalability? Isn't it just the same like VPS with more expensive cost for bandwidth? So what scaling advantage is ...
1
vote
2answers
365 views

What techniques do you use to design and scale a web app horizontally (in EC2)?

Specifically I'm looking for techniques for scaling a web application which has no central database server, in the cloud, but general advice is great. I have come across GlusterFS, which looks great, ...
0
votes
2answers
106 views

Run untrusted program from apache

I have a problem to which I already have an implemented solution, but I'm not sure whether it's the best one. In the interests of not biasing any possible responses, I won't say how I've chosen to ...
1
vote
4answers
327 views

How should I host a site that could potentially get a short spike in traffic of 1000%+

This is a purely theoretical question, but what if I had a site that would normally only get a couple thousand hits a day, but for a few days each month that could shoot to several hundred thousand or ...
3
votes
1answer
746 views

Nginx vs Apache & mod_php for PHP and php+fpm vs fastcgi

It seems to be universally recommended to run Nginx as a reverse proxy in front of Apache but there seems to be a devision in opinion on whether Apache + mod_php or Nginx are better for serving ...
30
votes
9answers
2k views

What's the piece of hardware listening on Facebook's or Wikipedia's IP address?

I am trying to understand how massive sites like Facebook or Wikipedia work, for my intellectual curiosity. I read about various techniques for building scalable sites, but I am still puzzled about ...
6
votes
3answers
792 views

What are the typical methods used to scale up/out email storage servers?

What I've tried: I have two email storage architectures. Old and new. Old: courier-imapds on several (18+) 1TB-storage servers. If one of them show signs of running out of disk space, we migrate ...
1
vote
1answer
419 views

How to scale out image hosting/serving?

I asked this question on stackoverflow and it was suggested that I try it here: I'm building a website where users can upload photos and I'd also convert uploaded photos into thumbnails. Planning ...