The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

learn more… | top users | synonyms

-2
votes
1answer
6k views

How do I calculate my bandwidth requirements?

We have a facility that needs to upload approximately 20 3MB photos per minute to Amazon S3. These are coming from 10 different machines on our local network. We need to do this continuously for 16 ...
0
votes
1answer
437 views

Virtualbox development network using FreeBSD

I want to setup virtual network with 3 guest OS(FreeBSD) for testing scalable webapp. The first one should be only MySQL master server. Second and Third will be slaves with read only MySQL's and ...
-1
votes
1answer
280 views

Video Uploading on Amazon instances?

I am having real problems trying to wrap my head around my problem. I have decided on the middle and end solution to my problem but I can't seem to work out the the beginning of it. So as a bit of a ...
-3
votes
1answer
274 views

How do you host a big data web application? [closed]

Affordable alternative to Linode. I am using linode to serve my web application. The application serves, what I consider big data using ~ 30GB for our model US State and we serve a few hundred ...
0
votes
1answer
739 views

What is the best Amazon EC2 server configuration for a highly-scalable distributed php application? [closed]

I'm creating a php application that needs to be able to scale up to "1 million users". I know this question is subjective to the application, but I'm curious what type of generic setups are a best ...
1
vote
2answers
2k views

Why doesn't IIS scale consistently?

I have a WCF service (written in .NET 4) running under IIS 7.5 on Windows 2008 R2 64-bit. I created a test tool that spawns 10-20 (or more) threads - each thread creates a random payload and hits the ...
4
votes
2answers
526 views

When you exhaust a 1 Gpbs connection to your main haproxy, how do you scale out?

If you exhaust your public network connection (say 1 Gbps) to your haproxy server that proxies requests to your backend servers, what options do you have to scale it out? Since all request traffic ...
2
votes
1answer
80 views

Availability & Scaling : Three Tier or Two Tier

I began working on a three -Physical- tier website (UI:MVC / Application:REST / DB), I've always considered that three tier is more scalable than two (taboo for high traffic websites), but lately i ...
0
votes
4answers
321 views

IMAP scalability

I am creating a system which allows members to email content to it and have it instantly and automatically parsed. I asked a question regarding using a custom SMTP server for intercepting mail. One ...
4
votes
2answers
1k views

Scalable way to add users in Postfix without creating new unix/linux accounts?

What is the most scalable way to add new users in postfix? I don't necessarily want to create a new user in /etc/shadow just for email. I know I can use aliases but this does not solve the issue of ...
0
votes
2answers
864 views

Unable to add the environmental variables and run “as-cmd”

I am running micro instance, now need to horizontally scale. I mean I am experimenting with a micro instance. I followed the instructions which is given in this video, but when I run as-cmd I get an ...
2
votes
1answer
413 views

Suggested or Best practices for network architecture for ASP.net web application

Currently I have one server that runs an ASP.net web application (on IIS) and this is also running a SQL Server database. I am getting more and more traffic and soon I will need to increase the ...
1
vote
3answers
281 views

Why is static page response time going up with increased concurrent requests

I don't understand the performance I'm seeing from apache. I would expect that more concurrent apache requests would perform better than fewer, up to a point, but beyond 3 concurrent requests, overall ...
0
votes
2answers
3k views

What is the reason for scaling Amazon EC2 by instance count rather than instance parameters?

We are looking into moving our website to Amazon EC2. The basic idea behind Amazon's cloud seems to be: "Need more RAM? You got it. Hard disk? Sure, here you go." Etc. But Amazon seems to be pushing ...
3
votes
2answers
2k views

Amazon EC2 AutoScaling WordPress

I am currently looking to autoscale my wordpress installation on Amazon EC2. Everything is working, I can bundle my EBS instance, put some policy and then amazon run automatically instances behind my ...
4
votes
1answer
1k views

Scalability 1-way. What does it mean?

I have read "Scalability: 1-way" in the specifications of a server. What does it means? The server is : HP ProLiant ML110 G6 TV X3430 2.40GHz 4-core 1P 1GB-U Non-hot Plug 250GB SATA LFF 300W PS
0
votes
3answers
238 views

Is it possible to rate limit based on host headers? i.e. not just on ip address

I have a web service endpoint that I am building where people will post an xml file to, and it will really get pounded with over 1K requests per second. Now they are sending in these xml files via ...
0
votes
2answers
241 views

How wordpress.com do scalability

Out of curiosity, I wanted to know, how Wordpress.com scale their architecture, specifically: how they handle sub-domains. I believe they have millions of subdomains.CMIIW. How do they scale their ...
0
votes
1answer
365 views

Memcached server: Is it a good practice to point two server urls to the same server?

I have a system where there are connections to a memcache server from several different files and servers. I would like to stay with one server but keep the option of increasing the number of ...
-3
votes
1answer
167 views

How scalable is mySQL server? [closed]

I am debating on whether I should have three separate wordpress installs with three separate databases, or whether it would be okay to use multisite (which only uses one central db). I am concerned ...
0
votes
1answer
708 views

nginx / node.js / postgres, scalability problems?

I have an app running with: one instance of nginx as the frontend (serving static file) a cluster of node.js application for the backend (using cluster and expressjs modules) one instance of ...
4
votes
8answers
3k views

Multiple servers vs 1 big server performance

My team of developers has suggested a server structure for an upcoming project we are developing. Our structure is "logical", meaning that the various logical components of the application (it is a ...
1
vote
2answers
502 views

Scalable Web Application Hardware Topology Best Practice

I'm working with an existing web application developed in Ruby with a MySQL back-end, but I think the generic hardware topology question will apply to a wide variety of server architectures. I'm ...
2
votes
3answers
339 views

Scaling Out SQL Server 2008 R2

I am looking into the possibilities of how to scale out the sql server 2008R2. simply scaling up wont be enough. "p2p replication" and "distributed partitioned views" look interesting, but both ...
1
vote
1answer
475 views

Which requests cause a w3wp process to grow considerably?

On a production environment, how can one discover which Asp.Net http requests, whether aspx or asmx or custom, are causing the most memory pressure within a w3wp.exe process? I don't mean memory leaks ...
0
votes
2answers
451 views

Why should one use amazon-elb?

Amazon-elb is a scalability solution that works like a proxy to several instances of my amazon ec2 servers. I wonder if it would'nt be more effective to have a roundrobin DNS to resolve my name into a ...
3
votes
3answers
3k views

Database scalability with write-heavy application

I have a write-heavy application. The application is best compared to surveys - the customer creates custom questionares and this is saved to the database. Most of the requests are from their users ...
1
vote
1answer
492 views

Multiple AWS EC2 Instance with Single Database

Currently we are using One EC2 instance to run our Services. And we are planning to add one more instance to put our application Server. Is it better to put the database in separate instance and query ...
1
vote
2answers
1k views

KVM on multiple servers

I'm using KVM for virtualization on a couple of Ubuntu servers but each physical server runs a bunch of VMs. Is there a way I can scale my VMs across physical servers? Does KVM support this? Is there ...
-3
votes
1answer
65 views

Doubts about best choices for a webserver [closed]

I have this config. Quad core i7 930 (x64) 6gb ram WEBSITE architecture php language for website mysql and it is possible the use of cassandra SSL protocol three hundred thousand visits (daily) ...
1
vote
2answers
264 views

How to theoretically prevent hardware failures in a collection of 10,000 servers?

From a book about warehouse-scale computers: Although it might be theoretically possible to prevent hardware failures in a collection of 10,000 servers, it would surely be extremely expensive. ...
3
votes
3answers
153 views

SQL Server 2008 Enterprise edition 64 bit scalability

I am currently running SQL Server 2008 64-bit Enterprise Edittion on a VM ware environment with 4 CPUs and 32GB RAM. I want to scale it up. Is there a limit on how many CPUs and RAM I can go up to? I ...
1
vote
3answers
223 views

What is the best way to seed 20.000+ torrents [closed]

What is the best (most stable) way to seed 20.000+ torrents on 1 server?
3
votes
2answers
914 views

Is Amazon EC2 for me?

I'm working on an image hosting website tailored to a particular niche. The website is made with Django. I'm currently planning to run it on Linode. So far so good. The problem is: I will need to ...
0
votes
1answer
462 views

Scalability problem (Tornado). Can't figure it out, holding up launch

Thanks guys, any ideas/insight are appreciated b/c this is driving me crazy. Problem: Only about 3 or 4 users can use the server simultaneously before app grinds to a halt. Currently we see massive ...
12
votes
6answers
5k views

What is a typical method to scale out a software load balancer?

I often see web app architectures with a SLB / reverse-proxy in front of a bunch of app servers. What happens when the number of connections to the SLB requires too many resources for a single SLB to ...
0
votes
1answer
83 views

Utilizing two servers (LAMP)

I currently have my web app on a single cloud server. Been doing this for a few months now and I have EVERYTHING on this instance (app, cron scripts, mysql, svn, dev environment, etc). The site is ...
1
vote
1answer
69 views

Is it a good idea to separate the Database and the website files in 2 shared hosting?

Do you think If I did separate the db and the files will make it performs better? and is this easy thing to do? What if I upgrade later on to 2 VPS as well, can I do the same thing without affecting ...
0
votes
1answer
250 views

Approximately, how many writes can a EC2 large dedicated Mongo server handle?

Let's assume that it was only writes. Each "document" inserted is less than 140 characters. How many writes can this database handle?
2
votes
1answer
1k views

Setting up a Rails 2.3.x app on EC2 for easy scalability

I'm running a simple rails stack on a single dedicated machine. We're reaching our full capacity and have absolutely no setup for scaling, just one app on one machine. I did some research and came up ...
24
votes
6answers
4k views

Scaling databases with cheap SSD hard drives

I hope that many of you are working with high traffic database-driven websites, and chances are that your main scalability issues are in the database. I noticed a couple of things lately: Most large ...
1
vote
2answers
263 views

Open source cloud computing with scalable virtual machines

I'm searching for open source software to create my own cloud computing environment, like Ubuntu UEC or Eucalyptus. What I need is that each virtual machine can use resources from multiple nodes (CPU,...
0
votes
2answers
497 views

https scalability for concurrent connections

I am a building a site right now that has a lot of chat messages and social communication moving between users in both real-time and accessed through archives (text material, not images). I want to ...
2
votes
2answers
1k views

How to load balance > C100K?

Suppose that a hypotetical webapp keeps one connections per user (eg: chat app using comet, long pooling, etc...). How can i load balance such thing to scale beyond the connection limit of a single ...
0
votes
2answers
216 views

Cherokee Web Server and large files

Is Cherokee Web Server (several servers behind a load balancer) suitable for delivering large files (in the range of 20 - 500 MB) to a big number of clients (several thousands) ?
3
votes
1answer
495 views

Ideal server specs/software for mail, file, and database storage

I'm trying to figure out what the ideal set up would for a few servers. 1) Website 1) Mail server 1) Database server 1) file server In this given scenario, say there is a site that will offer each ...
3
votes
1answer
1k views

M-M or M-S replication of EBS volume across multiple EC2 instances

I would like to share EBS backed file system of size up to 20GB in 200K files across multiple EC2 instances. Master-master would be ideal, but I'd be happy with master-slave solution too. I know that ...
1
vote
2answers
165 views

Push sub-database to master-database?

Say, I have a big database globalclients which is very very big. Now, I divide this big database to 100 sub-databases, as: chinaclients japanclients koreaclients indiaclients brazilclients etc. ...
0
votes
1answer
185 views

Can sql server scalable shared databases work with a vmware (ESX server) shared disc?

I've recently found out about sql server scalable shared database technology and I'd like to test it out in a vmware environment. Our production environment is SAN based but we don't have a test ...
6
votes
1answer
2k views

IPSec software that can use multiple CPU cores

Can anyone recommend a good IPSec software that can use multiple CPU cores to achieve performance ~2Gbps on Linux dual-CPU quad-core E5620 Xeon setup (total 16HT cores)? I have tried OpenSwan and ...