The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

learn more… | top users | synonyms

0
votes
1answer
646 views

Scalable Web Hosting? [closed]

I have a website that receives heavy seasonal traffic. For much of the year, typical shared web hosting is adequate; however, the process of upgrading to VPS or dedicated hosting (when traffic gets ...
0
votes
1answer
7k views

Optimizing Apache for large concurrent requests and static files

OK, I know I'm asking a question that's been asked multiple times before (e.g. here - Serve millions of concurrent connections and static files?) but there appears to be no concrete solutions, so I ...
7
votes
4answers
4k views

PostgreSQL scaling up to 64 cores?

In this Computer World article, it specifies that PostgreSQL can scale up to a core limit of 64. Does this mean for one multi-core processor of 64 cores? Or multiple processors with fewer cores? The ...
0
votes
1answer
83 views

Easiest way to scale php and mysql website [closed]

I have read many info about optimizing websites (varnish, caching...) All these look quite complex. I wonder if cloud hosting can help me. Are there automatic scaling solutions ? Simplicity is the ...
3
votes
1answer
495 views

Using NFS for scalable PHP/MySQL web application

Here's the situation: I have a PHP/MySQL web application that accepts user uploads (pdf files). From these pdf files' pages a preview image is made on the fly and presented to the web app's users. ...
-1
votes
1answer
121 views

Choosing a database management system to maximize availability and scalability [closed]

If I was planning on choosing a database management system and know that the data needs to be available as close to 100% as possible and that it needs to scale as well as possible, is there a "best" ...
0
votes
1answer
914 views

Load testing nginx inside AWS

I'm trying to load test nginx running on AWS. I need to try to optimise it to handle 1Gbps of inbound traffic. Currently I've got it to peak at 85Mbit/s by running nginx on an m1.large with 4 other ...
4
votes
2answers
4k views

is TCP port exhaustion real? [closed]

How fast would one need to allocate ephemeral ports in order to get into the TCP port exhaustion condition? I was told there are ~4k (older Windows), ~16k (newer Windows) or ~28k (RH Linux) ports ...
2
votes
0answers
61 views

scaling website to perform equally fast worldwide [closed]

Our website is growing and we get more and more customers all around the world. We use Nginx, PHP and MySQL Our servers are in UK, so it is fast in Europe, but the further we got away from servers - ...
10
votes
0answers
582 views

Highly-available, Web-accessible and scalable deployment of statsd and graphite

I'd like to setup statsd/graphite so that I can log JS apps running on HTML devices (ie. not in a contained LAN environment, and possibly with a large volume of incoming data that I don't directly ...
1
vote
0answers
171 views

Scaling a video processing application on EC2?

I am approaching the need to scale a video-processign application that runs on EC2. So far the setup is one machine: Backbonejs frontend Rails 3.2 Postgresql Resque + S3 for storage The flow of ...
0
votes
1answer
858 views

Predictive vs Least Connection Load Balancing Techniques

I have a windows based desktop application that communicates via TCP to the application servers. (windows 2003). No sticky sessions between client calls. We have exactly 2 servers to load balance and ...
0
votes
4answers
96 views

What would be a quick fix in case of server downtime due to sudden high traffic?

Let's consider a scenario like below: A small web blog build based on LAMP stack and deployed on a shared hosting. Suddenly it becomes popular in one day and it gets million hits per day. Since the ...
1
vote
1answer
140 views

Extremely high loads despite Caching

Okay I've got a nice dedicated server running CentOs 6 with 16gb of ram, dual xenon processors, etc. However I've been experiencing high loads due to mysql. Randomly the load will go below 1.0, and ...
0
votes
3answers
390 views

Apache stops serving requests when connections increase [duplicate]

Possible Duplicate: Apache performance issue, after “1000 total children” Apache no longer responds to HTTP requests. Not MaxClients issue? The values for MaxClients, ServerLimit ...
2
votes
2answers
427 views

Dynamically changing one-node Cassandra cluster to two nodes

So I have an application that will be very dormant most of the time but will need high-bursting a few days out of the month. Since we are deploying on EC2 I would like to keep only one Cassandra ...
4
votes
3answers
216 views

Risks of Network Partitioning When a Split Brain Creates a Security Flaw

I'm looking to create a high-availability, scalable networking solution by using a distributed system of data. A node here, describes a network that has control over one copy of the data. These nodes ...
4
votes
1answer
779 views

nagios automation in big scale

I would like to know if you have an experience or any idea about how to set up nagios in big scale. Previously we used nagios and nagiosql for manual settings, it was pretty comfortable for few ...
7
votes
0answers
3k views

Multithreading with multi-queue NIC on SMP system [closed]

How are packets scheduled from network interface queues to CPUs, then onwards to threads for processing? What needs to be considered when it comes to how packets are hashed across queues, hardware ...
0
votes
2answers
128 views

EC2 cost-effective webapp scaling

I have a webapp running in a Media Temple VPS account, and I'm currently evaluating the gains to switch to Amazon EC2. It's running under Apache 2 web server. This webapp for now has almost no access ...
3
votes
1answer
719 views

Multiple DNS names and IP address to make load balancing more efficient in an Exchange CAS Array

The tl;dr problem The CAS server occasionally gets one or two NAT'ed IP addresses that have several hundred users behind it. That is bad for scalability. The tl;dr solution Have the NAT'ed ...
0
votes
1answer
245 views

Creating my small farm by virtual machines to learn scalability issues [closed]

I would like to create a fake server farm using virtual machines with Ubuntu server on them. I do not plan to use those as a real farm to host people websites etc. I recently read about scalability, ...
0
votes
4answers
32k views

How to achieve 500K requests per second on my webserver? [closed]

I recently gifted myself a new dedicated server and I am trying to squeeze maximum performance out of it, for fun and learning. I am trying to achieve maximum possible requests per second this server ...
2
votes
1answer
2k views

How do you choose the EC2 instance for your django app? [duplicate]

Possible Duplicate: Can you help me with my capacity planning? My team has created a nice django app and now it is going to be deployed on an EC2 instance. Now there are a few questions that I ...
0
votes
2answers
193 views

Scaling web application with SQL Server 2008 database

I have a database which has 90% of read only tables. 10% of the tables has writable data. We need to scale the ASP.NET application.We need to add more users who will not be writing to the database. We ...
3
votes
2answers
120 views

Infrastructure modelling using virtual machines - a viable approach?

I'm interested in modelling various server/network configurations for a web application. I'd like to know in advance which parts of the system are going to be bottlenecks, and whether the bottlenecks ...
2
votes
4answers
375 views

As a small business, how can I host a static 500GB database in the most cost-effective way possible?

My company is building a database from a large publicly available data set. When we complete it, we will have something like 500GB of data, but the data will never grow beyond that. It takes ...
6
votes
3answers
378 views

Memcached Lagging

Let me preface this by saying that this is a followup question to this topic. That was "solved" by switching from Solaris (SmartOS) to Ubuntu for the memcached server. Now we've multiplied load by ...
-2
votes
1answer
6k views

How do I calculate my bandwidth requirements?

We have a facility that needs to upload approximately 20 3MB photos per minute to Amazon S3. These are coming from 10 different machines on our local network. We need to do this continuously for 16 ...
1
vote
0answers
80 views

Whats the next scalability step after seperate mysql farms?

I'm running a saas service which is growing rapidly. The customers are ecommerce websites and we get hit on every page view on each of our customers sites (currently 10M's hits/day). The current ...
0
votes
1answer
439 views

Virtualbox development network using FreeBSD

I want to setup virtual network with 3 guest OS(FreeBSD) for testing scalable webapp. The first one should be only MySQL master server. Second and Third will be slaves with read only MySQL's and ...
-1
votes
1answer
280 views

Video Uploading on Amazon instances?

I am having real problems trying to wrap my head around my problem. I have decided on the middle and end solution to my problem but I can't seem to work out the the beginning of it. So as a bit of a ...
-3
votes
1answer
275 views

How do you host a big data web application? [closed]

Affordable alternative to Linode. I am using linode to serve my web application. The application serves, what I consider big data using ~ 30GB for our model US State and we serve a few hundred ...
1
vote
3answers
2k views

What would cause Memcached to Hang for 2+ seconds?

I'm going nuts trying to scale memcached. From their site: Memcached operations are almost all O(1). Connecting to it and issuing a get or stat command should never lag. If connecting lags, you ...
3
votes
2answers
554 views

Ubuntu scalable nginx mongodb mongdb memcached server configuration [duplicate]

I have been building a PHP web application using the following techniques in the past 2 months: PHP 5.3.4 MongoDB MySql I just got my dedicated server running Ubuntu 10.4 LTS x64 with the ...
7
votes
4answers
4k views

Ways to auto scale MySQL servers?

I run a site which has high traffic surges and because of that auto scaling solutions is very profitable for this case. Currently the web server is able to horizontally auto scale but the bottleneck ...
1
vote
2answers
2k views

Why doesn't IIS scale consistently?

I have a WCF service (written in .NET 4) running under IIS 7.5 on Windows 2008 R2 64-bit. I created a test tool that spawns 10-20 (or more) threads - each thread creates a random payload and hits the ...
4
votes
2answers
526 views

When you exhaust a 1 Gpbs connection to your main haproxy, how do you scale out?

If you exhaust your public network connection (say 1 Gbps) to your haproxy server that proxies requests to your backend servers, what options do you have to scale it out? Since all request traffic ...
2
votes
1answer
80 views

Availability & Scaling : Three Tier or Two Tier

I began working on a three -Physical- tier website (UI:MVC / Application:REST / DB), I've always considered that three tier is more scalable than two (taboo for high traffic websites), but lately i ...
4
votes
2answers
1k views

Scalable way to add users in Postfix without creating new unix/linux accounts?

What is the most scalable way to add new users in postfix? I don't necessarily want to create a new user in /etc/shadow just for email. I know I can use aliases but this does not solve the issue of ...
1
vote
1answer
120 views

unable to set up the ec2 ubuntu instance for auto scaling

I went through enough number of blog post which actually guides how to set up the auto scaling platform. I am using the Ubuntu ec2 32 bit AMI. From which I am trying to scale the instances, I am ...
0
votes
2answers
864 views

Unable to add the environmental variables and run “as-cmd”

I am running micro instance, now need to horizontally scale. I mean I am experimenting with a micro instance. I followed the instructions which is given in this video, but when I run as-cmd I get an ...
1
vote
3answers
281 views

Why is static page response time going up with increased concurrent requests

I don't understand the performance I'm seeing from apache. I would expect that more concurrent apache requests would perform better than fewer, up to a point, but beyond 3 concurrent requests, overall ...
0
votes
2answers
3k views

What is the reason for scaling Amazon EC2 by instance count rather than instance parameters?

We are looking into moving our website to Amazon EC2. The basic idea behind Amazon's cloud seems to be: "Need more RAM? You got it. Hard disk? Sure, here you go." Etc. But Amazon seems to be pushing ...
3
votes
2answers
2k views

Amazon EC2 AutoScaling WordPress

I am currently looking to autoscale my wordpress installation on Amazon EC2. Everything is working, I can bundle my EBS instance, put some policy and then amazon run automatically instances behind my ...
4
votes
1answer
1k views

Scalability 1-way. What does it mean?

I have read "Scalability: 1-way" in the specifications of a server. What does it means? The server is : HP ProLiant ML110 G6 TV X3430 2.40GHz 4-core 1P 1GB-U Non-hot Plug 250GB SATA LFF 300W PS
0
votes
3answers
238 views

Is it possible to rate limit based on host headers? i.e. not just on ip address

I have a web service endpoint that I am building where people will post an xml file to, and it will really get pounded with over 1K requests per second. Now they are sending in these xml files via ...
0
votes
2answers
241 views

How wordpress.com do scalability

Out of curiosity, I wanted to know, how Wordpress.com scale their architecture, specifically: how they handle sub-domains. I believe they have millions of subdomains.CMIIW. How do they scale their ...
-3
votes
1answer
168 views

How scalable is mySQL server? [closed]

I am debating on whether I should have three separate wordpress installs with three separate databases, or whether it would be okay to use multisite (which only uses one central db). I am concerned ...
0
votes
1answer
366 views

Memcached server: Is it a good practice to point two server urls to the same server?

I have a system where there are connections to a memcache server from several different files and servers. I would like to stay with one server but keep the option of increasing the number of ...