The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.
-3
votes
0answers
18 views
When to Scale Heroku Application based on New Relic (Request Queueing?)
I've been watching New Relic on my application as if I understand the numbers. I have request queuing spikes up to 20k ms per request, others around 9k. I'm not sure what to scale based in this ...
0
votes
0answers
26 views
Dedicated server vs VPS: advice on scaling site
We could use advice on a scaling/ops issue.
We have a simple mobile app that runs on Rails 3.2.12 and uses MongoMapper instead of ActiveRecord. There is one database call that sporadically performs ...
-2
votes
1answer
60 views
How to launch a site with high future growth potential. [closed]
I hope I have what is a straightforward question. As I am sure the steps of setting this up are complicated I would like to know a few things. We have a team that has been working on a great ...
-2
votes
0answers
25 views
Finance system: scalability, consistency, high-availability [closed]
I am designing a system to deal with (backend) financial data where I have to make design decisions. Data writes are very important since every transaction has to be recorded. I dont expect a huge ...
7
votes
9answers
5k views
How to solve linux subdirectories number limit?
I have a website which will store user profile images. Each image is stored in a directory (Linux) specific to the user. Currently I have a customer base of 30+, which means I will have 30+ folders. ...
2
votes
0answers
37 views
Scaling large numbers of small customer J2EE webapps
We're allowing customers to create websites on our SaaS app. We currently use Jetty as the app server, but we could use anything J2EE.
I'd like to be able to scale customer webapps across our ...
0
votes
2answers
82 views
Autoscaling set-up on EC2
I'm new to web development and design (I moved over from construction where answers are much larger), and I'm trying to build a scalable AWS architecture for a Wordpress site that lives in the free ...
2
votes
2answers
135 views
Is this a sensible way to scale Nginx for static content serving?
I need to set up some VPSs for serving static content (many small files). I plan on using Nginx for this, and would like to set it up so that we are able to scale out relatively easily. The ...
0
votes
1answer
33 views
PHP-FPM as a dedicated application server?
Just wondering in terms of scalability .. do you reckon PHP-FPM should run on a standalone server or works as well if you run it with NginX on the same server?
0
votes
0answers
19 views
Best cloud solution to good potential idea? [duplicate]
At the moment my company has a system that delivers educational content to learners. We only have one school with 2000 learners at the moment but a potential deal of 400 000 learners across the ...
0
votes
0answers
140 views
Nginx Unix vs TCP sockets
I had a scalability problem on a Django website, basically with 4000 online users the website was not accessible, I run some load test: ab -n 1000 -c 100 http://www.domain.com/
The performance was ...
0
votes
0answers
55 views
Ruby concurrency + Scaling with Rails
We have a social networking site runs with,
Stunnel->Haproxy->Nginx->Unicorn
We have 20 unicorn processes running in a 24 core machine.
When i run the tests with 200 requests and 100 concurrent ...
0
votes
0answers
11 views
Purchasing new dedicated servers questions to ask [duplicate]
I have a meeting scheduled tomorrow with a few different server hosting companies. We are looking to purchase more dedicated servers for scalability reasons. What are some questions I could ask, ...
3
votes
2answers
94 views
Load balancer explanation
I'm trying to figure out how exactly the load balancing of sites like facebook/youtube works, but I have few questions. So after alot reading I figured out that loadbalancing looks like this: When ...
0
votes
1answer
98 views
Scalable Web Hosting? [closed]
I have a website that receives heavy seasonal traffic. For much of the year, typical shared web hosting is adequate; however, the process of upgrading to VPS or dedicated hosting (when traffic gets ...
0
votes
3answers
330 views
What Sort of Server Setup Am I Likely to Need? - School A/V streaming
My prior experience with servers has generally been limited to home file-sharing servers, low-traffic web-servers, and the like. This leaves me with the technical knowledge of how to set up a system, ...
-1
votes
1answer
567 views
Optimizing Apache for large concurrent requests and static files
OK, I know I'm asking a question that's been asked multiple times before
(e.g. here -
Serve millions of concurrent connections and static files?) but there appears to be no concrete solutions, so I
...
0
votes
1answer
90 views
Load testing nginx inside AWS
I'm trying to load test nginx running on AWS. I need to try to optimise it to handle 1Gbps of inbound traffic.
Currently I've got it to peak at 85Mbit/s by running nginx on an m1.large with 4 other ...
6
votes
4answers
348 views
PostgreSQL scaling up to 64 cores?
In this Computer World article, it specifies that PostgreSQL can scale up to a core limit of 64. Does this mean for one multi-core processor of 64 cores? Or multiple processors with fewer cores?
The ...
0
votes
1answer
48 views
Easiest way to scale php and mysql website [closed]
I have read many info about optimizing websites (varnish, caching...)
All these look quite complex.
I wonder if cloud hosting can help me. Are there automatic scaling solutions ?
Simplicity is the ...
3
votes
1answer
143 views
Using NFS for scalable PHP/MySQL web application
Here's the situation:
I have a PHP/MySQL web application that accepts user uploads (pdf files). From these pdf files' pages a preview image is made on the fly and presented to the web app's users. ...
-1
votes
1answer
66 views
Choosing a database management system to maximize availability and scalability [closed]
If I was planning on choosing a database management system and know that the data needs to be available as close to 100% as possible and that it needs to scale as well as possible, is there a "best" ...
3
votes
2answers
452 views
is TCP port exhaustion real? [closed]
How fast would one need to allocate ephemeral ports in order to get into the TCP port exhaustion condition?
I was told there are ~4k (older Windows), ~16k (newer Windows) or ~28k (RH Linux) ports ...
1
vote
1answer
104 views
unable to set up the ec2 ubuntu instance for auto scaling
I went through enough number of blog post which actually guides how to set up the auto scaling platform. I am using the Ubuntu ec2 32 bit AMI. From which I am trying to scale the instances, I am ...
2
votes
0answers
24 views
scaling website to perform equally fast worldwide [closed]
Our website is growing and we get more and more customers all around the world.
We use Nginx, PHP and MySQL
Our servers are in UK, so it is fast in Europe, but the further we got away from servers - ...
2
votes
0answers
129 views
Highly-available, Web-accessible and scalable deployment of statsd and graphite
I'd like to setup statsd/graphite so that I can log JS apps running on HTML devices (ie. not in a contained LAN environment, and possibly with a large volume of incoming data that I don't directly ...
0
votes
0answers
57 views
Scaling up on cloud, what are the necessary change in configuration, e.g. PHP, Varnish [closed]
Upgrading instance is just a few clicks for a cloud server, like EC2 and Azure, but what are the configuration change necessary to harness the extra power?
While I think this can as well be a general ...
1
vote
0answers
68 views
Whats the next scalability step after seperate mysql farms?
I'm running a saas service which is growing rapidly. The customers are ecommerce websites and we get hit on every page view on each of our customers sites (currently 10M's hits/day).
The current ...
1
vote
0answers
83 views
Scaling a video processing application on EC2?
I am approaching the need to scale a video-processign application that runs on EC2.
So far the setup is one machine:
Backbonejs frontend
Rails 3.2
Postgresql
Resque
+
S3 for storage
The flow of ...
0
votes
1answer
96 views
Predictive vs Least Connection Load Balancing Techniques
I have a windows based desktop application that communicates via TCP to the application servers. (windows 2003). No sticky sessions between client calls. We have exactly 2 servers to load balance and ...
0
votes
4answers
60 views
What would be a quick fix in case of server downtime due to sudden high traffic?
Let's consider a scenario like below:
A small web blog build based on LAMP stack and deployed on a shared hosting.
Suddenly it becomes popular in one day and it gets million hits per day.
Since the ...
1
vote
1answer
99 views
Extremely high loads despite Caching
Okay I've got a nice dedicated server running CentOs 6 with 16gb of ram, dual xenon processors, etc. However I've been experiencing high loads due to mysql. Randomly the load will go below 1.0, and ...
0
votes
2answers
1k views
best practice with memcache/php - multi memcache nodes
So I am working on a web app - that has to be built for scalability. It stores frequent MySQL querys into the cache. I have pretty much everything built and ready to go - but I am concerned on best ...
2
votes
2answers
173 views
Dynamically changing one-node Cassandra cluster to two nodes
So I have an application that will be very dormant most of the time but will need high-bursting a few days out of the month. Since we are deploying on EC2 I would like to keep only one Cassandra ...
0
votes
3answers
138 views
Apache stops serving requests when connections increase [duplicate]
Possible Duplicate:
Apache performance issue, after “1000 total children” Apache no longer responds to HTTP requests. Not MaxClients issue?
The values for MaxClients, ...
1
vote
3answers
630 views
Sharing / replicating EBS across AWS nodes
I would like to use single EBS storage across multiple EC2 nodes (web/app servers). I've read some articles on snapshot sharing, but that doesn't suit well for what we need.
We use filesystem for ...
4
votes
3answers
151 views
Risks of Network Partitioning When a Split Brain Creates a Security Flaw
I'm looking to create a high-availability, scalable networking solution by using a distributed system of data. A node here, describes a network that has control over one copy of the data. These nodes ...
4
votes
1answer
261 views
nagios automation in big scale
I would like to know if you have an experience or any idea about how to set up nagios in big scale.
Previously we used nagios and nagiosql for manual settings, it was pretty comfortable for few ...
7
votes
5answers
4k views
Optimize apache for 10K+ wordpress views a day on 2GB RAM E6500 CPU
I have a dedicated server with apache/php on ubuntu serving my Wordpress blog with about 10K+ pageviews a day. I have W3TC plug in installed with APC.
But every now and then server stop responding or ...
1
vote
5answers
824 views
How many site visitors can my server handle? [duplicate]
Possible Duplicate:
How do you do Load Testing and Capacity Planning for Web Sites
I have a website, and I want to host it on my own computer, but I'm wondering if it's good enough.
The ...
5
votes
0answers
699 views
Multithreading with multi-queue NIC on SMP system [closed]
How are packets scheduled from network interface queues to CPUs, then onwards to threads for processing? What needs to be considered when it comes to how packets are hashed across queues, hardware ...
0
votes
2answers
111 views
EC2 cost-effective webapp scaling
I have a webapp running in a Media Temple VPS account, and I'm currently evaluating the gains to switch to Amazon EC2. It's running under Apache 2 web server.
This webapp for now has almost no access ...
3
votes
0answers
293 views
Multiple DNS names and IP address to make load balancing more efficient in an Exchange CAS Array
The tl;dr problem
The CAS server occasionally gets one or two NAT'ed IP addresses that have several hundred users behind it. That is bad for scalability.
The tl;dr solution
Have the NAT'ed ...
0
votes
1answer
142 views
Creating my small farm by virtual machines to learn scalability issues [closed]
I would like to create a fake server farm using virtual machines with Ubuntu server on them. I do not plan to use those as a real farm to host people websites etc.
I recently read about scalability, ...
-2
votes
3answers
623 views
How much server capacity by thousand of registered users one must provide for a social networking site? [closed]
I am involved in the worldwide launch of a social networking site.
For how many server capacity we must plan ? what are the average ratios per thousand registered users ? what are the assumptions ...
-1
votes
1answer
292 views
Servers / ram for social network- how many? [duplicate]
Possible Duplicate:
Can you help me with my capacity planning?
I am launching my social network soon and am looking into hosting. The question I am lost considering is: Do I need separate ...
1
vote
1answer
813 views
How do you choose the EC2 instance for your django app? [duplicate]
Possible Duplicate:
Can you help me with my capacity planning?
My team has created a nice django app and now it is going to be deployed on an EC2 instance. Now there are a few questions ...
-7
votes
4answers
4k views
How to achieve 500K requests per second on my webserver? [closed]
I recently gifted myself a new dedicated server and I am trying to squeeze maximum performance out of it, for fun and learning.
I am trying to achieve maximum possible requests per second this server ...
2
votes
2answers
1k views
Poor performance on Amazon RDS instance
I'm doing some load/stress testing on a PHP web application that is backed by a Small RDS database instance. When I hit the website with ~50 concurrent web requests, the RDS database just stops ...
0
votes
2answers
136 views
Scaling web application with SQL Server 2008 database
I have a database which has 90% of read only tables. 10% of the tables has writable data. We need to scale the ASP.NET application.We need to add more users who will not be writing to the database. We ...
