Scalability is the capability to increase resources to yield a linear (ideally) increase in service capacity. The key characteristic of a scalable application is that additional load only requires additional resources rather than extensive modification of the application itself. Although raw ...
-1
votes
1answer
53 views
Estimating Concurrent Users for Web Applications - the 10%/10% rule of thumb [closed]
I know that there is no substitute for knowing your application intimately and testing but I've always used the "10% rule" as a rule of thumb when it comes to estimating concurrent users.
e.g.
Of ...
3
votes
2answers
76 views
Infrastructure modelling using virtual machines - a viable approach?
I'm interested in modelling various server/network configurations for a web application. I'd like to know in advance which parts of the system are going to be bottlenecks, and whether the bottlenecks ...
1
vote
4answers
114 views
As a small business, how can I host a static 500GB database in the most cost-effective way possible?
My company is building a database from a large publicly available data set. When we complete it, we will have something like 500GB of data, but the data will never grow beyond that. It takes ...
4
votes
2answers
48 views
Memcached Lagging
Let me preface this by saying that this is a followup question to this topic.
That was "solved" by switching from Solaris (SmartOS) to Ubuntu for the memcached server. Now we've multiplied load by ...
-2
votes
1answer
96 views
How do I calculate my bandwidth requirements?
We have a facility that needs to upload approximately 20 3MB photos per minute to Amazon S3. These are coming from 10 different machines on our local network. We need to do this continuously for 16 ...
1
vote
0answers
38 views
Whats the next scalability step after seperate mysql farms?
I'm running a saas service which is growing rapidly. The customers are ecommerce websites and we get hit on every page view on each of our customers sites (currently 10M's hits/day).
The current ...
0
votes
1answer
52 views
Virtualbox development network using FreeBSD
I want to setup virtual network with 3 guest OS(FreeBSD) for testing scalable webapp. The first one should be only MySQL master server. Second and Third will be slaves with read only MySQL's and ...
0
votes
0answers
35 views
Horizontally scalable database (Linux) [closed]
I am looking for a persistance solution that can go from one server then when required be scaled out without much hassle. It should include some failover solution (replication) and be quick. I have ...
-1
votes
1answer
71 views
Video Uploading on Amazon instances?
I am having real problems trying to wrap my head around my problem. I have decided on the middle and end solution to my problem but I can't seem to work out the the beginning of it.
So as a bit of a ...
-3
votes
1answer
81 views
How do you host a big data web application? [closed]
Affordable alternative to Linode.
I am using linode to serve my web application. The application serves, what I consider big data using ~ 30GB for our model US State and we serve a few hundred ...
1
vote
2answers
102 views
What would cause Memcached to Hang for 2+ seconds?
I'm going nuts trying to scale memcached. From their site:
Memcached operations are almost all O(1). Connecting to it and issuing a get or stat command should never lag. If connecting lags, you ...
3
votes
2answers
196 views
Ubuntu scalable nginx mongodb mongdb memcached server configuration
I have been building a PHP web application using the following techniques in the past 2 months:
PHP 5.3.4
MongoDB
MySql
I just got my dedicated server running Ubuntu 10.4 LTS x64 with the ...
0
votes
0answers
32 views
How scalable is SVN's WebDAV functionality?
I have been investigating ways to add version control to a networked file-store whilst keeping it "looking like" a Windows SMB share. I have read this book excerpt that explains implementing a ...
6
votes
4answers
427 views
Ways to auto scale MySQL servers?
I run a site which has high traffic surges and because of that auto scaling solutions is very profitable for this case. Currently the web server is able to horizontally auto scale but the bottleneck ...
1
vote
2answers
190 views
Why doesn't IIS scale consistently?
I have a WCF service (written in .NET 4) running under IIS 7.5 on Windows 2008 R2 64-bit.
I created a test tool that spawns 10-20 (or more) threads - each thread creates a random payload and hits the ...
4
votes
2answers
164 views
When you exhaust a 1 Gpbs connection to your main haproxy, how do you scale out?
If you exhaust your public network connection (say 1 Gbps) to your haproxy server that proxies requests to your backend servers, what options do you have to scale it out?
Since all request traffic ...
2
votes
1answer
43 views
Availability & Scaling : Three Tier or Two Tier
I began working on a three -Physical- tier website (UI:MVC / Application:REST / DB), I've always considered that three tier is more scalable than two (taboo for high traffic websites), but lately i ...
3
votes
2answers
136 views
Scalable way to add users in Postfix without creating new unix/linux accounts?
What is the most scalable way to add new users in postfix? I don't necessarily want to create a new user in /etc/shadow just for email. I know I can use aliases but this does not solve the issue of ...
1
vote
0answers
70 views
unable to set up the ec2 ubuntu instance for auto scaling
I went through enough number of blog post which actually guides how to set up the auto scaling platform. I am using the Ubuntu ec2 32 bit AMI. From which I am trying to scale the instances, I am ...
0
votes
2answers
83 views
Unable to add the environmental variables and run “as-cmd”
I am running micro instance, now need to horizontally scale. I mean I am experimenting with a micro instance. I followed the instructions which is given in this video, but when I run as-cmd I get an ...
0
votes
3answers
107 views
Why is static page response time going up with increased concurrent requests
I don't understand the performance I'm seeing from apache. I would expect that more concurrent apache requests would perform better than fewer, up to a point, but beyond 3 concurrent requests, overall ...
0
votes
2answers
225 views
What is the reason for scaling Amazon EC2 by instance count rather than instance parameters?
We are looking into moving our website to Amazon EC2.
The basic idea behind Amazon's cloud seems to be: "Need more RAM? You got it. Hard disk? Sure, here you go." Etc.
But Amazon seems to be pushing ...
2
votes
2answers
450 views
Amazon EC2 AutoScaling WordPress
I am currently looking to autoscale my wordpress installation on Amazon EC2.
Everything is working, I can bundle my EBS instance, put some policy and then amazon run automatically instances behind my ...
2
votes
1answer
141 views
Scalability 1-way. What does it mean?
I have read "Scalability: 1-way" in the specifications of a server. What does it means?
The server is :
HP ProLiant ML110 G6 TV X3430 2.40GHz 4-core 1P 1GB-U Non-hot Plug 250GB SATA LFF 300W PS
0
votes
3answers
89 views
Is it possible to rate limit based on host headers? i.e. not just on ip address
I have a web service endpoint that I am building where people will post an xml file to, and it will really get pounded with over 1K requests per second.
Now they are sending in these xml files via ...
0
votes
2answers
122 views
How wordpress.com do scalability
Out of curiosity, I wanted to know, how Wordpress.com scale their architecture, specifically:
how they handle sub-domains.
I believe they have millions of subdomains.CMIIW. How do they scale their ...
-3
votes
1answer
127 views
How scalable is mySQL server? [closed]
I am debating on whether I should have three separate wordpress installs with three separate databases, or whether it would be okay to use multisite (which only uses one central db).
I am concerned ...
0
votes
1answer
102 views
Memcached server: Is it a good practice to point two server urls to the same server?
I have a system where there are connections to a memcache server from several different files and servers.
I would like to stay with one server but keep the option of increasing the number of ...
0
votes
1answer
185 views
nginx / node.js / postgres, scalability problems?
I have an app running with:
one instance of nginx as the frontend (serving static file)
a cluster of node.js application for the backend (using cluster and expressjs modules)
one instance of ...
0
votes
1answer
324 views
What is the best Amazon EC2 server configuration for a highly-scalable distributed php application? [closed]
I'm creating a php application that needs to be able to scale up to "1 million users". I know this question is subjective to the application, but I'm curious what type of generic setups are a best ...
1
vote
2answers
106 views
Scalable Web Application Hardware Topology Best Practice
I'm working with an existing web application developed in Ruby with a MySQL back-end, but I think the generic hardware topology question will apply to a wide variety of server architectures.
I'm ...
2
votes
3answers
181 views
Scaling Out SQL Server 2008 R2
I am looking into the possibilities of how to scale out the sql server 2008R2. simply scaling up wont be enough.
"p2p replication" and "distributed partitioned views" look interesting, but both ...
2
votes
1answer
128 views
Suggested or Best practices for network architecture for ASP.net web application
Currently I have one server that runs an ASP.net web application (on IIS) and this is also running a SQL Server database.
I am getting more and more traffic and soon I will need to increase the ...
0
votes
2answers
242 views
Why should one use amazon-elb?
Amazon-elb is a scalability solution that works like a proxy to several instances of my amazon ec2 servers. I wonder if it would'nt be more effective to have a roundrobin DNS to resolve my name into a ...
2
votes
1answer
314 views
I need nodejs and mongodb to handle 5000 requests per second
As the title suggested, I need nodejs and mongodb to handle 5000 requests per second. Right off the bat that is. We'll grow to many times that eventually.
My initial thoughts are to put each on ...
1
vote
3answers
176 views
Database scalability with write-heavy application
I have a write-heavy application. The application is best compared to surveys - the customer creates custom questionares and this is saved to the database. Most of the requests are from their users ...
1
vote
1answer
127 views
Multiple AWS EC2 Instance with Single Database
Currently we are using One EC2 instance to run our Services. And we are planning to add one more instance to put our application Server. Is it better to put the database in separate instance and query ...
2
votes
2answers
447 views
Poor performance on Amazon RDS instance
I'm doing some load/stress testing on a PHP web application that is backed by a Small RDS database instance. When I hit the website with ~50 concurrent web requests, the RDS database just stops ...
1
vote
2answers
120 views
KVM on multiple servers
I'm using KVM for virtualization on a couple of Ubuntu servers but each physical server runs a bunch of VMs. Is there a way I can scale my VMs across physical servers? Does KVM support this? Is there ...
-3
votes
1answer
49 views
Doubts about best choices for a webserver [closed]
I have this config.
Quad core i7 930 (x64)
6gb ram
WEBSITE architecture
php language for website
mysql and it is possible the use of cassandra
SSL protocol
three hundred thousand visits (daily)
...
3
votes
3answers
78 views
SQL Server 2008 Enterprise edition 64 bit scalability
I am currently running SQL Server 2008 64-bit Enterprise Edittion on a VM ware environment with 4 CPUs and 32GB RAM. I want to scale it up. Is there a limit on how many CPUs and RAM I can go up to?
I ...
1
vote
0answers
85 views
Browsers can't handle the real time updates my app is sending, slows everything waay down
Posted this a couple days ago, have made some more progress. Thanks for the help, this is delaying our launch and I'm under a lot of pressure.
UPDATE: I don't think it's the server side, I think ...
3
votes
2answers
549 views
Is Amazon EC2 for me?
I'm working on an image hosting website tailored to a particular niche. The website is made with Django. I'm currently planning to run it on Linode.
So far so good. The problem is: I will need to ...
0
votes
1answer
177 views
Scalability problem (Tornado). Can't figure it out, holding up launch
Thanks guys, any ideas/insight are appreciated b/c this is driving me crazy.
Problem: Only about 3 or 4 users can use the server simultaneously before app grinds to a halt.
Currently we see massive ...
0
votes
1answer
65 views
Utilizing two servers (LAMP)
I currently have my web app on a single cloud server. Been doing this for a few months now and I have EVERYTHING on this instance (app, cron scripts, mysql, svn, dev environment, etc).
The site is ...
0
votes
1answer
481 views
Setting up a Rails 2.3.x app on EC2 for easy scalability
I'm running a simple rails stack on a single dedicated machine. We're reaching our full capacity and have absolutely no setup for scaling, just one app on one machine. I did some research and came up ...
1
vote
2answers
173 views
Open source cloud computing with scalable virtual machines
I'm searching for open source software to create my own cloud computing environment, like Ubuntu UEC or Eucalyptus.
What I need is that each virtual machine can use resources from multiple nodes ...
2
votes
2answers
365 views
How to load balance > C100K?
Suppose that a hypotetical webapp keeps one connections per user (eg: chat app using comet, long pooling, etc...).
How can i load balance such thing to scale beyond the connection limit of a single ...
3
votes
1answer
327 views
Ideal server specs/software for mail, file, and database storage
I'm trying to figure out what the ideal set up would for a few servers.
1) Website
1) Mail server
1) Database server
1) file server
In this given scenario, say there is a site that will offer each ...
6
votes
6answers
1k views
What is a typical method to scale out a software load balancer?
I often see web app architectures with a SLB / reverse-proxy in front of a bunch of app servers.
What happens when the number of connections to the SLB requires too many resources for a single SLB to ...