323 reputation
1719
bio website
location
age
visits member for 4 years, 2 months
seen Oct 25 at 1:45

Mar
28
comment CDNs - is there a delay between file submission and availability?
@Jay - yeah apparently its the time before it's purged from the CDN (not just the cache headers sent to the client), according to their support. The docs are a little more ambiguous though: support.netdna.com/howto/custom-expiry-headers.
Mar
28
comment CDNs - is there a delay between file submission and availability?
@Jay - yeah good point. I checked and it seems you can override the default cache expiry time in MaxCDN (they say 'no limit' but I'm sure there must be).
Mar
28
comment CDNs - is there a delay between file submission and availability?
@MichaelHampton - wasn't familiar with it, but yes it seems like the way to go.
Mar
27
comment CDNs - is there a delay between file submission and availability?
I see. Thank you.
Mar
27
comment CDNs - is there a delay between file submission and availability?
Thanks! The files will not change, so I'm not worried about long cache rules. However there will be files added regularly, and I'm concerned about when these new files will become available to users after they are added via the API.
Mar
27
comment CDNs - is there a delay between file submission and availability?
BTW - I realise that is a bit of an edge question (which presumably is why the vote to close). I don't think its a perfect match for SO, Serverfault or webmasters.
Mar
26
comment Is this a sensible way to scale Nginx for static content serving?
That's in the sense that NFS is not particularly known to be a performant solution, but that's the reason for my question, and as Dennis mentioned, NFS might not be a good fit. but if you know that your site can run out of a small VPS - I never said this, only that we are using VPS as the basis. There are many sites that have grown to a large scale on VPS (e.g. Pintest, Reddit - which has 200-odd EC2 instances AFAIK). The whole reason for my question is that I want to consider scalability of this part of the architecture now rather than later.
Mar
25
comment Is this a sensible way to scale Nginx for static content serving?
Thanks. Not sure I understand this sentence If you're thinking about using VPS and NFS, I don't think your concerns about scalability are justified. - could you clarify? At some point 1 machine is not going to cut it (VPS or not), so I'd rather have things set up for scale-out before that.
Mar
23
comment Is this a sensible way to scale Nginx for static content serving?
Ah, looks like varnish can use ram and disk.
Mar
23
comment Is this a sensible way to scale Nginx for static content serving?
Thanks. One last question then :) - I've no experience with caching proxies - do they cache in RAM only? Or do they also cache to local disk? Just wondering what amount of RAM would be required to keep them going back to the content servers.
Mar
23
comment which CDNs are popular websites using?
Great info, thanks. I see that MaxCDN list stackoverflow as a customer on their frontpage - wonder if that's still the case?
Mar
23
comment Is this a sensible way to scale Nginx for static content serving?
I see - good to know, thank you! I was really hoping to avoid having to have the application servers aware of the number/configuration of nginx servers and doing multiple operations (e.g. having to handle situation where one PUT fails). Regarding resyncs - you mean using rsync? Might it be viable just to update one server and have rsync deal with propagation after each file put?
Mar
21
comment Is my VPS server secure? Steps needed to make it secure, if not?
Yeah the linode library has a lot of good stuff in it. IMO though some of these security recommendations are a bit pointless when the Linode admin tool (which gives access to everything) does not implement them (pure username/password).
Mar
13
comment HAProxy - putting up a maintenance page
Thanks, I'll look into this.
Jan
31
comment Is Zabbix the right tool for me?
I was under the impression that Zabbix can use SNMP - not so?
Jan
16
comment NGINX config for many small files
what number of workers would be appropriate for many very small files? More than the number of CPU cores?
Jan
14
comment HAProxy being killed with more that 54,000 connections
@Olly - Just of of interest, what size EC2 machine is it?
Jan
14
comment HAProxy being killed with more that 54,000 connections
@WillyTarreau - ah sorry, I see there is some info in your post which ochoto linked to (serverfault.com/questions/106537/…)
Jan
14
comment HAProxy being killed with more that 54,000 connections
@WillyTarreau - could you point us to any information about how TCP settings should be adjusted for very high concurrency situations? (i.e. how to avoid such high memory usage). Thanks.
Oct
30
comment Fast small static file serving on a VPS - avoiding the Disk
Quick question - do you know if this starts copying the whole folder into memory as soon as you mount this, or does it load each file into memory the first time it's requested?