I have a default vhost setup on my Debian box (a demo, I wanted to see how Varnish caching works and whether it could solve a speed problem).
All was well with the default host, lots of cache hits and the occasional miss. Cool.
So I added a vhost through Apache, hooked up WordPress (I know about the cookie problems) and tried loading it's readme.html file. Still quick, but it's stopped hitting/missing the cache altogether, despite having absolutely no dynamic references. Images also aren't cached at all.
Any suggestions for what could be going wrong? I used a2ensite but above that did no additional configuration for the new vhost.