I just started using haproxy (tcp mode because of SSL) to load balance my traffic between two web servers.
When I was using a single server, after images are downloaded for the first time, apache started serving "304 Not Modified" headers. But now I use two web servers and my browser downloads images again everytime I am connected the other web server.
All images on both servers have the same modification date.