5

Let's say I have items A, B, and C. I have two backend servers: server01 and server02.

Item A can be handled by server01, item B and C can be handled by server02. New items and servers get added and removed, and we programatically update a hash table between item id and backend server in a file, Redis, Memcache, or similar (whatever the proxy would support).

Can I make a frontend such as /items/${id}, and have HAProxy route to the correct backend server based on ${id}? So by looking up what id is associated with what server?

If not, would Nginx be able to do this?

3
6

You can use maps to make it work.

This is perfectly outlined in a post on the HAProxy.com blog. They're mapping based on the Host header, but it would be trivial to change the config to work for the URL.

One extra benefit here is that you can dynamically add and remove mapping entries using the http-[request|response] [set-map|del-map] keywords, or via the admin socket.
Changes made with http-[request|response]or via the socket aren't persisted between reboots, so you'd want to have some out of band process to update the map file at the same time, but that's another question all together.

Assuming you have a backend for each server, and given a map file called /etc/haproxy/items.map with these contents:

#itemPath    backendname
/item/a      bk_server01
/item/b      bk_server02
/item/c      bk_server02

You would do something like this in your frontend:

frontend ft_items
  [...]
  use_backend %[path,lower,map(/etc/haproxy/items.map,bk_default)]

If you have both servers in the same backend, you'd write an ACL in the front-end that catches all the items (acl items path_beg /items), send them to the backend (use_backend servers if items) and replace the use_backend line from the frontend with appropriately if-claused use_server lines in the backend.

4
  • Isn't stick-tables meant for this purpose? – Karthik Murugan Jun 4 '19 at 9:13
  • 1
    No, stick tables are mostly meant to store data for server persistence, aka sticky sessions. – GregL Jun 4 '19 at 10:29
  • would this work if i had 100000 items and both them and the servers change often? A realtime lookup would be best, but i'll settle for something that is fast to pick up on changes. I think the proposed solution is probably not intended for such a noisy use case? – kvz Mar 18 at 13:38
  • Yeah, that seems like a bad idea. I’d find a way to break it down more so that you have less items in your map. That said, I’ve got to assume that 100000 routes of going to be hard for any reverse proxy to handle properly. – GregL Mar 18 at 13:44
5

Yes, you can easily do this with HAProxy. Simply create an ACL with a list of IDs served by server and apply it to a use-server directive. IE:

acl server1-ids path_beg -i /items/id1 /istems/id2
use-server server1 if server1-ids

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.