Port forwarding is usually done for machines that are hidden behind a firewall and not otherwise directly accessible. In order to work properly, it requires some form of NAT, which by the sounds of it isn't going to be there in your case. That will make such a setup very awkward.
Effectively you would need to make it such that the router is the only public IP address used, and the other two machines, despite having perfectly usable public IP addresses, are logically arranged behind the router. This can be achieved by setting their default gateway to the IP of the router (i.e. all outgoing traffic goes through the router). Then define DNS entries pointing at the router, and set up the router to perform the necessary forwarding of traffic, complete with NAT.
As long as your router isn't configured properly, I would be very careful with setting the default gateway of the other two machines, since as soon as you do that and the router hasn't been configured to forward traffic properly, you'll lose all connection and the only way to get a working connection will be to ssh into the router and then from there ssh into any of the other machines.