I have a router opened up to allow Remote Desktop to one of the machines. It works if I try to connect from outside the network. If I however am inside the LAN and try to connect using the WAN IP address it doesn't work. Why?
You need to have NAT reflection enabled if your router/firewall supports it. This allows you to access internal servers by public IP. Otherwise, you need to use private IP addresses when accessing internal servers.