I have a server running openvpn for outgoing connections. However, once I start openvpn, I lose SSH, HTTP access to the server's IP. This is expected I guess, but is there a way to circumvent the VPN connection when connecting to these ports?
Try setting a static route to the Server's address to go through eth0, wlan0, etc. This should bypass the tunnel interface explicitly. If you need to do this on a port level, try IPTABLES