No, you can not. At least not universally.
The combination of IP:port identifies something unique. You can only tie one application to such a combination. That means one FTP server, or one mail server, or one webserver, ...
Note that webservers do get around the limitations of that by also sending the name of the website in their request, so they basically steer on a triplet. Most FTP client and servers do not.*
*Most as in it has been suggested for FTP and a RFC is released. But that does not mean that all clients support it. You might get it working in a small office with controlled clients, but do not yet try to use it as a general working solution on an Internet accessible FTP server with unknown clients. Instead consider one site with three directories. Or something else than ancient FTP.