A virtual private server is where a single physical host server is partitioned off to create many virtual servers. Each of these can run its own full-fledged operating system and can be independently rebooted.
In the world of commercial web hosting, VPS exists between shared and dedicated hosting.
The concept of VPS may also be known by the terms "Virtual Server" and "Virtual Dedicated Server."