I want a good resource on how to setup Ubuntu on Hostgator VPS. I am unable to find it on Hostgator forums.
You cannot change the OS on a VPS, only your provider can do it. Ask their support (you pay them for answering your questions, right?).