A small pry bar (I use a Stanley Wonder Bar II) has come in handy a number of times -- trying to get a tight server out of the rack; replacing swollen batteries out of a UPS. But it gets its most use when I have to shift everything in the rack up a couple of mm because the server I'm inserting is just a hair taller than whatever it was I just took out. (Lossen a higher machine, lift it 'til it's tight against the one above it, tighten screws, repeat down the line).
If you weren't in a colocation centre, I'd also suggest a crash cart with a serial terminal, and a lift cart (for those times when your management won't give you a maintenance window, and you really, really need to move that server; it also comes in handy when you don't have enough people to safely unrack that ancient 8U UPS, but can extend it far enough to get a lift under it).