You can explicitly revoke read access to all required properties from MMC AD snapin (using delegate control wizard), but don't do it.\
LDAP is designed to provide such information for authorized users.Why revoke it?
Anybody from domain can query same info user explorer's "Search in AD" function or by running
When you mess-up permission on OUs and user-objects, you may have a big trouble.
Did you create dedicated user for outlook address book setup, or you are using integrated auth?
Until you use integrated auth, you will need to revoke "Read attributes" and "Read Extended attributes" privileges on all user object in your OU from all users in that ou.