You're looking for the X-Forwarded-For header. Any proxy worth its salt will add this header to HTTP requests it is forwarding.
If your entire site is behind this proxy, then you need to find the relevant LogFormat for it, which will typically look like this:
LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\"" combined
and add the header to it (or swap out the %h which is only ever going to be your reverse proxy) like this:
LogFormat "%{X-Forwarded-For}i %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\"" combined
If you don't want to redefine the combined log format then create your own:
LogFormat "%{X-Forwarded-For}i %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\"" combined_proxy
CustomLog /path/to/logfile.log combined_proxy
%{<header>}i is a way to get any other request header into your log files.
Note: That header will not always necessarily be a single IP address. If the request has come through more than one proxy, then you'll get a comma separated list of the form: client, proxy1, proxy2; you may need to update your scripts or log scrapers to accommodate this.