You could use restriction classes. See:
For example:
/etc/postfix/main.cf:
smtpd_recipient_restrictions =
check_recipient_access hash:/etc/postfix/protected_destinations
...
smtpd_restriction_classes = bad_senders1
bad_senders1 = check_sender_access hash:/etc/postfix/bad_senders1
/etc/postfix/bad_senders1:
person@fromaddress.com REJECT You are not welcome here.
...
/etc/postfix/protected_destinations:
person@ouraddress.com bad_senders1
...
Now emails with an envelope sender address in the "bad_senders1" restriction class will get rejected, but only if it was sent to an address in the "protected_destinations" list that has the "bad_senders1" restriction class specified on the right-hand side.
Remember to run postmap for the newly created files.