This isn't going to be an answer, so much as an explanation of the complexity of what you are trying to do.
You have to ALWAYS remember that an email can be addressed to more than one recipient. You said "I want to not queue it if it's a forwarder". Well, what do you do when one is forwarder and one is a local mailbox? You only know the content of the message (headers and body) during the DATA phase, at which point you will have already accepted the recipients (one forwarder and one local).
This is MUCH more complicated to do what you want because the SMTP Protocol didn't allow for per-recipient preferences to be applied. There is a new feature that's in Exim that is called PRDR (Per Recipient Delivery Responses). It's a draft protocol from years ago that is an extension to the SMTP protocol. Almost no other mail servers support it other than Exim. It requires a mail server to connect to your Exim mail server and say "I see you allow PRDR, so I'm going to request it and will allow you to reject an email for each individual user, not just all or none."
It requires you to configure a PRDR ACL to check for specific things (spam score, recipient marks specific senders as spam, etc). THe ACL is called once for each recipient AFTER the message has been recieved (which is not allowed in regular SMTP), and in that PRDR ACL you can deny or accept for each recipient. Since the sending mail server requested PRDR mode, it will understand it.
Otherwise, you either accept it for all (and risk negative reputation with google) or reject it for all (and risk rejecting wanted email).
You can alternately specify a maximum of 1 recipient per inbound message. When you limit it that way, then you can make a forwarder/not_forwarder designation during the data phase and decide what to do based on spam score. But on emails with 10 recipients, you'll get 1 email to the first one, tempfail the remaining 9, and the sending mail server will queue it and retry later. After some time (depends on the sending mail server queue retry time) you'll get the email again to the second recipient, tempfailing the remaining 8. Repeat for 1, 7 remaining. Repeat for 1, 6 remaining. And remember, inbetween each delivery will be a pause that you cannot control because it depends how long the sender will retry the queued message.
The options for this are not great :-/
** Ironically, LMTP is a subset of the SMTP protocol which is designed for delivering from an inbound SMTP server to a backend mailbox server (i.e. not over the internet, only internally). LMTP does allow for per recipient rejection. So if you want to consider it this way, think of PRDR as applying a specific feature of LMTP to the SMTP protocol.