Perhaps what you need is the 'Group Listen' feature, which allows a user to use the handset while both sides of the conversation come through the speaker on the set. The mic is disabled, so background noise is not an issue, but the group of people listening cannot participate directly in the call. Group Listen is F802 to activate & F#802 to de-activate.
And try to keep the handset protected from the set speaker to prevent feedback.