Do you mean something other than a conventional mail client that would retrieve the entire message?
I'm not sure there's a way to retrieve only the attachment. For one thing, something would need to keep track of wether or not the attachment has already been retrieved, because the actual mail message (that contains the attachment) would never be removed unless told to do so by a conventional mail client.