You can install some kind of a firewall software on your server - I personally recommend AtGuard - I think, from Symantec. It's a decent small scale firewall, and it has an olption to block particular address for a specified time duration - exactly what you need. You can remove all the default options, and add just your access control ones, or, you can keep the defaults for extra protection (especially, if your server is on Internet).
Requires some basic firewall knowledge, though.
A word of causion: this is an intended PC product, not a server product, meaning, that, if something not defined very clear, it pops up a prompt, and waits for your input. So, after you configured it for the first time, watch for a week or so, in order to clear all possible situations with firewall rules.
Hope it helps - BTW, I tested it om my PC - worked like a champ.