Many broadband routers have the capabilty, if you already have those it would be worth checking. Post your model numbers for more help there.
All modern versions of Windows (NT, 2K, XP) have the ability to act as a VPN server for one connection, Server versions of Windows can handle several connections at once.
VPN servers are available for Linux in several forms.