Yes. If you do, place the routers in order of preference and ensure that each router has the correct routing tables in place. If not, data will not be able to reach its intended destination.
From my experience, the order of preference in DHCP Manager actually works and the first router in the list will be the default gateway for all your DHCP clients.
Regards,