As recommended, I suggest you get the manuals from php.net. I have both running well on my windows machine.
Simply install the PHP package (5 or 4.x). Then install the MySQL package on top. You will need to change the php.ini file and remove the ';' from the mysql dll/library extention...