Okay. I tried pulling the power from each component one at a time, and each time I pulled the plug, it gave a bit more of a spin. Harddrive, CD and DVD ROMS, then Graphics Card, then fans. Once I unplugged the fans, the PSU's rear fan gave a full spin, then died.
Fun.