Ok, so, problem solved I think.
gfx is fine, new PSU is fine. My graphics card works in another machine. Other graphics cards work fine on my machine. However, put my graphics card in my machine and it doesn't like it one bit.
The card I tried in mine was an 8800GTS, powered by the PCI-E...