XP probably doesn't have appropriate drivers for the hard disk controller. You'd need to make an 'F6' disk and use it to add drivers to Windows during setup.
Note that installing XP after Vista will almost certainly corrupt the Vista bootloader and you'll probably need to perform a repair install of Vista to recover it.