So I said, "fuck it" and thought I would be smart and install Win2k on it instead. There was something I hadn't considered though - integrated ethernet. Win2k wouldn't even see the ethernet port. Checking the HP site (with my laptop) I could see that there was NO driver for anything other than Windows XP. I also tried Suse Linux 8.0 as well - no luck.
To top it all off they didn't even bother to include a Windows XP restore CD. So, they're getting back their hardware with Suse Linux 8.0 installed.
That'll teach me to ever buy a prefabbed system again.