" I don't suppose it will take a PCI Express graphics card, will it? "
No. 8X agp.
Memory price. I think it is more expensive to make a 1 gig module over 2 X 512 dimms. Just think yourself lucky it does not take these click here
You may be better off with 2 X 512Mb. Have you seen the vendor list click here