and both computers are on, double click on the LAN icon and look at the status. The information should be on Details. This is what you should get:
IP Address - both different, Subnet Mask - same on both PCs and router, Default Gateway - router IP, DNS - router IP.
If this is not the case, then you may need to rerun the Network Wizard; if it still does not work, configure the TCP/IP manually.