if they are configured to operate in infrastructure mode. Anything that's configured in ad-hoc mode will not work. Could this be the problem?
By default, the Linksys will have WEP encryption disabled - if you enable this during setup you can encounter problems unless each point in your wireless network uses the same WEP encryption method and encryption key. This causes lots of problems for newcomers to wireless networking - I get calls from people who have enabled WEP, only to find that although they get an icon reporting an excellent signal reception, they can't "see" the network.