I don't ahve a Router, but I am on ADSL, via a USB modem.
If I dont actually look at the modem, the lights appear to remain constant. Hovever if I actually stare at them, while up/down-loading, the USB light does flicker as data transfer takes place. It's so fast that I can't see it unless I look right at it.
Does this sound like what you have?