Your router will have an IP address (probably 192.168.1.1.)
Stick that in the address bar of your browser and press enter
You will then be asked to log in to the router. (this will either be the factory default password or one you recently set)
Once past that screen you will be in the web browser administration screens used for managing your router.