If you look in control panel, internet options, connections...do you have 'always dial my default connection' checked?
Also is your dial up set to default? if not, highlight it and click on set as default.
If you go into settings and then advanced, you can check the box 'disconnect when connection no longer needed'. This will prompt if you want to disconnect when you close your browser.