have you checked your keyboard country settings? i always have the problem of it defaulting to US instead of UK. i would assume you have though as your email addresses are going in correctly.
the only thing i can suggest otherwise is update internet explorer. just put win98 in the other day and had no problems logging in as i had updated IE straight away through Windows Update