Just have to keep cleaning HB click here it's not just you, it happens a lot. Try bleach, bi-carb, or white vinegar.
You could soak rag or kitchen roll in white vinegar and poke it up the spout and leave for half an hour. Vinegar will dissolve calcium deposits and kill mould spores. White vinegar makes a super all purpose cleaner and laundry freshener (put some in washer with your laundry).