Right click>The 'Task Bar'
In the pop up menu click> 'Properties'
Make sure the 'Hide inactive icons' box is ticked. If it isn't, tick it then click> 'Apply' & 'OK'
If it is ticked click> 'Cusomize...'
In the 'Current Items' list scroll down till you see 'Safely Remove Hardware'
Click> the wording to the right of it.
Then Click> the 'Down Arrow'
I'll give you 3 choices
Pick 'Hide when inactive' (Even if it already said it)
Click> 'Apply' again then click> 'OK'