Click on Library across the top
Select the Category at the top left eg Music, Pictures, Video etc
Click once on the file you want to delete to highlight it then hit the Del key on the keyboard.
A box will appear asking if you want to delete the file from your Library or from your Library and the PC. Put a dot in the latter and it will be permanently deleted.