Libraries and My Document are just shortcuts to your main folder on C:\drive. They are there just for your convenience but are showing the same files. Leave them as they are and ignore them if you don't want to use Libraries or My Documents shortcut. If you were to delete them, you would loose your only copy of the file.
Cetainly, back up your files - that's a very good and wise practice.