When you download programs they are not installed onto your system. You need to run them which will install the software. This means you can delete them normally. To uninstall the software which has been installed you need to go to the Control Panel and select Add/Remove Programs.
Note that some programs don't need to be installed and these can be deleted normally also.
And yes, it will free up disk space.