Yes it is the battery.
They are normally only a simple large watch type battery.
If you lift the lid off your PC you should see it.
As regard to loading new settings it looks like you have to just press F2 to enter the BIOS.
The only thing you really need to set is the time and date