You say that you don't want any arguments about dishonesty etc, and that you would like legal advice, not moral.
In my opinion, there is no discussion.
They've made a mistake, so ring them and explain exactly that, then explain what you would like to do. If you don't, someone will notice at some point. Then it will look dishonest.