When you format columns the whole of the document will be affected unless you contain the columns with a section. It sounds as if this is what is happening now, but when you try to move the text you are moving to a different section which, if not formatted for columns will obviously look normal, but if you format page 2 for columns and then try to move the text, then the whole of the rest of the document is affected because there is no section break after the new columns.
Try this: 1 Put your cursor at the bottom of page 1 and Insert a Section Break on "next Page".
2 Put your cursor on page2 and Format Columns.
3 Cut and Paste text.
4 If you do not want the rest of the document to have columns, Insert another Section break, this one "Continuous" and Format to remove columns from the new section.
5 If the original text location is not to have coumns format this section to no columns as well.