Deuteronomy 22:29 "And she shall be his wife"

A man who forcefully takes a girl as a wife without following the Torah law for a proper wedding procedure is commanded to marry that girl in the proper manner.

They must remain married for the rest of their lives (see Negative Mitzvah 358).