Dozens of homes have had to be abandoned as the sea has crep