Cabin swapping etiquette

One person in business class, the other in economy. How do you feel about these 2 passengers swapping seats periodically during a longhaul flight?

BoardingArea