Especially when those 2nd, 3rd, + properties are being used as passive short term rentals. Observing the state of the housing situation “Hmm there aren’t enough homes for normal families to each have a chance, I should turn this extra property of mine into a vacation rental.” does this make said person a POS?
One aspect not mentioned is that sometimes, second homes are in places that have a good supply of houses available. This makes them cheaper, and easier to afford. It also has more potential to grow in value down the road. If that’s the case, no issue. If not, it’s complicated.