This may happen but it happens so rarely, it is just not with the risk.
Plus some phone numbers are actually VOIP number. Like Telus integrated solutions. People think they are getting a regular phone number and it is a VOIP system. I don’t accept those either.
That sucks though. You seem like a good guy so it sucks that this happens this way.