I think the mask thing is like smoking was. You have the freedom to smoke, and it's your health. But you don't have the freedom to subject unwilling others to your second hand smoke.
Same w masks. You have the freedom to manage your health. But you dont have the freedom to spread it to others. And the mask works at both ends (protects you and others in case you have it).
the WHO said asymptomatic spread is not a thing. your fears does not over ride people's rights to breathe fresh air