Yuyutsu, if someone chooses 'not to belong' to a society (bizarre notion), then I assume that person would not be paying any tax?
So it would follow that this person should not be eligible to use any services or infrastructure paid for by other people's taxes.

Where would such people live then? Out in the Simpson Desert?

Dear Suse,

These people will live either on their own properties or on the properties of like-minded people who allow them to be there.

So as you correctly pointed, they will not be entitled to any services and it is up for any society to which they do not belong to either deny them access to its infrastructure or to provide them access to it for an agreed charge.

While they may not pay tax, they would anyway be using their own money (if any) rather than the money that is printed by a society to which they do not belong. Anyone who uses a currency (voluntarily) must abide by the conditions of the printer/issuer of that money - which may include taxes.