Religious freedom is just a subset of freedom. If you don't have religious freedom, you aren't free. If you don't have freedom of speech, you aren't free.

Free is free. There are no carve-outs. You have it all or you aren't free.

No one can be completely free. Our talents, family
situations, jobs, wealth, cultural norms, and
of course - our laws. Laws against - murder, incest,
domestic violence, sexual abuse, burglary, to name just
a few - constraine our choices. As well as the freedom of
others, which limits ours.

Freedom is not absolute. Most of our rights are subject
to limitations and these limitations are necessary to
protect the rights and freedoms of others, public order,
national security, public health, and so on.

"Freedom is not absolute."

In other world shattering news, the sky isn't blue because sometimes there are clouds.

Yes freedom ends where it interferes with other's freedom.

I used to participate in weekend workshops called "Enlightenment Intensive".
While there are many details to describe and opinions for and against it, let me present here only what is relevant to this discussion:

The purpose of the workshop is spiritual and there should be every reason to classify it as religious even while it includes no theology or mention of 'God'.

At the core of the workshop are dyads, where participants are paired up and sit in front of each other. Half the participants in turn contemplate and then communicate to their partner whatever came up as a result of their contemplation - the partners listen silently, then at the end of each 5-minute interval only say "Thank You" and the roles reverse.

Now while the workshop is not about confession, removal of guilt feelings or absolution, things one is remorseful about do come up quite regularly in the process as a result of contemplation and are then communicated across to one's partner - thus confessions do incidentally occur.

To keep a safe and sacred space that allows the process to proceed and enlightenments to occur, participants are instructed and agree to keep absolute confidentiality and never mention or act on what they hear from their partner, "even if they said 'I murdered my grandmother and then ate her corpse`".

Participants come from all walks of life - they may happen to be doctors, lawyers, judges, priests or teachers, or they could just as well be bus drivers. Whatever they be outside the workshop, in there confidentiality is sacredly kept and none of what was said will ever be reported to anyone, not even to other participants and certainly not to police.

In order to allow this sacred religious process to occur, freedom of religion is paramount.

'In other world shattering news, the sky isn't blue because sometimes there are clouds.'
- Yes and for 12 hours a day the Sky is BLACK

Try to be a rainbow in someone's clod.
(Maya Angelou).

Besides, beautiful sunsets need cloudy skies.