Simple....the answer is yes.
I personally would not consider losing or negotiating any of my freedoms.
Remember freedom of religion is not intended to profess favoring it.
The intent is to have the ability to have religion or not......so for the atheist the freedom of religion protects their choosing.

No freedom of religion = ISIS......believe what I say or you will be slaughtered!