Neutrality at government sites doesn’t threaten free speech. It protects it.
On topics of current debate, having government buildings be a neutral space ensures an environment of free speech, where both left and right feel they are welcome to express their views.