No. The placing of religious symbols on government property is tantamount to government endorsement of religion. Therefore, no religious symbols on government property.

Lack of endorsement of any religion is not the same thing as endorsement of atheism.