There's a HUGE difference between "taking down" and having something temporarily covered up at the request of a *guest* speaker.

If I had to hazard a guess, I'd presume that the WH simply wanted to avoid appearing to endorse any particular religion.

This sounds like a tempest in a teapot - you made it sound like the government was coming in and tearing down crosses. Did Georgetown U. make a big deal of it?