What's the Argument Against the Mosque Location, A Reader Asks

In the comments to my "at" or "near" post of yesterday, a reader asks the following question.  Since it is an important question, I thought I'd pull it from the comments where it might go unnoticed and ask for thoughts in reponse. 

"Both Rick Garnett and John Breen have now claimed that there are arguments against the location of Park51 which have nothing to do with Islamophobia or the--implicit or explicit--questioning of American Muslims' patriotism. I still have not heard what these arguments are. They certaintly are nowhere to be found on major media outlets or political blogs. From the excerpt of Robby George's not-yet-published op-ed, I anticipate one such argument, which is grounded in "considerations of the sensitivies of families of victims of the 9/11 attacks". But I submit that as soon as you begin to explain *why* a certain sensitivity is enjoined upon the builders of Park51 and no one else, you end up in the position of Islamophobia, or at least in the position of imputing collective guilt on all Muslims (who must be more sensitive than everybody else) for the actions of a few religo-political maniacs."

[Upated to open comments, which I inadvertently neglected to do when I first posted.]