As Thomas Jefferson wrote in his Autobiography, in reference to the Virginia Act for Religious Freedom:

“Where the preamble declares, that coercion is a departure from the plan of the holy author of our religion, an amendment was proposed by inserting “Jesus Christ,” so that it would read “A departure from the plan of Jesus Christ, the holy author of our religion;” the insertion was rejected by the great majority, in proof that they meant to comprehend, within the mantle of its protection, the Jew and the Gentile, the Christian and Mohammedan, the Hindoo and Infidel of every denomination.”

These are the true roots of America, folks. Secular government, religious freedom. America is for everyone.

- An American

P.S.

The Presidential oath of office is described in Article II, section 1 of the
Constitution:

“Before he enter on the Execution of his Office, he shall take the following Oath or Affirmation:–”I do solemnly swear (or affirm) that I will faithfully execute the Office of President of the United States, and will to the best of my Ability, preserve, protect and defend the Constitution of the United States.”

Nothing in this section requires that the oath of office be taken on the Bible. Neither do the words “so help me God” appear in the oath. While Presidents often include this phrase in their inauguration ceremonies, the words are customary; they are not required by the Constitution.

EDIT I am afraid there are some people out there that do want to erase His name from everything. People who are hard-hearted against God will do many things to keep Him away from themselves, and other people.