Former President Bill Clinton says he's frustrated with all the speculation about Hillary Clinton running for the White House.