"They were [moving] everyone out," said a source at the ex-president's private club and residence in Palm Beach, Florida. "Everyone was asked to leave."