The disgraced prince is reportedly refusing to downsize from his large home — which King Charles wants to give to Prince William — into Prince Harry's former cottage.