Charles reportedly toasted to the birthday boy, as well as "those that weren’t there," during an intimate family luncheon at Buckingham Palace on Saturday.