“My first Memorial Day through Labor Day…it was the summer of the white pants because I never had to worry,” the talk show host remembered on her pod.