The "Umbrella" singer, 34, hit the stage in a head-to-toe red jumpsuit, debuting what appeared to be a baby bump.