The couple — who said "I do" during a non-legal ceremony in January — have kept a relatively low profile following West's disturbing remarks last year.