The "Baby" singer and the Rhode founder stepped out together four days after eagle-eyed fans noticed he was no longer following her on Instagram.