The rapper-turned-designer has lost his exclusive status, as his Adidas partnership accounted for $1.5 billion of his net worth. Now, he's worth $400 million.