"You threatened that if I sued you, I would never speak to my kids again," the music producer wrote. "There are two sides to every story."