"I had a knee-jerk reaction to it because of the reputation that preceded it," the "Two and a Half Men" alum shared. "I was just like, 'Oh, this can only go bad.'"