During Monday's "Oldish" podcast, the actor recalled the beginning of his relationship with his former co-star.