"My love for books started as pure hatred," the "Did Everyone Have an Imaginary Friend (or Just Me)?" author tells Page Six.