You are comparing the velocities of the centers of mass, instead of the velocities of the points of contact.
The true elastic contact relationship is expressed for the contact point A.
$$ (v_{df} - v_{sf}^A) = -\epsilon (v_{di} - v_{si}^A) $$ where $v_{si}^A = 0 $, and $v_{sf}^A = v_{sf} + c\,\omega_f $, with $c$ the distance of the center of mass of the stick to the contact point, and $\epsilon=1$ the COR.