Initially it would still have no rotation, but as it is in a non uniform gravity field the center of gravity would be slightly below the center of mass. This can create a torque on it.
"A body's center of gravity is the point around which the resultant torque due to gravity forces vanishes. Where a gravity field can be considered to be uniform, the mass-center and the center-of-gravity will be the same. However, for satellites in orbit around a planet, in the absence of other torques being applied to a satellite, the slight variation (gradient) in gravitational field between closer-to (stronger) and further-from (weaker) the planet can lead to a torque that will tend to align the satellite such that its long axis is vertical. In such a case, it is important to make the distinction between the center-of-gravity and the mass-center. Any horizontal offset between the two will result in an applied torque." From Wikipedia; https://en.wikipedia.org/wiki/Center_of_mass#Center_of_gravity