In principle yes, but skin contains many large and complex molecules and thus many chemical reactions can be introduced by absorbing photons. For example, UV light can even damage the DNA (just google for sunburn). Human blood cells absorb blue and green, but reflect red, giving blood its red color (in contrast, plants reflect green thus being green). In general, melanin is the most important substance in human skin interacting with visible light thus producing the color of the skin.
So different substances and different reactions, but the result is that energy is transferred to your skin.
Note, what we call infrared radiation (long wavelengths) does not introduce chemical reactions but just excite rotation and vibration modes, as you mentioned.