I can confirm that the granite slab feels cooler than paper or wood, despite having a greater temperature.
I experimented with the following materials: A steel handle, a granite slab, a wooden chair, lens from a solder stand, and a paper cup. See that the temperature of the granite slab and steel handle is in fact higher than the rest of the materials. The temperatures were measured using a Fluke 62 max IR thermometer (I don't have any associations with the company, this thing was just lying there in the lab). The feeling was measured using my forearm. The forearm was properly recalibrated after each measurement by idling for one minute.
Object |
Temperature ($Celsius$) |
How it felt |
Thermal conductivity($Wm^{−1} K^{−1}$) |
Steel handle |
26.4 |
Very very cool |
45 |
Granite slab |
26.6 |
Very cool |
~3.1 |
Wooden chair |
25.2 |
A little bit cold |
~0.1 |
Solder Lens |
25.9 |
A little bit more cold |
~1 |
Paper cup |
25.8 |
Warm |
0.05 |
The following orderings were made by comparing each material in pairs.
The temperatures were roughly the same ($25.98\pm0.49^{\circ}$C) for all these objects since they exist in this air-conditioned room for as far as I remember. So the main factor contributing to the coldness here should be the thermal conductivity.
The materials ordered by thermal conductivity (high to low):
Steel>Granite>Glass>Wood>Paper
The materials ordered by how cold they feel (cool to warm):
Steel>Granite>Glass>Wood>Paper
The order of coolness seems to match nicely with the order of thermal conductivity. Note that I looked up the thermal conductivities after performing the experiment, in order to remove confirmatory biases.
Bob's and Nic's answers explain well the thermal conductivity part and how coolness is related to the skin's heat transfer rate rather than actual temperature (Also see this related question).
This experiment seems to confirm that their explanations are on point.
I would also like to add that the feeling of coldness also has to do with the surface roughness and porosity of the material. Smooth materials would have a higher contact area with the skin, allowing for better heat transfer.