Let's say you open a window. There is difference in temperature and relative humidity between inside and outside air. Which room quantity will equalize faster with the outside - temperature or humidity?
Humidity will equalize mainly by convection (and somewhat with diffusion) whereas temperature, along with convection, will also use conduction and radiation. So my guess is temperature will equalize faster.