Yes, the presence of GHGs results in an increase in temperature. As they serve to trap heat within the atmosphere, this reduces the radiative flux from the planet, meaning there is no longer thermal equilibrium. To restore said equilibrium, the temperature of the Earth must rise such that it can radiate more.

It's important to also remember that there's an external source of energy (the sun) adding to the system, which just makes matters worse.