There are two aspects to be considered here:
- Does the wall reflect or absorb the radiation?
- If the wall reflects, is this specular or diffuse reflection?
For both of these sub-questions, the answer depends on the material that the wall is made of and on the wavelength of the infrared radiation. At wavelengths close to the visible (for example, at 0.8 µm), the behaviour is likely similar to the visible — so similar, in fact, that there are meteorologists that refer to any radiation up to 1 µm as "visible", even though we clearly can't see such radiation. At 20 µm, however, behaviour may be vastly different than at 0.5 µm.
The exact answer depends on too many factors, so the answer is: it depends. If you can specify exactly what material the wall is made of, and in what wavelength you are interested, a more precise answer can be given.
For example, for the walls of the Ice Hotel, mid-infrared radiation (10–20 µm or so) is certainly absorbed a lot more than visible light!