If I take three consecutive measurements $T_0$, $T_1$, $T_2$ at equal intervals, I can end up with two (Newton’s law of cooling) equations where the $e^{-kt}$ term is the same.
$$T_{n+1} = T_{outside} + (T_n - T_{outside}) × e^{-kt}.$$
So, without knowing the temperature constant of the building, can I calculate the outside temperature?
$$T_{outside} = \dfrac{T_0 × T_2 - T_1^2}{T_2 + T_0 - 2T_1}.$$
Have I missed something? Or is this really possible? (Provided no other sources of cooling and heating)