The core of the issue is that, for unbounded operators $\hat A$, the operator exponential is not defined in terms of the power series $\exp(\hat A) = \sum_{k=0}^\infty \frac{\hat A^n}{n!}$. And it can not be defined that way, as we don't have a guarantee that this series converges.
Instead, we use the spectral theorem to define
$$ \exp(\hat A) = \int \mathrm e^a\, |a \rangle\!\langle a| \, \mathrm da \;, \tag{1} $$
where $|a \rangle\!\langle a| \, \mathrm da$ is the physicist's notation for the projection-valued measure $\mathrm dP_a$.
Crucially, this is the definition used in Stone's theorem on strongly continuous unitary groups.
This means in particular that the time evolution of $|\psi_2\rangle$ is not $|\psi_2(\mathrm dt)\rangle = |\psi_2\rangle - \frac{\mathrm i\, \mathrm dt}{\hbar}\hat H |\psi_2\rangle + \mathcal O(\mathrm dt^2)$ as suggested in the question.
Hence it is not a contradiction that
$$\langle \psi_1 | \hat H | \psi_2 \rangle = 0 \;. $$
Side note: As explained in [Reed, Simon (1981), VIII.3], definition (1) agrees with the power series for the case of bounded $\hat A$.
Further, for all $|\psi\rangle$ that can be written as $|\psi\rangle = \int_{-M}^M |a \rangle\!\langle a|\varphi\rangle \, \mathrm da$ for some $M \in \mathbb R$ and some $|\varphi\rangle$, the power series $\sum_{k=0}^\infty \frac{\hat A^n}{n!} |\psi\rangle$ converges to $\exp(\hat A)|\psi\rangle$ [Reed, Simon (1981), VIII.5].
As mentioned in the answer by mike stone, there is a simpler example demonstrating the same problem.
Let $D(\alpha) = \exp(\mathrm i \alpha \hat p)$ be the translation operator ($\hbar=1$).
Using definition (1), we immediately see that
$$ \langle x | D(\alpha) | \psi \rangle = \int \mathrm e^{\mathrm i \alpha p} \langle x | p \rangle \langle p | \psi \rangle \,\mathrm dp = \langle x+\alpha | \psi \rangle \;. $$
If $\psi$ has compact support, this is obviously different from
$$ \sum_{k=0}^\infty \frac{ \langle x | (\mathrm i \alpha \hat p)^n | \psi \rangle }{n!} = \sum_{k=0}^\infty \frac{ (\alpha \partial_x)^n }{n!} \langle x | \psi \rangle = \sum_{k=0}^\infty \frac{(\mathrm i\alpha)^n}{n!} \int p^n \langle x | p \rangle \langle p | \psi \rangle \,\mathrm dp \;. $$
The latter expression is only correct if we can exchange the order of the integral and the series, as explained also in [Holstein, Swift (1972)].