Note : I am writing this answer late at night, so I apologize in advance if the explanation is unclear or unnecessarily complicated. I will probably edit it in the future to make it clearer.
$|\phi\rangle $and $|\psi\rangle$ span a subspace of dimension $\leq 2$. We can therefore find a ket $|\tilde \psi\rangle $and angles $\theta,\varphi$ such that $(|\phi\rangle,|\tilde\psi\rangle)$ is orthonormal and :
$$|\psi\rangle = e^{i\varphi}\cos(\theta)|\phi\rangle +\sin(\theta)|\tilde \psi\rangle$$
Then, we have :
$$H|\phi\rangle = g^*e^{i\varphi}\cos(\theta)|\phi\rangle +g^*\sin(\theta)|\tilde \psi\rangle$$
and :
\begin{align}
H|\tilde\psi\rangle &= \frac{1}{\sin(\theta)}H(|\psi\rangle-e^{i\varphi}\cos(\theta)|\phi\rangle) \\
&= \frac{g}{\sin\theta}|\phi\rangle-\frac{g^*e^{i\varphi}\cos\theta}{\sin\theta}|\psi\rangle\\
&= \frac{g}{\sin\theta}|\phi\rangle-\frac{g^*e^{i\varphi}\cos\theta}{\sin\theta}(e^{i\varphi}\cos(\theta)|\phi\rangle +\sin(\theta)|\tilde \psi\rangle) \\
&=\frac{1}{\sin(\theta)}(g - g^*e^{2i\varphi}\cos^2(\theta))|\phi\rangle - g^*e^{i\varphi}\cos(\theta)|\tilde\psi\rangle
\end{align}
If $H$ is to be Hermitian, we need $\langle \phi|H|\phi\rangle = g^*\langle\phi|\psi\rangle= g^*e^{i\varphi}\cos(\theta)$ to be real. This means that $g = e^{2i\varphi}g^*$ and we have :
$$\langle \phi|H|\tilde\psi\rangle =\frac{1}{\sin(\theta)}(g - g^*e^{2i\varphi}\cos^2(\theta)) = \frac{g}{\sin(\theta)}(1-\cos^2(\theta)) =g \sin(\theta) = \langle \tilde\psi|H|\phi\rangle^*$$
as we expect for a Hermitian operator. We also see that $\langle \tilde\psi|H|\tilde\psi\rangle$ is real, so $H$ is Hermitian.
To recap, $H$ is hermitian if, and only if, $g\langle\psi|\phi\rangle \in\mathbb R$.
Edit : Here is a simpler and (hopefully) clearer answer.
First, if $H$ is hermitian, then $\langle \psi|H|\psi\rangle = g\langle\psi|\phi\rangle \in \mathbb R$.
Now, let us assume that this condition holds.Then $(g\langle \psi|\phi\rangle)^*= g\langle \psi|\phi\rangle$ and $(g^*\langle \phi|\psi\rangle)^*= g^*\langle \phi|\psi\rangle$
Take two arbitrary kets :
\begin{align}|1\rangle &= a_0|\psi\rangle + a_1 |\phi\rangle + \sum_{n\geq 2} a_n|\psi_n\rangle\\
|2\rangle &= b_0|\psi\rangle +b_1 |\phi\rangle + \sum_{n\geq 2} b_n|\psi_n\rangle
\end{align}
and compute :
\begin{align}
\langle 1 |H|2 \rangle &= \Big( a_0^* \langle \psi| + a_1^*\langle \phi|\Big)\Big(b_0 g|\phi\rangle + b_1 g^*|\psi\rangle\Big) \\
&= a_0^*b_1g^* \|\psi\|^2 + a_1^*b_0g\|\phi\|^2 + a_0^*b_0 g \langle \psi|\phi\rangle + a_1^*b_1 g^*\langle \phi|\psi\rangle\\
&= \Big[a_0b_1^*g \|\psi\|^2 + a_1b_0^*g^*\|\phi\|^2 + a_0b_0^* g \langle \psi|\phi\rangle + a_1b_1^* g^*\langle \phi|\psi\rangle \Big]^* \\
&= \Big[\Big( b_0^* \langle \psi| + b_1^*\langle \phi|\Big)\Big(a_0 g|\phi\rangle + a_1 g^*|\psi\rangle\Big) \Big]^*\\
&=(\langle 2 |H|1\rangle)^*
&= \langle 1 |H^\dagger\rangle
\end{align}