Hartree-Fock reduces the multi-particle problem to a one-particle one, representing its interaction with the rest of the world as an interaction between the particle and some average (mean) field. This is perhaps less obvious when treating a two-particle system, where both particles appear on an equal footing, but it becomes rather obvious when one is treating a system of N-particles.
Slater determinant is a manifestation of that: it gives an exact wave function for $N$ non-interacting particles, but once the interaction is on, the factorization into single-particle orbitals becomes an approximation.
Remarks: The exchange term may appear unusual in comparison to the usual form of the Coulomb interaction, but it remains a one-particle interaction with the rest. When applying more formal mean field frameworks, e.g., via the Habbard-Stratonovich transformation, both terms appear naturally, on equal footing.
Example: This is not to give a summary of all the mean-field approaches, but just to give an idea why it is natural to call HF mean field. Let us consider a second-quantized electron Hamiltonian with Coulomb interaction:
$$
\mathcal{H} = \sum_{k,\sigma}\epsilon_{k,\sigma}c_{k,\sigma}^\dagger c_{k,\sigma} +
\sum_{k,k',\sigma,\sigma'}V_{k,\sigma;k',\sigma'}c_{k,\sigma}^\dagger c_{k',\sigma'} + \\
\frac{1}{2}\sum_{k,k', k'', k''', \sigma, \sigma'}U_{k, k', k''', k''}c_{k,\sigma}^\dagger c_{k',\sigma'}^\dagger c_{k'',\sigma'} c_{k''',\sigma}
$$
Here the second term is an interaction with an external field, which potentially can be spin-dependent (hence the spin indices). The last term is the usual Coulomb interaction, which we will factorize in a HF manner as
$$
\frac{1}{2}\sum_{k,k', k'', k''', \sigma, \sigma'}U_{k, k', k''', k''}c_{k,\sigma}^\dagger c_{k',\sigma'}^\dagger c_{k'',\sigma'} c_{k''',\sigma} \approx\\
\frac{1}{4}\sum_{k,k', k'', k''', \sigma, \sigma'}U_{k, k', k''', k''}c_{k,\sigma}^\dagger c_{k''',\sigma}\langle c_{k',\sigma'}^\dagger c_{k'',\sigma'}\rangle -
\frac{1}{4}\sum_{k,k', k'', k''', \sigma, \sigma'}U_{k, k', k''', k''}c_{k,\sigma}^\dagger c_{k'',\sigma'} \langle c_{k',\sigma'}^\dagger c_{k''',\sigma}\rangle
$$
here the first term in the last expression is the Hartree term, whereas the last term is the Fock term - they differ just by the order of pairing operators that will be replaced by their mean, i.e.
$$ c_{k',\sigma'}^\dagger c_{k'',\sigma'}\rightarrow
\langle c_{k',\sigma'}^\dagger c_{k'',\sigma'}\rangle
$$
We can further rewrite the Coulomb term as
$$
\frac{1}{2}\sum_{k,k', k'', k''', \sigma, \sigma'}U_{k, k', k''', k''}c_{k,\sigma}^\dagger c_{k',\sigma'}^\dagger c_{k'',\sigma'} c_{k''',\sigma} \approx
\sum_{k,k',\sigma,\sigma'}U^{eff}_{k,\sigma;k',\sigma'}c_{k,\sigma}^\dagger c_{k',\sigma'},
$$
which has the same form as the one-particle potential (external field term). The use of mean and field comes rather naturally in this context and has a clear meaning. Note also that in this formalism there is no really apparent difference between Hartree and Fock terms - they differ by the spin indices, which are necessarily the same in the Hartree term, but even these could be symmetrized, as is done in the classical reference on the field theory methods in condensed matter, although for more detailed derivations of this type and introduction to the second quantization I would recommend more pedestrian Fetter & Walecka. These books however may not call it mean field, which is a term used mainly by the people raised on path integrals, for which a good condensed matter reference is Negele & Orland.