In the book Quantum Computation and Quantum Information (Nielsen & Chuang) the section 2.2.4 discusses quantum distinguishability and arrives at the conclusion that if someone were to show me a set of states and give me one of them, I can only tell which one it is if the set is orthogonal. So I came up with a counterexample to this. Let's say we have these two states: \begin{align} |\psi_1\rangle & = \frac{1}{\sqrt{2}}(|0\rangle + |1\rangle)\\ |\psi_2\rangle & = |0\rangle \, . \end{align}
If I make a measurement on the unknown state and the result is the eigenvalue associated with $|1\rangle$, I know with certainty that the given state was $|\psi_1\rangle$, so I was able to distinguish them even though they are not orthogonal. Clearly there's something wrong with my thinking, but I can't tell what it is.