You are right that there's not much you can do with a single qubit. However it doesn't take many before you can do things that can't be done with classical bits. Here are a few illustrative examples.
Communication
Imagine I make this offer to you and a friend of yours: I will give you each a classical bit, and then you will each give me a classical bit. If the XOR of the bits you give me is equal to the AND of the bits I gave you, you win.
You're allowed to come up with any strategy you want with your friend, but once I give you the bits, you can no longer communicate.
Well it is easy to show that the best you and your friend can hope to achieve is a 3/4 probability of winning. You just take the average over all deterministic strategies.
On the other hand, if only you and your friend each had one qubit, the combined state of which was $$\frac{\left| 00 \right> + \left| 11 \right>}{\sqrt{2}},$$ then you could win with probability $\approx 0.85$.
What I've just described is called the CHSH game. You can also come up with games where classically you can only win with some probability, but quantumly you can win with certainty.
Computation
Let's say you have a problem where you know how to check if a solution is valid, but you don't know how to come up with a solution. The class of problems for which this is the case is called NP-complete.
If you know a solution takes at most $n$ bits to encode, that means there are $2^n$ possible solutions. If you have $n$ qubits, you can put them in an equal superposition of all $n$-bit strings.
Now you can't exactly "check all strings to find a solution" all in one go, but there is something you can do.
When all strings are in an equal superposition, measuring your qubits will give you a completely random string. However, if you can make a circuit which verifies if a given string is a solution, then you can "amplify" the probability that your measurement gives you a solution.
After $\mathcal{O} \left( \sqrt{2^n} \right)$ iterations of the amplitude amplification process, measuring your qubits will give you a solution.
Notice that this works for any problem as long as you can verify an answer. If we didn't have qubits, the "check all $n$-bit strings" approach would take $\mathcal{O} \left( 2^n \right)$ checks.