Why is e useful in quantum mechanics?
Essentially, it is because $e^{ax}$ is an eigenfunction for the $\frac{d}{dx}$ operator:
$$\frac{d}{dx}e^{ax}= ae^{ax}$$
So, as an almost trivial example, it follows from Schrodinger's equation
$$\hat H |\psi\rangle = i\hbar \frac{\partial}{\partial t}|\psi\rangle$$
that an energy eigenstate, with energy eigenvalue $E_n$, can be written as
$$|\psi_n(t)\rangle = |\psi_n(0)\rangle e^{-i\frac{E_n}{\hbar}t}$$
which can be directly checked:
$$\hat H |\psi_n(t)\rangle=i\hbar \frac{\partial}{\partial t}|\psi_n(t)\rangle = i\hbar |\psi_n(0)\rangle \frac{\partial}{\partial t}e^{-i\frac{E_n}{\hbar}t}= E_n|\psi_n(0)\rangle e^{-i\frac{E_n}{\hbar}t} = E_n|\psi_n(t)\rangle$$
As a less trivial example, one can formally solve Schrodinger's equation for an arbitrary state to find
$$|\psi(t)\rangle = |\psi(0)\rangle e^{-\frac{i}{\hbar}\hat H t}$$
Which again can be formally checked:
$$\hat H |\psi(t)\rangle=i\hbar \frac{\partial}{\partial t}|\psi(t)\rangle = i\hbar |\psi(0)\rangle \frac{\partial}{\partial t}e^{-\frac{i}{\hbar}\hat H t}
= \hat H |\psi(0)\rangle e^{-\frac{i}{\hbar}\hat H t} = \hat H |\psi(t)\rangle$$
Now, one might wonder how to interpret an operator valued exponent. However, a simple Taylor expansion yields
$$e^{-\frac{i}{\hbar}\hat H t} = 1 - i\frac{t}{\hbar} \hat H - \frac{t^2}{2!\,\hbar^2}\hat H^2 + i\frac{t^3}{3!\,\hbar^3} \hat H^3 + ...$$
So this operator evolves the state $|\psi(0)\rangle$ to the state $|\psi(t)\rangle$.