Yes. In mathematics, the symbol $f'$ means
$$ f'(x) = \frac{{\rm d}f}{{\rm d}x} = \lim_{\epsilon\to 0} \frac{f(x+\epsilon)-f(x)}{\epsilon} $$
This notation using ${\rm d}$ was introduced by Leibniz; the notation with the prime was introduced by Lagrange.
You also ask whether there is some problem with noncommutativity. There is absolutely nothing noncommutative in the integrals you write down. They're integrals with ordinary functions and their derivatives. The only objects that don't commute in quantum mechanics are observables i.e. operators such as $\hat x$ and $\hat p$.
However, the derivative $\psi'$ isn't really an operator. More precisely, it is proportional to the operator $\hat p$ acting on the wave function $\psi$ but $\psi$ isn't an operator so you can't really move it to the left side from the derivative.
If we have things like $V'(x)$ in quantum mechanics, the derivative of the potential energy, then the potential energy $V(x)$ may be interpreted as an operator. Then $V'(x)$ may be rewritten as
$$ V'(x) = [\frac{\rm d}{{\rm d}x},V(x)] = \frac{i}{\hbar} [\hat p,\hat V(x)] $$
However, when we choose the explicit integrals over $x$ etc., they always mean the operations with ordinary commuting functions as they do in the calculus. One only has noncommuting objects when we write the actions of the operators more abstractly, in a way that doesn't depend on the representation of the wave function.