To elaborate on Qmechanic's answer, and on Leo L. comment :
Are they different kinds of "infinity" at 𝑥=0?
Yes, there are different kinds of infinity for a potential, and different kinds of zero width.
It all comes down to taking a rectangular potential wall of small thickness $\epsilon$ and of large value $V(\epsilon)$ within the thickness, zero potential outside.
Then you take the limit for $\epsilon$ goes to zero.
I haven't yet told you what $V(\epsilon)$ is, except that is goes to infinity when $\epsilon$ goes to zero.
If I choose, for instance $$V(\epsilon) \propto 1/\epsilon^2$$
so the product $\epsilon V(\epsilon)\propto 1/\epsilon$ goes to infinity when $\epsilon$ goes to zero, this is Qmechanic's third case.
The infinite of the potential is "stronger" than the "zero" of the width.
There will be no quantum tunneling.
This will also be the case for $V(\epsilon) \propto 1/\epsilon^3$, $V(\epsilon) \propto 1/\epsilon^4$, etc. or even $V(\epsilon) \propto 1/\epsilon^{3/2}$, $V(\epsilon) \propto 1/\epsilon^{4/3}$, etc.
Contrariwise, I choose, for instance $$V(\epsilon) \propto 1/\epsilon^{1/2}$$
so the product $\epsilon V(\epsilon)\propto \epsilon^{1/2}$ goes to zero when $\epsilon$ goes to zero,
or $V(\epsilon) \propto 1/\epsilon^{1/3}$, $V(\epsilon) \propto 1/\epsilon^{1/4}$ or even $V(\epsilon) \propto 1/\epsilon^{2/3}$, $V(\epsilon) \propto 1/\epsilon^{3/4}$, then we are in Qmechanic's first case : the particle does not "see" the infinite potential, because this infinite is "weaker" than the zero value of the width. It will behave as a free particle, despite the infinite potential.
Finally if $$V(\epsilon)= A/\epsilon$$ so that the product $\epsilon V(\epsilon)$ is the constant $A$, this is Qmechanic's second case, quantum tunneling is present.
So it really boils down to the fact that there are different infinities....