Point charges are mathematical abstractions. Real charges have a finite radius. Even for an object as small as an electron, there is some distance from the centre at which the inverse square law breaks down.
Consider the gravitational potential of a spherical distribution of mass, which is analogous to an electrical charge.
From outside of the sphere it can be regarded as a point mass, with all of the mass concentrated at the centre - see Shell Theorem. But even a sphere of dense matter has a finite radius, and inside that radius the gravitational potential does not continue to increase. The Shell Theorem tells us that inside the sphere the force of attraction is proportional to the mass within our current distance from the centre. For a sphere of uniform density, this force decreases linearly, resulting in a finite potential at the centre.
For a spherical shell, with all the mass concentrated at the surface, the Shell Theorem tells us that the gravitational attraction is zero inside the shell. Then the potential everywhere inside is the same as at the surface.
If the point charge is a spherical conductor or shell, this is equivalent to the gravitational shell : the potential everywhere inside is the same as at the surface. If charge is distributed uniformly throughout a sphere, then the electrical potential will continue increasing towards the centre, but not according to $1/r$.
Potential due to uniform sphere shows that for a uniform distribution of mass or charge, the potentials outside and inside the sphere are given by
$$V(r \gt a)=\frac{a}{r}V_0$$
$$V(r \le a)=\frac{3a^2-r^2}{2a^2}V_0$$
where $V_0$ is the potential at the surface $(r=a)$. Thus the potential at the centre is $\frac32 V_0$.