The notion "point particle" is coming from classical mechanics, where all fields $F(t,x)$ acting on a point particle, identified by its enumerated center of mass coordinate $x_k$ with momentum $p_k$, can simply expressed as $F(x_k)$ by replacing the field coordinate with the coordinate of the particle passing that point.
Gravitational and electric interactions can be formulated in terms of the kinetic momentum $p_k - \frac{e}{c}\ A(x_k) $ involving corrections to the canonical momentum $p$.
The central entity is the quadratic norm of of the kinetic momentum, aka "mass times transport velocity"
$$(p(x_k)-A(x_k))^2 = G(x_k)((p(x_k)-A(x_k)),(p(x_k)-A(x_k)) )$$
as a simple square, whrere again only the center of mass coordinate $x_k$ determines the gravitational effects at a point in space.
This classical notion of "point particles with no internal structure" is transfered, by the principle of first quantizaton (Heisenberg, Schrödinger, Dirac), to quantum mechanics.
In quantum mechanics, paths of position and momentum in phase space are replaced by position operator
$$X_k: \ f(x_1,\dots,x_n) \to \ x_k \ f(x_1,\dots,x_n)$$
and momentum operator
$$P_k\ f(x_1,\dots,x_n)\to -i \ \partial_{x_k}\ f(x_1,\dots,x_n)$$
and to the astonishment of the public, again the external electric and graviatational fields are pointwise encoded in the square of the momentum operators
$$ G(x_k)(P_k - \frac{e}{c}\ A(x_k)), P_k - \frac{e}{c}\ A(x_k))$$
The states in quantum mechanics can be as diluted or concentrated in space as external field conditions deman, making obsolate all speculations about their the electric field energy of their own charge.
The first step in the interaction of many electrons in these wave functions of many variables, is to eliminate the electric self energy.
The reason for this step is clear: Quantums first priciple since Planck is the energy of photons with fixed frequency
$$ \hbar \omega_k = E_k$$
But the Fourier representation of the static Coulomb field has $\omega_k=0$ for all euclidean modes $k$ with density $\frac{1}{k^2}$. They simply don't take part in the energy exchange game.