EDIT [for aptness of this question to this site, read 'real world applications' as 'applications in Physics']
The concept of function (of the form $f : \mathbb{R} \to \mathbb{R}$ ) has been used in various real world applications of Mathematics. In almost all of the applications the general consideration such as approximating a given function with another function is viewed through a lens of mean square error or one of several other such very similar metrics.
My question is concerning the use of functions which have singularities. I've heard from some Physicists that the use of such functions is just a matter of mathematical taste as such functions could be easily approximated with smooth functions and hence the choice of using such functions is just a matter of mathematical taste and it wouldn't make any conceptual difference. I tend not to agree with such an argument because it all depends on the lens of approximation that is being used. If we do not use the metrics like the ones mentioned above then it could be different. A function which contains singularities is fundamentally conceptually different from a smooth function which approximates it no matter how good the approximation is.
So my question is, are there any applications of Mathematics in which functions with singularities are used not just as a matter of mathematical taste but for conceptual reasons ?
