Let $W$ between two point be defined as: $$W=\int_a^b \vec{F}.\vec{dr}$$
Here $W$ is the work done between two fixed points $a$ and $b$.
Let $U$ at a point be defined as:
$$U_{\text{at } b}=\int \vec{F}.\vec{dr}+ \text{constant}$$
Here is it proper to say that potential energy $(U)$ is the work done between a fixed point $b$ and another arbitrary point. That is, can we say potential energy is work done having many degrees of freedom.