Since the velocity vector of an object is always tangent to the path it takes by definition, changes in the magnitude of the vector involve acceleration components also tangent to the velocity vector and hence the path.
Corollary to this, acceleration components not tangent to the velocity vector do not affect the magnitude of the velocity vector, but its direction.
Mathematically if we trace an object along its path, and designate $\boldsymbol{\hat t}$ the tangent vector and $\boldsymbol{\hat n}$ the normal vector (perpendicular) then we can always decompose the velocity vector as
$$ \boldsymbol{v} = v\; \boldsymbol{\hat{t}} \tag{1} $$
where the scalar $v$ is the speed (velocity magnitude).
Not the change in velocity is acceleration and it always decomposes along the two directions as
$$ \boldsymbol{a} = \dot{v}\; \boldsymbol{\hat{t}} + \frac{v^2}{\rho} \;\boldsymbol{\hat{n}} \tag{2} $$
where $\dot{v}$ designates change in speed (linear acceleration) and $\rho$ is the radius of curvature. This radius is an indication of how the direction of velocity changes along the path. It is purely geometric quantity because it removes the dependency of speed (and hence time) from the change in direction.
The smaller the radius, the higher the arc of movement the more rapid the change in direction is. If the radius of curvature is infinite then the second term goes to zero and the body is moving is a straight line but changing speed.