First, the more general expression for angular momentum is $\mathbf L=\mathbf r\times\mathbf p$ for a point particle with momentum $\mathbf p$ with a position vector of $\mathbf r$ relative to the point in space the angular momentum is being calculated about. This expression is important because it shows that your statement
If angular momentum is conserved, we can safely assume that as the radius of the mass from the axis of rotation decreases and the mass of the object remains constant, then the speed must increase in order to conserve angular momentum
is false. For example, if the point particle has some non-zero velocity and no forces acting on it its angular momentum will be conserved while $\mathbf r$ changes, yet it's speed is not changing.
However, although it isn't stated, you seem to be considering the scenario where we have circular motion at some radius, and then the radius is decreased to end in circular motion again at a smaller radius. Well then in that case to answer the question
How does the speed increase without the aide of a force in these cases, or is there a force involved which causes this speed to increase?
Yes, the force that causes the radius to decrease will be doing work, which causes the speed to increase.
I will note that many introductory physics problems greatly simplify scenarios like this. For example, if you have circular motion and then suddenly increase the centripetal force you will not just get circular motion at a smaller radius. This is explored somewhat in my answer here.