Basically you miss the fact that full definition of torque is this :
$$ \boldsymbol{\tau} = \boldsymbol r \times \boldsymbol F $$
which is a cross-product of position vector and force vector. By definition cross-product of vectors don't need any proportionality factor or vector scaling, because it's not a simple proportionality statement, but rather a vector operation.
However, there are cases where vector scaling in cross-product is actually needed. For example, one when analyzing angular velocity sees that if we increase position vector, then tangential velocity also increases, so you can't simply state that $\boldsymbol \omega = \boldsymbol r \times \boldsymbol v$, because then $\boldsymbol \omega$ would not be a constant but rather increase too with position vector. Hence to reformulate angular velocity in terms of cross-product scaling is needed (but again, it's not a proportionality factor, just vector algebra here!) :
$$ {\boldsymbol {\omega }}={r^{-2} \cdot ( {\mathbf {r} \times \mathbf {v} }}) $$
HTH !