Brief introduction
In Newtonian mechanics, the correlation between dynamical quantities and geometry was not that eminent. Sure, kinematics used geometry, but dynamics was good enough explained in terms of “forces”. The profound dependence of dynamical quantities with the underlying geometry was not that obvious. Just have a look into Galilean transformation for example
$$
\begin{cases}
t=t'\\
x=x'+Vt'\\
y=y'\\
z=z'
\end{cases}
\tag{1}
$$
It would be interesting if one wrote this in the form
$$ \left(
\begin{array}
&t\\
x\\
y\\
z\\
\end{array}
\right)=
\left[
\begin{matrix}
1&0&0&0\\
V&1&0&0\\
0&0&1&0\\
0&0&0&1\\
\end{matrix}
\right]
\left(
\begin{array}
&t'\\
x'\\
y'\\
z'\\
\end{array}
\right)
\tag{2}
$$
But there is no much symmetry between space and time, and by those times there was no reason to believe that there was anything else there, especially because the absoluteness of time was completely established.
3 years after Einstein’s SR, with its radical changes in the concepts of space and time, Minkowski presented a reformulation of SR in terms of geometric concepts. In fact, most physical quantities seemed to be easily adapted to SR if they were written in the form of a 4-vector, including dynamical ones. An impressive symmetry between space and time transform, made people to believe that there was more in that than a simple coincidence.
Answering to your question
Have a look into the homogeneous Lorentz group:
$$ \left(
\begin{array}
&t\\
x\\
y\\
z\\
\end{array}
\right)=
\left[
\begin{matrix}
-1&0&0&0\\
0&1&0&0\\
0&0&1&0\\
0&0&0&1\\
\end{matrix}
\right]
\left(
\begin{array}
&t'\\
x'\\
y'\\
z'\\
\end{array}
\right)
\tag{3}
$$
There is an astonishing symmetry between time and space here. More importantly, we have already accepted the idea that time was not that special and could change due to speed (position derivative) effects, but not with position itself, hence why not try to generalize this to include positional effects along with speed effects. The natural way to generalize it is by writing
$$ \left(
\begin{array}
&t\\
x\\
y\\
z\\
\end{array}
\right)=
\left[
\begin{matrix}
F_1& F_2& F_3& F_4\\
F_5& F_6& F_7& F_8\\
F_9& F_{10}& F_{11}& F_{12}\\
F_{13}& F_{14}& F_{15}& F_{16}\\
\end{matrix}
\right]
\left(
\begin{array}
&t'\\
x'\\
y'\\
z'\\
\end{array}
\right)
\tag{4}
$$
With $F_i$ being functions of position, time and dynamical quantities plus the condition that (4) should become (3) for small space-time volumes. This is the connection between GR and SR. It generalizes the Lorentz homogeneous group.
Now, it should be noted that Newtonian Gravity was not Lorentz invariant and thus was out of the scope of SR. A Scar in the theory that needed to be addressed and Einstein saw the opportunity to link the form of those $F_i$ by linking then to gravity.
As a final thought, one could consider SR to encompass the changes in physics due to speed (position derivative) and GR as including both changes due to position and its derivative speed.
PS: I used the notation $c=1$ and the metric signature $(-,+,+,+)$.