Due to the laws of gravity and electromagnetic attraction (decreases with $\frac{1}{r^2}$) we know that space should be limited to 3 dimensions.
At the same time we know that gravity bends space. All visualization of that are basically elastic 2D membranes where heavy balls are placed to create "gravity wells" of various sizes. The watcher is left to imagine all that happening with one more dimension and then you've got the way how gravity bends space.
However, the membrane visualization works by distorting the 2D plane into the 3rd dimension. If I go 1 dimension higher, logically 3D space should be distorted into the 4th dimension.
Basically, gravity distorts space into a dimension that shouldn't exist according to the laws of gravity?
Question: where does this logical chain of arguments have a hole?
(Assume I have a lot of popular science knowledge and a background in Mathematics and computer science, but no physics)