I happened to look upon a section of Yakov Perelman's Physics for Entertainment, part I, the author was discussing the relation with distance from centre of earth, and the attraction.
When $d>r_{earth}$, his arguement matches with my intuition, that attraction decreases. The case is baffling when $d < r_{earth}$ - he argues that the weight would be still less than one on the surface, as there would be attraction from all sides.
He writes:
This is because now he earth's attracting forces no longer act just on one side of body, but all around it. (The picture) shows you the weight in the well; it's pulled down by the forces below it and simultaneously up by the forces above it.
And provides this picture:
I am not sure about this, (I made some crappy (possibly wrong) thought experiments; and the results were contrary to this); Is Perelman right here ? What is the "Upward attraction"s ? [1]: https://i.sstatic.net/fqmP8.jpg