The moon is bright, and if you were 50 times closer it would be 25 degrees across with the same surface brightness, which would be pretty dazzling. Looking at the moon through a telescope (which increases the apparent size, but can't increase the apparent surface brightness) can certainly be dazzling. So looking at a 25 degree circle of a surface reflecting sunlight at 150 million km from the sun can be dazzling.
But, in the words of Pink Floyd "There is no dark side of the moon really, matter of fact it's all dark." The moon has an albedo of 0.12, about the same as dark soil. So looking at a 25 degree circle of dark soil here on Earth (also 150 million km from the sun) should be just as dazzling as looking at the moon if we were 50 times closer to it. But dark soil looks dark. Why the difference?