To add to what Solomon Slow said, the only way to have a geostationary orbit is if you orbit the Earth at exactly the speed that it rotates, so that you "float" about a single point on the surface. Since the Earth rotates on its axis, this is not possible if you are orbiting on a plane perpendicular to the plane of rotation (a polar orbit).
As you said, you can have a geosynchronous orbit, so that as you orbit around the poles, you'll be flying above the same exact points at the same times each day.
You cannot orbit so that you're just indefinitely "floating" above, say, the North pole.