Let's assume I have a theoretical display that can show a different flat picture depending on the viewer's location. It would provide different images to the left and right eyes of a human observer. A classic 3D display that could be constructed using lenticular sheets perhaps.
Now, the display shows a very simple image: a single white pixel. The $(x_1,y_1)$ coordinate of the white pixel shown to the left eye matches the $(x1,y1)$ coordinate of the left eye, and the $(x2,y2)$ coordinate of the white pixel shown to the right image matches the $(x2,y2)$ coordinate of the right eye.
The user's eyes would converge on the dot, and the brain reconstructs a dot seemingly infinitely far away, like a star in the sky. However, unlike the sky, the lens of his eye would need to focus on the screen and not infinity, since the eyes are still looking at a flat screen. If the user had only one eye, this eye would only see a regular screen showing a regular pixel, there would be no parallax information and the focus is definitely on the screen.
Now, let's assume this theoretical screen can support an infinite number of viewers, or eyes, all at the same time, creating a full parallax in both horizontal and vertical direction.
This theoretical screen has now turned into a parallel light source similar to a bright star, casting a hard shadow on objects placed in front of it.
Question: If one were to look at the apparent dot, what distance would one need to focus. Is it still the screen's distance or infinity? What are the conditions?
I have two trains of thought.
I would argue that in the limit and a screen with infinite resolution, the focus point has now moved to infinity. Each pixel emits an infinitesimal narrow beam of light. I should be able to expect to put a lens in front of it and focus the beam to its focus point.
When resolution is limited though, each pixel would send out a narrow light cone, like a narrow spotlight that spreads with distance. The light cones of neighboring pixels would start overlapping at some distance and the point source would be imperfect. In this case, I'm not sure what to expect. If I'm close enough to the screen, I would not expect that I can focus at infinity and still get a sharp picture.
Why I'm asking: There is a Hologram printing service where I can submit (flat) pictures of an object from up to 150'000 viewing angles. They will calculate and print a diffraction pattern at 250um. I'm wondering whether this will only produce a parallax effect, or whether I'll be able to actually focus different depths of the apparent object, get a depth of field effect, and so forth. I am thinking I cannot expect that to happen. I would argue this Hologram cannot be proper in principle. Points that float above or below the surface of the holographic plate will show ghosting artifacts.