If I understand your question correctly (based also on your disagreement with the interpretation of the other answers), what you are asking is whether the first galaxies were formed at the particle horizon "outskirts" that delimit the observable Universe at some earlier point or somewhere within the current confines of it. If that is indeed the question, then the answer is the former.
Quantum fluctuations of the scalar field whose potential dictates inflationary expansion (usually called the inflaton $\phi$) during the slow roll regime correspond to physical scales which we may denote as $\lambda$. You may think of $\lambda$ as the "distance" a quantum fluctuation has and thus where it's located in the initial inflationary patch. These scales are subject to inflationary expansion as well, since the quantity $a\lambda$ is the physical wavelength of the perturbation in the comoving frame of reference.
If a certain physical scale $\lambda _{0}$ appears at $N_{0}$ e-folds after the slow roll started, then the physical wavelength by the end will have grown:
\begin{equation}
a(N_{\text{tot}}) \, \lambda _{0} \sim a(N_{0}) \, \lambda _{0} \, e^{N_{tot} - N_{0}}
\end{equation}
where $N_{\text{tot}}$ the total amount of e-folds of the slow roll. If the e-fold difference and initial scale of the fluctuation have an appropriate size so that $a(N_{\text{tot}}) \, \lambda _{0} \gtrsim H^{-1}$ ($H^{-1}$ being the initial - Planckian - size of the particle horizon), then said physical scale crosses the horizon and remains "frozen" beyond it as soon as the crossing occurs. "Frozen" here implies the corresponding (quantum fluctuation) inflaton dynamics become static.
After inflation and the subsequent reheating phase conclude, the observable Universe will keep expanding in a radiation-dominated manner, so the particle horizon $H^{-1}$ which was roughly constant during inflation will begin to increase. As it increased and approached its current size (around $3000 \, Mpc$), physical scales that crossed the horizon during inflation close enough to the end of inflation will be able to cross back in the horizon. Since they are now macroscopic in size, they are imprinted on the spacetime as density perturbations that cause local inhomogeneities. This is precisely the nature of structure formation by which galaxies are formed.
Since in this paradigm of structure formation it is inflation-era quantum fluctuations that are responsible for galaxy formation by crossing out and back in the particle horizon, galaxies are inevitably first formed close to the limits of the observable Universe at each point where a particular crossing occurs.
As an addendum, to make a connection with anna's balloon analogy, you can picture galaxy formation like this: Imagine you have a balloon that begins very small and we're at its surface. During inflation, this balloon remains roughly of equal size, but an "imaginary" balloon space where the current balloon can expand into grows immensely. Our balloon experiences small perturbations on the surface that also grow immensely, so they stop acting as perturbations as soon as they become bigger than the balloon itself; they enter the imaginary balloon space.
At some point this phase ends and our balloon starts inflating at some (smaller) rate. As it inflates and encapsulates more and more of the imaginary balloon space that grew earlier, it "bumps" into those earlier grown perturbations. Upon bumping into them, the density of the balloon changes and structures (your "balloon galaxies") form on the surface.