For a lack of better word, I used growing and shrinking in the question, but what I really mean is: Are objects that are now in the observable universe passing getting out of range in the future, or are objects that are now outside of the observable universe ever come close enough to pass over into the observable universe? Or both?
Is the number of objects in the observable universe growing or shrinking due to "migration"?