We certainly would, or at least we would if we had telescopes powerful enough. However, better still, we could choose to watch its history unfold at an arbitrarily high fast-forward rate! Suppose our universe were classical/Newtonian/Galilean (or whatever you want to call it) but with a finite speed of light propagation (and let's just say that we're still unable to travel faster than light in this hypothetical world). Then, by the good old Doppler effect, we would receive the photons coming from this star faster than they were emitted. How much faster? Well, suppose we were travelling towards the star at approximately the speed of light. The photons would be travelling towards us at the speed of light, and so by Galilean relativity (which isn't correct, note!) the photons would be arriving at us twice as quickly as they were emitted. Hence we would receive a pleasant 2X FF. This is consistent: if our planet is $x$ light years away from the star in question, then we would (from Earth) be seeing the star $x$ years ago. Then, if we hurtled towards it at the speed of light, the time taken to get there would also be $x$ years, and by the time we arrived, we should both be 'in the present', so to speak. Hence we must be catching up by one year per year, which corresponds to a 2X fast-forward.
But this isn't the universe we live in! We live in a universe governed, to the best of our knowledge, by Einstein's relativity. In our case, since we're mostly concerned with a journey through deep space (where gravity is negligible) we want the theory of special relativity. This theory tells us that as we get to faster and faster speeds relative to a given object, that object becomes contracted in length (along the direction we're travelling) and time runs more slowly for it. These are very strange results indeed --- what is their implication? Well, as we approached the speed of light, the distance between this far away star and our spaceship would contract. In fact, it would contract to an arbitrarily small distance as we got arbitrarily close to the speed of light. Consequently we could get to the star in not years, but in practically no time at all!
From the star's perspective it works like this: the star sees a spaceship travelling at almost the speed of light towards it. The near light-speed relative velocity entails that to the star, time is running particularly slowly aboard the spaceship --- by the time we get very, very close to the speed of light, time has almost halted to a stop, from the perspective of the star. So by the point of our arrival, very little time has passed aboard our spaceship.
What this means is that (for one, it means that with enough energy, we can get to basically anywhere in the universe within our lifespans) it now takes us only a short length of time to reach the star, but in that time we must have caught up those $x$ years that the star was 'in the past', from Earth's perspective. If we did the journey in $x/2$ years, say, we would be watching the star at a fast-forward rate greater than 2X. Faster still and we could watch the star's history unfold in a matter of mere days, or minutes.