A brief history of the misapplication of magnetohydrodynamics to the analysis of the solar wind:
1959: Soviet satellite Luna 1 directly observed the solar wind for the first time and measured its strength.
http://en.wikipedia.org/wiki/Luna_1
So as of 1959, by direct experimental observation, it was known that the heliopause was at least the radius of the earth or R⊙.
Pneuman and Kopp 1971 Model: According
to a more complex but still simplified
MHD [MagnetoHydroDynamics] model of the coronal structure
(ISP p. 114-117 etc., the model of
Pneuman and Kopp 1971), the dipolar
magnetic field lines form closed loops
if they originate at solar latitudes
of less than about 45° (above or below
the solar equator). However, those
arising greater than about 45° are
open field lines that may curve around
the closed region to some extent but
eventually extend far into space in
all directions, at least beyond a
heliocentric distance of about 2 R⊙.
http://www.mcgoodwin.net/pages/spacephysics_ess471.pdf
(page 36)
This is the only paper I've been able to find that approximately reads on the magnetopause question. This is a highly cited paper and it's early enough to influence the expectations at the Voyager launches (1977). So I believe that the Pneuman and Kopp paper gave the expectation that the heliopaue would be at around 2 R⊙ based on MHD calculations. Since this was a huge error, I've not been able to find any better detail.
The man who developed MHD was Hannes Alfvén. He got the 1970 Nobel prize in physics for this. His Nobel prize lecture was partially dedicated to the task of claiming that his theory was being abused. In particular, he noted that the space physics situation was out of control. From his lecture, I've italicized the parts having to do with space physics predictions:
Plasma physics, space research and the origin of the solar system
[ Nobel Prize Lecture, 1970, by Hannes Alfvén ]
... The cosmical plasma physics of
today is far less advanced than the
thermonuclear research physics. It is
to some extent the playground of
theoreticians who have never seen a
plasma in a laboratory. Many of them
still believe in formulae which we
know from laboratory experiments to be
wrong. The astrophysical
correspondence to the thermonuclear
crisis has not yet come. The reason
for this is that several of the basic
concepts on which the theories are
founded, are not applicable to the
condition prevailing in cosmos. They
are "generally accepted" by most
theoreticians, they are developed with
the most sophisticated mathematical
methods and it is only the plasma
itself which does not "understand",
how beautiful the theories are and
absolutely refuses to obey them. It is
now obvious that we have to start a
second approach from widely different
starting points.
If you ask where the border goes
between the first approach and the
second approach today, an approximate
answer is that it is given by the
reach of spacecrafts. This means that
in every region where it is possible
to explore the state of the plasma by
magnetometers, electric field probes
and particle analyzers, we find that
in spite of all their elegance, the
first approach theories have very
little to do with reality. It seems
that the change from the first
approach to the second approach is the
astrophysical correspondence to the
thermonuclear crisis. ...
http://nobelprize.org/nobel_prizes/physics/laureates/1970/alfven-lecture.pdf
The above lecture includes a table with a detailed comparison between the "first approach" and "second approach".
Conclusion:
The problem in estimating the heliopause was mostly due to theoreticians overestimating their understanding of the limitations of MHD. In particular, the MHD equations fail when electric currents are strong enough to overcome the magnetic field. This breaks the MHD assumption that ions and electrons remain pinned to magnetic field lines.