Consider a star of mass $M$ and radius $R$ at a distance $r$ from the supernova. For a back-of-the-envelope estimate, consider how much momentum would be transferred to the star by the supernova. From that, we can estimate the star's change in velocity and decide whether or not it would be significant.
First, for extra fun, here's a review of how a typical core-collapse supernova works [1]:
Nuclear matter is highly incompressible. Hence once the central part of the core reaches nuclear density there is powerful resistance to further compression. That resistance is the primary source of the shock waves that turn a stellar collapse into a spectacular explosion. ... When the center of the core reaches nuclear density, it is brought to rest with a jolt. This gives rise to sound waves that propagate back through the medium of the core, rather like the vibrations in the handle of a hammer when it strikes an anvil. .. The compressibility of nuclear matter is low but not zero, and so momentum carries the collapse beyond the point of equilibrium, compressing the central core to a density even higher than that of an atomic nucleus. ... Most computer simulations suggest the highest density attained is some 50 percent greater than the equilibrium density of a nucleus. ...the sphere of nuclear matter bounces back, like a rubber ball that has been compressed.
That "bounce" is allegedly what creates the explosion. According to [2],
Core colapse liberates $\sim 3\times 10^{53}$ erg ... of gravitational binding energy of the neutron star, 99% of which is radiated in neutrinos over tens of seconds. The supernova mechanism must revive the stalled shock and convert $\sim 1$% of the available energy into the energy of the explosion, which must happen within less than $\sim 0.5$-$1$ s of core bounce in order to produce a typical core-collapse supernova explosion...
According to [3], one "erg" is $10^{-7}$ Joules. To give the idea the best possible chance of working, suppose that all of the $E=10^{53}\text{ ergs }= 10^{46}\text{ Joules}$ of energy goes into the kinetic energy of the expanding shell. The momentum $p$ is maximized by assuming that the expanding shell is massless (because $p=\sqrt{(E/c)^2-(mc)^2}$), and while we're at it let's suppose that the collision of the shell with the star is perfectly elastic in order to maximize the effect on the motion of the star. Now suppose that the radius of the star is $R=7\times 10^8$ meters (like the sun) and has mass $M=2\times 10^{30}$ kg (like the sun), and suppose that its distance from the supernova is $r=3\times 10^{16}$ meters (about 3 light-years). If the total energy in the outgoing supernova shell is $E$, then fraction intercepted by the star is the area of the star's disk ($\pi R^2$) divided by the area of the outgoing spherical shell ($4\pi r^2$). So the intercepted energy $E'$ is
$$
E'=\frac{\pi R^2}{4\pi r^2}E\approx 10^{-16}E.
$$
Using $E=10^{46}$ Joules gives
$$
E'\approx 10^{30}\text{ Joules}.
$$
That's a lot of energy, but is it enough? Using $c\approx 3\times 10^8$ m/s for the speed of light, the corresponding momentum is $p=E'/c\approx 3\times 10^{21}$ kg$\cdot$m/s. Optimistically assuming an elastic collision that completely reverses the direction of that part of the shell's momentum (optimistically ignoring conservation of energy), the change in the star's momentum will be twice that much. Since the star has a mass of $M=2\times 10^{30}$ kg, its change in velocity (using a non-relativistic approximation, which is plenty good enough in this case) is $2p/M\approx 3\times 10^{-9}$ meters per second, which is about $10$ centimeters per year. That's probably not enough to eject the star from the galaxy. Sorry.
References:
[1] Page 43 in Bethe and Brown (1985), "How a Supernova Explodes," Scientific American 252: 40-48, http://www.cenbg.in2p3.fr/heberge/EcoleJoliotCurie/coursannee/transparents/SN%20-%20Bethe%20e%20Brown.pdf
[2] Ott $et al$ (2011), "New Aspects and Boundary Conditions of Core-Collapse Supernova Theory," http://arxiv.org/abs/1111.6282
[3] Table 9 on page 128 in The International System of Units (SI), 8th edition, International Bureau of Weights and Measures (BIPM), http://www.bipm.org/utils/common/pdf/si_brochure_8_en.pdf