Not really. Non-magnetic materials don't produce a net magnetic field, because the magnetism from their individual particles don't align to give substantial total fields, but rather cancel out on average.
But if 'to a varying degree' you're willing to consider ridiculously small attraction forces, then we should consider that this cancellation isn't always perfect. If you have $N$ magnetic particles that can each point up or down (and do so independently of each other, which is a key assumption that won't always hold), then you'll almost never have exactly $N/2$ pointing up and $N/2$ pointing down. On average you'll have an excess of $\sim\sqrt{N}$ particles pointing in one direction or the other, and so there will be a small net magnetic field. This effect becomes bigger for smaller numbers of particles, and is relevant in NMR spectroscopy (where it's called statistical polarization). Thus I suppose there would be a tiny attractive force to any nearby paramagnet.
I should add as a disclaimer that I'm not sure whether statistical polarization would be the dominant contribution in a realistic scenario, but it's one that should be pretty universal.