A Newtonian fluid is by definition one where the shear stress $\sigma(t)$ at time $t$ is linearly proportional to the strain rate $\dot{\gamma}(t)$ at the same time, i.e.,
$$\sigma(t) = \eta \dot{\gamma}(t)$$
where $\eta$ is the fluid viscosity. Any fluid that does not obey this behavior is a Non-Newtonian fluid.
A class of non-Newtonian fluids are viscoelastic. This means that the fluid displays both elastic (solid-like) and viscous (liquid-like) behavior. If you further look at the regime where the stresses and strain rates are "small", then you get a linear viscoelastic material. A simple model of linear viscoelasticity is the Maxwell model
$$\frac{d\sigma(t)}{dt} = -\frac{\sigma(t)}{\tau} + \frac{\eta}{\tau} \dot{\gamma}(t)$$
where $\tau$ is the stress relaxation time. For $t\gg\tau$, we get $\sigma(t) \sim \eta \dot{\gamma}(t)$ whereas for $t\ll\tau$, we find that the stress is proportional to the strain, i.e., $\sigma(t) \sim E \, \gamma(t)$ where $E=\eta/\tau$ is an elastic modulus.
This means that if you probe the material at short times, like punching it, it behaves like an elastic solid. However on longer timescales, the material flows like a liquid in response to an applied stress, like dipping your hands in slowly. Do also read about (and, if possible, play with) the silly putty.
In principle, all materials display viscoelastic behavior. It is the value of $\tau$ which governs the kind of response you see in a certain time. For water $\tau \sim 10^{-12} s$ whereas for glass $\tau \sim 10^{32}$ years. For non-Newtonian fluids, like the silly putty, $\tau$ is commensurate with our attention span and so it will bounce as well as flow before human patience runs out.