In order to produce neutron-degenerate material, you need to compress matter to roughly $10^{15}$ kg/m$^3$. Unless you do this, then any free neutrons will decay. Thus there does not exist a stable, low-density form of partially degenerate neutron matter.
Stars of course do contain such reservoirs of mass, that in principle it seems that neutron-degenerate material could exist at their centres, with their gravitational field providing the required compression. The problem is however that the cores of stars are not cold.The pressure in the core, required to support the weight of the star, is sufficient to keep the gas at densities far too low to be neutron degenerate. This pressure and temperature can easily be sustained in non-degenerate conditions by nuclear reactions. It is only when exothermic nuclear reactions cease and (neutrino) cooling mechanisms become efficient, that the core can collapse to the required densities at the onset of a core-collapse supernova.
Electron degeneracy as found in white dwarfs requires much lower densities. These conditions are expected to be present in the inert cores of low mass red giant stars, and the cores of brown dwarfs and giant planets that do not sustain nuclear fusion.
In both cases, "small chunks" cannot exist in isolation, because their internal kinetic energy density would be vastly higher than their surroundings. That's a fancy way of saying it would explode. The minimum mass for a "chunk" of stable neutron-degenerate matter is about 0.15$M_{\odot}$. It is smaller for electron degeneracy (e.g. core of a giant planet), but I do not have an exact number.
Further reading: What is the theoretical lower mass limit for a gravitationally stable neutron star?
What would happen to a teaspoon of neutron star material if released on Earth?