An early bit of evidence for the neutron as an uncharged constituent of the nucleus, with approximately the mass of the proton, actually comes from the exclusion principle, and the low-temperature heat capacities and excitation spectra of atomic gases. The argument is a little bit subtle, so you'll have to bear with me.
First, we have the exclusion principle for electrons: the probability of finding two different electrons in exactly the same quantum-mechanical state is zero. This is accomplished in the mathematics of quantum mechanics by demanding that electron wavefunctions be "antisymmetric under exchange." That is, if I have my "first" electron in some state $\left|a\right>$, and my "second" electron in some state $\left|b\right>$, then my total wavefunction must be (up to an irrelevant constant)
$$
\left|\text{total}\right> =
\left|a\right>_1 \left|b\right>_2
-
\left|b\right>_1 \left|a\right>_2
$$
This construction has two effects.
First, if someone else comes along and labels the "first" and "second" electrons differently --- or, if they swap places --- then the wavefunction $\left|\text{total}\right>$ changes sign. This is what's meant by "anti"-symmetry. Second, if the two states $\left|a\right>$ and $\left|b\right>$ are the same, then the wavefunction $\left|\text{total}\right>$ is identically zero. This is the "exclusion" part: there is simply no permitted description of two electrons in the same state.
Now, what other particles obey the exclusion principle? The hydrogen molecule, $\rm H_2$, is a nice system, because it is made only of electrons and protons. The molecule is a rotor whose energy is determined by the angular momentum quantum number $L$. The total nuclear spin, $S$, doesn't have much effect on the energy because the interaction between the two proton spins is quite feeble; this feebleness also makes the protons' total spin quite stable against changes in temperature of the gaseous phase of the material.
There are four ways for the proton spins to combine (again ignoring a normalization constant):
\begin{align}
\text{antisymmetric: }
\left|S=0\right> &= \quad \left| \downarrow\uparrow \right> - \left| \uparrow\downarrow \right>
\\
\text{symmetric: }
\left|S=1\right> &= \left\{
\begin{array}{c}
\left| \uparrow\uparrow \right> \\
\left| \downarrow\uparrow \right> + \left| \uparrow\downarrow \right> \\
\left| \downarrow\downarrow \right> \\
\end{array}
\right.
\end{align}
Since there are three times as many ways to be symmetric, we expect that hydrogen gas at high temperature will eventually have about 75% of its molecules in the symmetric $S=1$ state.
Under exchange symmetry, states with even $L$ are symmetric, while states with odd $L$ are antisymmetric. If the proton obeyed the exclusion principle, our argument about overall antisymmetry would suggest that hydrogen molecules with $S=0$ should only have even $L$, and molecules with $S=1$ should only have odd $L$, so that every hydrogen molecule is antisymmetric under exchange. And this is in fact what we see. In the excitation spectra of warm hydrogen gas, the transitions between states with odd $L$ are about three times more common than transitions between states with even $L$, and transitions which change $L$ from odd to even or vice-versa are missing. However, when you liquify hydrogen all the molecules will try to enter the $L=0, S=0$ "parahydrogen" ground state (a transition which releases nearly as much heat per molecule as the heat of vaporization), and recently-liquified warm hydrogen gas undergoes only the even-$L$ transitions. This distinction between parahydrogen and "orthohydrogen" (the $S=1$, odd-$L$ component) was the first evidence that protons, like electrons, obey the exclusion principle. (The spin-statistics theorem came later.)
So let's consider a model where
- electrons obey the exclusion principle
- protons obey the exclusion principle
- the neutron is an electron-proton bound state, which is distinct from the neutral hydrogen atom for reasons unspecified.
Right away we see that the neutron must have a different behavior under exchange symmetry than the electron or proton. If exchanging two electrons makes a wavefunction change sign, and exchanging two protons makes a wavefunction change sign, then exchanging two neutrons must make the wavefunction change sign twice --- that is, no change at all! Such a neutron therefore doesn't obey the Pauli exclusion principle. We can use this information to predict the behavior of the other lightweight diatomic gases:
molecules of oxygen (with an even number of protons) should be symmetric under exchange, and the even-$L$ spectrum should dominate over the odd-$L$ spectrum. The model gets this one right: in fact, in $\rm O_2$ molecules the odd-$L$ spectrum is completely missing, consistent with the oxygen nucleus having total spin zero.
molecules of fluorine (with an odd number of protons) should be antisymmetric under exchange, and like hydrogen should have more odd-$L$ transitions than even-$L$. The model gets this one right, too: the fluorine nucleus has spin $\hbar/2$, like the lone proton.
molecules of nitrogen (with an odd number of protons) should be antisymmetric under exchange, and like hydrogen should have more odd-$L$ transitions than even-$L$. Here we are in trouble: reality is the other way around, and the statistics are consistent with the nitrogen nucleus having a spin of $\hbar$.
The contemporary explanation, of course, is that the electron-proton neutron model is wrong: the neutron has spin $\hbar/2$, obeys the exclusion principle, and the exchange symmetry of a nucleus depends on whether the number of nucleons is odd or even, rather than the number of protons alone. Of course neutrons had to be produced before they could be said to have been "discovered," but the need for a neutral nucleon obeying the exclusion principle was already established.
At this point you might like to backpedal and wonder whether the neutron is a metastable bound state of the proton, electron, and antineutrino. But that opens you up to a whole flurry of other questions. Why not a proton and a negative pion? Why are any nuclei stable against beta decay? Can such a model predict (as the standard model does) rates of beta decay and cross sections for neutrino capture? Why is the neutron's size comparable to the proton's size, given the uncertainty in the momentum for its lightweight bound constituents? Why can neutron-nucleus interactions near beta-decay energies trigger strong and electromagnetic interactions, but can't trigger weak interactions? The list goes on and on.