The bump can be observed through an explicit calculation.
If $\it l$ is the angular momentum quantum number of a molecule, then the rotational energy levels are
$$ \varepsilon_\text{rot} = \frac{\hbar^2}{2I}\it l(\it l + 1) = \frac{k\theta_\text{r}}{2} \it l(\it l + 1) \,, \quad \textrm{ where }\quad \theta_\text{r} \equiv \frac{\hbar^2}{Ik} \,,$$
and $I$ is the moment of inertia of the molecule.
Since each $\it l$ is $(2\it l + 1)$-fold degenerate, the partition function over each rotational mode reads
$$
Z_\text{rot} = \sum_{l=0}^\infty (2\it l+1)\exp\left( - \frac{\theta_\text{r}}{2T} \it l(\it l + 1) \right) = \begin{cases}
1 + 3 e^{-\theta_r/T} + 5e^{-3\theta_r/T} + \mathcal O\left( e^{-6\theta_r/T} \right) &\text{for } T \ll \theta_r \,, \\
2\frac{T}{\theta_r} + \frac13 + \frac1{30}\frac{\theta_r}{T} + \mathcal O\left( \left( \frac{\theta_r}{T} \right)^2 \right) &\text{for } T \gg \theta_r \,.
\end{cases}
$$
Using this, we can calculate the contribution to the internal energy per rotational degree of freedom.
$$
E_\text{rot} = NkT^2\frac{\partial}{\partial T}\ Z_\text{rot} = \begin{cases}
3Nk\ \theta_r\left( e^{-\theta_r/T} - 3e^{-2\theta_r/T} + \dots \right) &\text{for } T \ll \theta_r \,, \\
NkT\left(1 - \frac{\theta_r}{6T} - \frac{1}{180}\left(\frac{\theta_r}{T}\right)^2 + \dots \right) &\text{for } T \gg \theta_r \,.
\end{cases}
$$
Therefore, the contribution to heat capacity at constant volume by each rotational mode is
$$
C_V^\text{rot} = \frac{\partial }{\partial T}E_\text{rot} = Nk \begin{cases}
3 \left(\frac{\theta_r}T\right)^2 e^{-\theta_r/T} \left( 1 - 6 e^{-\theta_r/T} + \dots \right) &\text{for } T \ll \theta_r \,, \\
1 + \frac{1}{180}\left(\frac{\theta_r}{T}\right)^2 + \dots &\text{for } T \gg \theta_r \,.
\end{cases}
$$
The above function has a maximum of $1.1\ Nk$ at about the temperature $0.81\ \theta_r/2$. As the temperature is increased way above $\theta_r/2$, it settles down to $1\ Nk$ and we recover the classical flat result.