As an alternative, if you really need to see the nuts and bolts in detail, the flux through the bottom face at finite $\delta$ and $L$ can actually be calculated exactly. This is most easily done in cartesian coordinates, which gives a few square roots in the denominator but nothing to be too scared of. Start, then with the following representation: \begin{align} \Phi &=\int_S \mathbf E\cdot\mathrm d\mathbf a = \int_{-\delta}^{L}\mathrm dx \int_{-\delta}^{L}\mathrm dy \frac{\frac{q}{4\pi\epsilon_0}(x,y,-\delta)\cdot(0,0,-1)}{ \left\|(x,y,\delta)\right\|^{3/2} } \\ & = \frac{q\delta}{4\pi\epsilon_0} \int_{-\delta}^{L} \int_{-\delta}^{L} \frac{\mathrm dx\:\mathrm dy}{ \left(x^2+y^2+\delta^2\right)^{3/2} }. \end{align} Here we use the fact that the inner integral is perfectly doable: $$ \int \frac{\mathrm dx}{ \left(x^2+\alpha^2\right)^{3/2} } = \frac{x}{\alpha^2\sqrt{x^2+\alpha^2}}. $$ Putting this into the above, we get \begin{align} \Phi &= \frac{q\delta}{4\pi\epsilon_0} \int_{-\delta}^{L} \left. \frac{x}{ (y^2+\delta^2)\sqrt{x^2+y^2+\delta^2} } \right|_{-\delta}^{L} \mathrm dy \\ & = \frac{q\delta}{4\pi\epsilon_0} \int_{-\delta}^{L} \left[ \frac{L}{ (y^2+\delta^2)\sqrt{y^2+L^2+\delta^2} } +\frac{\delta}{ (y^2+\delta^2)\sqrt{y^2+2\delta^2} } \right] \mathrm dy. \end{align} Similarly, this integral is also perfectly doable: $$ \int \frac{\mathrm dy}{ \left(y^2+\alpha^2\right)\sqrt{y^2+\beta^2} } = \frac{1}{\alpha\sqrt{\beta^2-\alpha^2}} \arctan\left( \frac{ \sqrt{\beta^2-\alpha^2}y }{ \alpha\sqrt{\beta^2+y^2} } \right) . $$
The result is then a bit messy, but you have an explicit form. In particular, then, you have \begin{align} \Phi &= \frac{q\delta}{4\pi\epsilon_0} \left[ \frac{1}{\delta} \arctan\left( \frac{ L y }{ \delta\sqrt{L^2+\delta^2+y^2} } \right) + \frac{1}{\delta} \arctan\left( \frac{ y }{ \sqrt{2\delta^2+y^2} } \right) \right]_{-\delta}^{L} \\ & = \frac{q}{4\pi\epsilon_0} \left[ \arctan\left( \frac{ L^2 }{ \delta\sqrt{2L^2+\delta^2} } \right) + \arctan\left( \frac{ L }{ \sqrt{L^2+2\delta^2} } \right) \right.\\ & \qquad \qquad \quad + \left. \arctan\left( \frac{ L }{ \sqrt{2\delta^2+L^2} } \right) + \arctan\left( \frac{ 1 }{ \sqrt{3} } \right) \right]. \end{align}
This is nice because it's valid for all finite $\delta$ and $L$, but what we're interested in is the limit of this thing as $\delta/L\to 0$, so in that spirit it's best to rephrase it as
\begin{align} \Phi &= \frac{q}{4\pi\epsilon_0} \left[ \arctan\left( \frac{ L/\delta }{ \sqrt{2+\delta^2/L^2} } \right) + 2\arctan\left( \frac{ 1 }{ \sqrt{1+2\delta^2/L^2} } \right) + \arctan\left( \frac{ 1 }{ \sqrt{3} } \right) \right] \\ & \to \frac{q}{4\pi\epsilon_0} \left[ \arctan\left( \frac{ \infty }{ \sqrt{2+0} } \right) + 2\arctan\left( 1 \right) + \arctan\left( \frac{ 1 }{ \sqrt{3} } \right) \right] \\ & = \frac{q}{4\pi\epsilon_0} \left[ \frac{\pi}{2} + 2\frac{\pi}{4} + \frac{\pi}{6} \right] = \frac{q}{4\pi\epsilon_0} \times \frac{7\pi}{6} = \frac{7}{24} \frac{q}{\epsilon_0} . \end{align}
Of course, this agrees with the intuitive result from above (and, even more nicely, each term in that final sum has a direct and equal counterpart in the geometric decomposition from above).