There is an old question posted (Regularization) which did not get an answer, about the validation of analytic continuation as regularization. It did get some discussion in the comments, referring to Terence Tao's blog T.Tao, but questions seem to remain:
Why is analytical continuation allowed to regulate a diverging sum?
If Tao's article solves this, then where exactly in the text is this proof?
If analytical continuation is allowed, how do we avoid ambiguity?
To start with the last point, it should be clear that we can do this in several ways, for instance with a Taylor series or with a Dirichlet series. Example:
$$ S = 1+2+3\ +... = 1 z^1 + 2 z^2 + 3 z^3 + ... \quad \mbox{for} \ z=1 $$ $$ \ \ \ \ \ \ \ \ \ \Rightarrow S = \lim_{z \uparrow 1} \sum_{n=0}^\infty\ n\ z^n\ = \lim_{z \uparrow 1} \frac{z}{(z-1)^2}\ = \infty, $$ $$ \mbox{or:}\ \ \ \ \ \ S = 1+2+3\ +... = \frac{1}{1^{\mbox{$s$}}}+\frac{1}{2^\mbox{$s$}}+\frac{1}{3^\mbox{$s$}}+... \quad \mbox{for} \ s=-1 $$ $$ \Rightarrow \ \mbox{(by analytical continuation:)} $$ $$ S = \sum_{n=1}^\infty\ \frac{1}{n^s} = \zeta(s)\ = \frac{-1}{12} \quad \mbox{for} \ s=-1, $$ so that does not help. Of course the analytical continuation of a function is unique, but here we see that the choice of the function is not unique. The results are not the same for the Taylor series and the Dirichlet series. We also see that in the second case the analytical continuation ($s\rightarrow-1$) goes far outside the region where the original sum would converge ($\mbox{Re}\ s>1$), whereas in the first case the function is evaluated just at the boundary of the convergence region.
As for the question of physical meaningfulness, in the following I have put together the Casimir effect derivation in two ways. To some extent the results are the same, but it is not clear why the analytical continuation procedure should be reliable.
A) With exponential regularization, we compute the vacuum energy between the plates with: $$\omega = c\ \sqrt{q^2+k_z^2}$$ $$ E = \sum_{k_z=n\pi/a} (2-\delta_{n0}) \int \frac{q\ dq}{2\pi} \ \frac{{\small \hbar}}{\small 2} \ \omega\ e^{-\omega/C} $$ with the $2-\delta_{n0}$ because for $n>0$ we have a TE and TM mode and only a TM mode for $n=0$. This would be the energy per unit area below the piston in this drawing:
provided the area of the piston is very large, so for the $xy$-plane we can use an integral instead of a sum. Putting $\hbar=c=1$ for convenience, let's see how this works out: (for computational procedure see also math problem) $$ E = \sum_{k_z=n\pi/a} (2-\delta_{n0}) \int \frac{q\ dq}{2\pi} \ \frac{{\small \omega}}{\small 2} \ e^{-\omega/C} $$ $$ = \sum_{k_z=n\pi/a} (2-\delta_{n0}) \ \frac1{4\pi} \ \left(2C^3+2C^2 k_z + C k_z^2\right) \ e^{-k_z/C} $$ $$ = \frac{C^3}{2\pi} \ \coth\frac{\pi}{2a C} + \frac C{8a^2} \left(2 a C +\pi \coth \frac{\pi}{2a C}\right) \ \mbox{csch}^2 (\frac{\pi}{2a C}) $$ $$ = \frac{3 a \ C^4}{\pi^2} - \frac{\pi^2}{720\ a^3} - \frac{\pi^4}{5040\ a^5 C^2} + O(\frac1{C^4}) $$ Clearly there's a vacuum energy term proportional to $a$, as expected, but also to $C^4$ so we cannot let the cutoff go to $\infty$. For the force on the bottom of the piston we find: $$ F(a)= \frac {-dE}{da} = \frac{-\pi^2}{16\ a^2} \cdot \frac{2+\cosh(\pi/(2a C))}{\sinh(\pi/(2a C))} $$ $$ = \frac{-3\ C^4}{\pi^2} + \frac{-\pi^2}{240\ a^4} + \frac{\pi^4}{1008\ a^6C^2} + O(\frac1{C^4}). $$ If we then look at the total force and include the force on the top side: $$ F_{\mbox{cas}} = F(a) - F(H-a) = \frac{-\pi^2}{240\ a^4} + \frac{\pi^2}{240\ (H-a)^4} + O(\frac1{C^2}) $$ So this two-sided force is finite even if we let $C$ go to $\infty$. For the energy this was not possible and also not for the one-sided force. Physically this all makes perfect sense.
B) Now if we do this with Zeta regularization, we replace the exponential regulator with $1/\omega^{\ \large s}$, giving: $$ E = \sum_{k_z=n\pi/a} (2-\delta_{n0}) \int \frac{q\ dq}{2\pi} \ \frac{{\small \omega}}{\small 2} \ \omega^{-s} = $$ $$ = \sum_{k_z=n\pi/a} (2-\delta_{n0}) \ \frac{k_z^{3-s}}{4\pi(s-3)} = $$ $$ = \frac{\pi^{2-s} \zeta(s-3)}{2(s-3)\ a^{3-s}} \ \ \rightarrow \ \ \frac{-\pi^2}{720 \ a^3}, \ \ \ \mbox{if} \ s \rightarrow 0. $$ Here we do not have to take any limit to remove the regulator, we can just insert $s=0$ because there is no singularity. And that is exactly the worrying thing! We do not see a very large vacuum energy, becoming even infinite if the regulator is removed. We do not have to go first to the force instead of the energy and then to the two-sided force to get a finite result. It seems to defy the underlying physical picture... Of course for completeness we can still look at the force before setting $s=0$: $$ F(a)= \frac {-dE}{da} = \frac{-\pi^{2-s}}{2\ a^{4-s}} \zeta(s-3) \ \ \rightarrow \ \ \frac{-\pi^2}{240 \ a^4}, \ \ \ \mbox{if} \ s = 0. $$ Again, we get immediately the Casimir force, but not the large force due to volume-dependent vacuum energy, and we do not have to go to the two-sided force to keep the answer finite. So this regularization works fine, but it seems to work too well! It is missing the complications of the other approach, but those were actually natural from a physical perspective...