Normally in differential geometry, we assume that the only way to produce a tensorial quantity by differentiation is to (1) start with a tensor, and then (2) apply a covariant derivative (not a plain old partial derivative). Applying this to GR, I think one way of stating the equivalence principle is that the only tensorial object that we expect to be "built in" to the vacuum is the metric. Since the covariant derivative is basically defined as a derivative that produces zero when you apply it to the metric, this means that you can't get anything of interest (i.e., local and tensorial) by appying the process described by #1 and #2 to the vacuum. This can be used as a fancy way of arguing that the Newtonian gravitational field $\mathbf{g}$ isn't a tensor, since in the Newtonian limit, it's essentially the gradient of the metric.
However, the process described by #1 and #2 is sufficient but not necessary. In fact, one way of defining curvature is by taking non-covariant derivatives on the metric to form the Christoffel symbols, and then doing further operations involving non-covariant derivatives to get the Riemann curvature tensor -- which surprisingly ends up being a valid tensor.
It seems, then, that the Riemann tensor is a special case. I originally thought that there might be a uniqueness theorem that proves that if we want to produce a local, tensorial quantity from the metric, the only possibilities are the Riemann tensor or curvature polynomials formed from the Riemann tensor and its covariant derivatives.
[EDITS] A comment by joshphysics and the answer by BebopButUnsteady helped me to refine this conjecure as follows.
Joshphysics pointed out that things like $g_{ab}g_{cd}$ might be considered trivial counterexamples. I can think of two possible ways of dealing with this:
(1) BebopButUnsteady's answer shows that this is in some sense not a counterexample at all, since the metric itself can be expressed as a Taylor series in terms of the Riemann tensor and its derivatives. If the metric is analytic, and if we're willing to accept infinite series, then this means that there is no information in the metric that isn't recoverable from the Riemann tensor.
(2) What doesn't seem to exist, apart from curvature polynomials formed from the Riemann tensor and its covariant derivatives, is (a) any varying scalar field, or (b) any vector field. (Part b is basically the equivalence principle.)