A formal definition of this can be obtained from wikipedia:
A tensor is an assignment of a multidimensional array $T^{}_{}[f]$ to each basis $f = (e_1, ... , e_n)$ of an n-dimensional vector space such that, if we apply a change of basis $f \rightarrow f \cdot R = (e_iR_1^i, ... , e_iR^i_n)$ then the multidimensional array obeys the transformation law: $$T^{i'_1...i'_p}_{j'_1...j'_p}[f\cdot R] = (R^{-1})^{i'_1}_{i_1}...(R^{-1})^{i'_p}_{i_p}T^{i_1,...,i_p}_{j_1,...,j_q}[f]R^{j_1}_{j'_1}...R^{j_q}_{j'_q}$$
In physics, tensors are sometimes said to be defined by how they transform. In this case, the left hand side is the transformed tensor, and the right hand side is the transformation acting on the initial tensor. If you want to prove that your entity is a tensor using this definition, you need to calculate the change of basis elements (in your case this seems to be a rotation) and show how the tensor components can be related by the transformation according to this definition.
Addendum:
It seems you are working specifically with the Kronecker delta, which makes use of a trick. We want to prove
$$\delta^{i'}_{j'} = \delta^k_l\frac{\partial x_{i'}}{\partial x_k}\frac{\partial x_l}{\partial x_{j'}}$$
Beginning with the RHS, we can write
$$\delta^k_l\frac{\partial x_{i'}}{\partial x_k}\frac{\partial x_l}{\partial x_{j'}} = \delta^k_k\frac{\partial x_{i'}}{\partial x_k}\frac{\partial x_k}{\partial x_{j'}}$$
by definition of the Kronecker delta. Then, we can see that the numerator of the second fraction and the denominator of the first fraction reduce to one. This leaves us with $$\delta^k_l\frac{\partial x_{i'}}{\partial x_k}\frac{\partial x_l}{\partial x_{j'}} = \delta^k_k\frac{\partial x_{i'}}{\partial x_k}\frac{\partial x_k}{\partial x_{j'}} = \frac{\partial x_{i'}}{\partial x_{j'}}$$
Now, since these are coordinates, we can note that this term will be 1 when $i' = j'$ and that it will be zero when $i' \neq j'$. This is the definition of $\delta^{i'}_{j'}$, so we have shown that $$\delta^k_l\frac{\partial x_{i'}}{\partial x_k}\frac{\partial x_l}{\partial x_{j'}} = \delta^{i'}_{j'}$$ as we have set out to show.