The information you are given, i.e. $l=2$, tells you that the operators $L_x$, $L_y$, $L_z$ can be represented as 5x5 matrices, which operate on a vector space spanned by the five vectors
$$\{|2,-2\rangle,|2,-1\rangle,|2,0\rangle,|2,1\rangle,|2,2\rangle\}$$
which can be represented, for example, by one of the most natural bases:
$$|2,-2\rangle\stackrel{\cdot}{=}\left(\begin{array}{c}
1\\
0\\
0\\
0\\
0
\end{array}\right),|2,-1\rangle\stackrel{\cdot}{=}\left(\begin{array}{c}
0\\
1\\
0\\
0\\
0
\end{array}\right),|2,0\rangle\stackrel{\cdot}{=}\left(\begin{array}{c}
0\\
0\\
1\\
0\\
0
\end{array}\right),|2,1\rangle\stackrel{\cdot}{=}\left(\begin{array}{c}
0\\
0\\
0\\
1\\
0
\end{array}\right),|2,2\rangle\stackrel{\cdot}{=}\left(\begin{array}{c}
0\\
0\\
0\\
0\\
1
\end{array}\right)$$
$L_z$ is easy because in this basis is diagonal by definition, and it would be represented by
$$L_z\stackrel{\cdot}{=}\left(\begin{array}{ccccc}
-2 & 0 & 0 & 0 & 0\\
0 & -1 & 0 & 0 & 0\\
0 & 0 & 0 & 0 & 0\\
0 & 0 & 0 & 1 & 0\\
0 & 0 & 0 & 0 & 2\\
\end{array}\right)$$
On the other hand, the two operators $L_+$ and $L_-$, defined as
$$L_\pm=L_x\pm iL_y$$
are then represented by
$$L_-\stackrel{\cdot}{=}\hbar\left(\begin{array}{ccccc}
0 & 2 & 0 & 0 & 0\\
0 & 0 & \sqrt6 & 0 & 0\\
0 & 0 & 0 & \sqrt6 & 0\\
0 & 0 & 0 & 0 & 2\\
0 & 0 & 0 & 0 & 0\\
\end{array}\right),\quad
L_+\stackrel{\cdot}{=}\hbar\left(\begin{array}{ccccc}
0 & 0 & 0 & 0 & 0\\
2 & 0 & 0 & 0 & 0\\
0 & \sqrt6 & 0 & 0 & 0\\
0 & 0 & \sqrt6 & 0 & 0\\
0 & 0 & 0 & 2 & 0\\
\end{array}\right)$$
So, inverting the definition, $L_x=\frac12(L_++L_-)$ and $L_y=\frac12(L_++L_-)$, one can build the matrices corresponding to
$$\hat O_1 =\frac35 L_x-\frac45 L_y$$
and
$$\hat O_2 = 2L_x-6L_y + 3L_z$$
and calculate the eigenvalues by merely cranking the math, either:
- manually;
- using some software;
- using some trick that I'm not able to see now;