In this case, thus, you would expect the hinge to exert a force into the rod, because this is normal to the wall. However, there is also a component parallel with the wall?
Why is this?
I think the problem you may be having is thinking the cable can alone support the forces of the weight of the rod and hanging ball. But you also need the sum of the moments about the end of the rod be zero. That can't happen without an upward reaction by the wall. If that is still not clear, read on.
The reaction forces at the wall consist of a normal component because there will be a horizontal leftward force the cable exerts on the rod that needs to be opposed by a horizontal component reaction force of the wall directed rightward.
There also needs to be a vertical upward (parallel) reaction of the wall on the rod that, together with the vertical upward force of the cable on the rod is needed to balance the downward forces of the weight of the rod and the hanging weight ball, as well as needed so that the sum of the moments about the end of the rod is zero.
Do you know how to draw free body diagrams (FBDs)? If you do, do a free body diagram of the rod showing the forces exerted on it by the cable, the wall, its own weight, and the weight of the ball. Take the sum of the moments about the wall and set to zero. Take the sum of the horizontal and vertical forces and set each of them (two equations) equal to zero. That will give you enough equations to determine the normal and vertical (parallel) reaction forces of the wall. If you need help, get back.
Hope this helps.