Would a magnet attract a paperclip indefinitely? Let's say we have a magnet stuck to a metal bar, suspended above the ground. If I attach a paperclip to the magnet, where is the energy to hold the paperclip coming from (against the force of gravity), and for how long will the paperclip remain there - will it remain there forever?
 A: When the magnet attracts and moves the paperclip, moving it in the gravitational field of the earth, the energy comes from the potential energy that [in that case] we can associate to the magnetic field.
By attracting the paperclip you increase the gravitational potential energy of the paperclip but you reduce the one it has due to the magnetic field.
You do not need energy to hold the paperclip. As an analogy: when you hold something in your hands, you feel like you are "working" even in a static case; but in mechanics, work = exchange of energy is defined as $W = \int \vec{F} d\vec{s}$. 
When the situation is stationary, no energy exchange is involved, no force does no work at all, so it can stay forever.
A: The paperclip is not moving relative to earth - this means that no energy is being spent by magnet to hold it, so it can hold the paperclip as long as the magnet has magnetic properties.
As a contrast, when you hold something with your hands, energy is being spent by your muscles not to hold the object, but to remain contracted against gravity. This is because natural state of muscle cells is to be stretched or contracted as gravity tells them to, not against it.
By analogy, electromagnet spends energy not to hold things, but to to have magnetic properties, because its natural state is not magnetic. So natural magnet does not spend any energy, since its natural state is being magnetic.
