If I lift a book of mass $m$ from the ground and put it at height $h$,then initial and final energies with respect to ground are 0 and $mgh$ respectively.
So how energy is conserved here?
Repeat lifting books to height h several times per minute for an hour or two, and observe who gets tired.
You do work lifting the book, burning up biological energy stored in ATP molecules in your cells, to activate muscles, which apply some force upward on the book (as well as suffer some internal friction). The biological energy used up is converted into: a lifted book, extra body heat, sweat, and groans of displeasure because such smart people as physicists ought to have butlers to take care of book-placing.
All the chemical energy of food you ate and oxygen breathed, and all those energetic outputs mentioned, should add up perfectly. Physiologists do lab experiments to measure these things with athletes, average people, decrepit oldsters, kids, etc.
you give your muscular energy to book, so when it is in air at $h$ height it is actually having energy $mgh$ given out by your muscles and if you drop that book, the potential energy inside that book will gets converted to kinetic energy slowly and will gain speed. Then the moment before when it reaches ground it has all the energy converted to kinetic energy and after that moment the energy gets transferred to earth. Hence conservation of energy is not violated.