I would start with any good high school or introductory college text on physics. The textbook will not only show you conceptually what is going on, but will, out of neccessity of fulfilling the purpose for which it was written, give you the math along with it.
One caveat to that is that physics will not teach you calculus, and a college-level text will assume some calculus exposure. If you have not had differential and integral calculus, then stick to a high school level textbook, or... take a calculus course (or get the book and self-study).
Any good textbook will be structured to take you through the topics in a logical order. You will encounter free-body mechanics before you get to hydrostatics, hydrostatics before aerodynamics, electricity and magnetism before optics, and etc.
General guide for picking a GOOD text book:
1.) Look for texts which have more than one author (a collaborative effort) and are NOT the first edition. Something that is in its, say, fifth edition, is tested and proven and still in demand: an excellent sign of underlying quality.
2.) Look up community college physics courses on the web and write down what text they use, then surf for book rating comments on Amazon and elsewhere.
3.) Make sure the text book has LOTS of pictures.
4.) Make sure the text book has answers to odd-numbered problems (or answers to even-numbered... whatever) in the book. There is NO better way of verifying you grasped the material than working out a problem. You want to know that you got the right answer; and you have no teacher to go to.