I have learned that people in the field of machine learning and statistics often use the least squares method. Is there any alternative formulation of the least squares method using entropy? (It might be better to ask if it is related to entropy in physics or information theory.)
Sorry for the very vague question, but when I saw it I got a naive idea that it is kind of similar to what I learned about entropy in some of the Physics courses I took at University.