There is a somewhat widely accepted argument that the second law of thermodynamics exists because the universe began in a low-entropy state. I'm writing a paper that mentions this (and must be finished today), but I've realised that I don't know who originated this idea. So does anyone know the original reference for this?
Progress
My paper is now submitted, but I'm still curious about the origins of this idea. @Sundak below gives the hint that Boltzmann might have been its originator. Based on this and a bit of searching, I was able to turn up his Lectures on Gas Theory, §90, in which he says "That in nature the transition from a probable to an improbable state does not take place as often as the converse, can be assumed by assuming a very improbable initial state of the entire universe surrounding us...", which sounds very much like the low-entropy big bang idea. However, what he's actually suggesting is that our local region of the Universe had fluctuated into a low-entropy state at some point in the past. He proposes this because he believes the Universe to be infinite in both time and space, implying that the universe as a whole must be in thermal equilibrium. He then goes on to say that at "distances $10^{10^{10}}$ times the distance of Sirius" there might be other civilisations for whom the arrow of time points in the opposite direction. Boltzmann is a fun guy to read. But the idea he's proposing here is not the same as the modern notion that the Universe simply started out in a low entropy state.
Skipping forward many decades, in the abstract for his 1979 paper Singularities and Time's Arrow, Roger Penrose describes the attribution of the second law to the universe's boundary conditions as being part of "the normal point of view". I suspect that the references in Penrose's paper might be a good place to look, but it seems that only the abstract is available online.
So that narrows it down to some time between 1896 and 1979, but probably towards the beginning of that period. It could well be that Boltzmann himself proposed the idea in a different work. If anyone has any further insight it'd be much appreciated.