How would we perceive time going backwards? I haven't taken Physics in University. Lately, I've been reading about some of the branches of physics through Wikipedia.  I read several times that many of the theoretical models do not explain why time only moves forward.  And that the theoretical models support the ability for time to move backwards.  
I'm having difficulty understanding what happens to human consciousness when time moves backwards.   I can "perceive" time going forwards.  I am learning something every day, new neural connections are forming every moment in my brain.  If time moves backward, do I "forget" what I've learned because my neural connections are deconstructed?  All the electro-chemical reactions in my brain/body will proceed in opposite direction? 
I can't tell if I'm asking a philosophical, biological or physics question...
Addition — Maybe part of the answer I'm looking for is whether the universe is deterministic going forwards in time and backwards in time.  E.g. Just because I accidentally spill a cup of milk, when time is moving forwards doesn't necessarily mean that same milk will pour back into the cup when time moves backwards?
 A: This is really philosophy not physics, and if anyone objects to this being discussed here I'll happily delete this answer. Still, it's an interesting question that I bet many of us have discussed in those late night post drinking discussions that physics students are prone to.
Suppose I manage to write an AI program that emulates you (well enough to pass a Turing test) then this program would have the same sense of time passing that you do. However, unlike you, the program is running on a computer driven by a clock. Suppose at some point I stop the clock but preserve the internal state of the computer, then some time later I start the clock again. What would the AI experience? Well, it might notice that things in the outside world suddenly jumped, but it could have no sense of time having stopped because as far as the execution of the program is concerned its time is controlled by the computer clock not time in the outside world. Similarly I could run the computer clock slow or fast and although the AI may notice the outside world speeding up or slowing down, but it would still think time was flowing normally.
The point of the above is that the time for the AI is controlled by a clock register in the PC and is unrelated to external time. So, and this is the step some won't agree with, if I run the program in reverse the AI would still experience time flowing forward as normal.
Now if you think the above makes sense, and if you accept that you're basically a (somewhat squidgy) machine, the same must apply to you. In other words you can't tell whether time is flowing backwards, forwards, jerkily or whatever unless there is some aspect of the outside world you can use as a reference. If time flows at the same rate (whatever direction/rate that is) everywhere then there is no external reference.
The model of an AI on a computer can be pushed further. Suppose at some point I stop the computer clock then transfer the computer state to a different computer and start it again (note that the VMWare VMotion product can do exactly this), what would the AI experience? Again the answer would be nothing without some external reference. Suppose I take this to the extreme and at every tick of the computer clock I transfer the machine state to a new computer. From my previous argument the AI still couldn't notice anything, but now what do we mean by time when none of the computer clocks are actually ticking?
A computer has a finite number of possible states, so suppose I gathered together that many computers and set one to each possible state. Haven't I ended up with the same as I got by moving the AI program at each clock tick? If so does that mean my AI program is running somewhere in my collection of computers even though there is no concept of time? Or maybe every possibly AI is running somewhere in my collection of computers.
Turn this analogy into a phase space, and maybe the universe doesn't need time to flow at all, despite what we AIs might think :-)
A: Time moving forward or backward is a human convention. By convention we count the flow of time in the positive axis, but you can chose a different convention. Imagine a clock where the figures are interchanged, and the motion of the hands is 9->8->7->6->5... Nothing changes in nature. In particular the electro-chemical reactions in your brain/body do not care about the conventions that you use.
Your appeal to the milk in the cup seems to suggest that you are really asking about irreversibility. This is sometimes named the arrow of time, but the name is misleading because time flows in the same direction for a given process A-->B and for its inverse B-->A.
As explained in quantum mechanics textbooks, the evolution of the universe is not deterministic except as approximation. Universe is stochastic and "future is not given".
A: I will only say something out of my own feelings, thinking and my own believes.So forgive me if it seems to be a drift from the topic.Let me first of all make it clear what I think an event in time is.The process of thinking is a real event because something really takes place in our mind(real particle and energy movements).In my own experiences I noted several times that I was there when I was 3,10 or 20 years old(I am 60 now).There are occasions when this real feeling and those circumstances in the past captured me for several days giving me a feeling of fresh memories,like fragrances etc while I forgot everything about present and future worries or plans.What all this means then?The time went backwards as a real event inside my mind.This proves a small point but still giving rise to a possibility of backward motion of time which is a hint for a real situation somewhere, where forces against that kind of backward time are less than they are here around us. We are living in a time and place where forward push of time is dominating somehow.And who says past is fixed?History also keeps on changing.The events of history are stored like words in a dictionary and for a given time we choose few events to describe "true history" in the same way as an expert novelist can write a novel with a vocabulary of 3000 words out of hundreds of thousands of words which are actually there in the dictionary. 
