Would there be centrifugal force if I were alone in the universe? When I'm rotating, I feel centrifugal force.
But if I were the only one in the universe and rotating, wouldn't I just kinda be still (since I'm not rotating with respect to anything) or would there just be a force pulling me out?
What if there were another person a billion miles away, this should not change anything, right?
 A: How did you start rotating and how do you know in the first place that you are? :)
I'd image you start alone, but to rotate you have to accelarate for which you have you create thrust that will emit particles in the other direction what in turn means you are no longer alone...
A: The pseudo-forces such as centripetal acceleration are the result of using a rotating frame of reference.  They apply in all cases, even if there are no other objects.  Note that they are pseudo-forces.  They're not actually forces, but rather mathematical results of using rotating frames which happen to appear to act as forces.
So the real question would be what equations of motion make sense in your universe.  Do they line up with the equations of motion of an inertial frame (aka Netwonian frame), or do they line up with the equations of motion in a rotating frame.
Because you start from the declaration that you are alone in the universe and rotating, it is reasonable to assume that the equations of motion you use to predict the path of objects will be those of a rotating frame.  That's simply because you used a word which has that meaning.
Now if you were the only object in the universe, and were roughly a point-mass, it would be enormously difficult to measure your rotation, but that's another question entirely.
A: As always, the real answer is that we don't know.  We have no way of conducting the experiment. There are arguments both ways. So, we don't know.
The argument in favour of centripetal force is that things moving around in circles in not a natural movement and you need to use a force to make it happen.
The argument against is that it seems reasonable to assume that the universe as a whole cannot have an angular momentum (momentum of rotation).  If you are the only object in the universe, then you cannot have angular momentum, cannot rotate. So, no force.
Here, the question has chanced a bit and become "If you are the only being in the universe, is it possible for you to rotate?"
This might seem like a different question, but they are connected by the definition of "rotate".
Ponder this: If you were the only object in the universe, how would you know if you were rotating?
And the answer is: "If you need a force to keep your arms and legs in place."  With no remote "fixed" stars, this is the only way know if you are rotating.
This gives us two alternatives:


*

*There is no force.  Which means there is no rotation. OR,

*There is a force. Which means that rotation is possible.


Since we can't do experiments, we can't tell which of these would be the case.
Adding another person to the universe, regardless how far away, changes everything.  Now the two of you can have opposite angular momenta so that the total momentum of the universe is zero.
And you can measure you momentum by looking at the other person.
A: What you're basically asking about is Mach's principle. You might want to read the presentation of an example like this in Einstein's paper "The foundation of the general theory of relativity," which can be found in translation online.
According to general relativity, the answer to your question is yes, there would be a centrifugal force. However, there are alternative theories of gravity that are more Machian. One is called Brans-Dicke gravity. The original paper on this theory, C. Brans and R. H. Dicke, "Mach’s Principle and a Relativistic Theory of Gravitation," Physical Review 124 (1961) 925, starts off with a simple and readable physical example in the same style as the ones we've been discussing.
Brans-Dicke gravity was very successful in setting off a lot of interesting tests of general relativity back in the 1970's. The tests were all consistent with general relativity. Brans-Dicke gravity involves a parameter that makes it go over to general relativity in a certain limit. The value of that parameter has been constrained by solar system tests to have a value so close to the GR value that BD gravity is no longer considered to be much of a contender.
So the answer to your question is yes, there would be a centrifugal force. Rotational motion is not relative.
As a side note, I think a lot of people are turned off by discussions of Mach's principle, because they're often introduced in terms of "suppose the universe were almost empty," which is counterfactual. That makes it sound like useless philosophizing. But BD gravity is a real theory. The stuff about an empty universe is just motivation.
Alfred Centauri pointed out in a comment the existence of:

the Kerr metric, the solution for a spacetime with just a rotating, eternal black hole.

If Einstein had known about this solution circa 1920, he would have been disturbed and upset, because his ambition was for GR to turn out more Machian than it really was. In fact, he was upset by the Schwarzschild solution for similar reasons.
