Is the universe a perpetual motion machine?
Nope, not if you use the standard definition for "perpetual motion machines of the first kind", which can indefinitely produce work. Entropy increases monotonically over the entire universe, and eventually all free energy will be gone. This is known as heat death.
Will particles in the universe continue moving forever? Probably. But that's not what perpetual motion thought experiments are typically about.