Plenty of research activity in physics have been vigorously opposed by their opponents as pseudoscience or fringe science, while other research are mainstream. It is possible some topic is pseudoscience if the experts claim it is so, but they could potentially be biased. For the nonexperts out there, short of appealing to authority, what objective criteria can be used to distinguish between valid science, fringe science and pseudoscience, i.e. topics which are a waste of time compared to topics worth pursuing.
I would like to take a stab at this, because I think that this is where we are most privileged. This is perhaps the last moment in time when science is the exclusive domain of the specialist. I am optimistic that soon every person will either directly possess, or personally know some people who together possess, enough expertise to access all human knowledge. Public dissemination makes science into what it was always intended to be: an activity of masses, not elites.
In such an environment, bogus ideas don't stand a chance.
Pseudoscience and fringe science are pejorative political terms, which are never used by the proponents of the ideas. I don't like the labels--- I prefer simpler labels, like "right" and "wrong". One can ask, what distinguishes a correct idea from an incorrect idea?
For this case it's simple. The only criteria are
Of these, the third is by far the most important--- without it, we would get stuck in ruts all the time, we would run out of new ideas, and research quality would be determined by pure politics, and we know by bitter experience that in politics, Aristotle beats Aristarchus. Further experiment suggest new theories, and new ideas, more often than theory suggests new experiments.
But experiment is not the sole arbiter, because experiment requires theory to interpret, and experiments can be flawed--- consider early studies on ESP, or more recent OPERA results So you need to consider 1 and 2 when evaluating theories and experiments, to see if they make sense in the framework of knowledge already accumulated. But you can't go overboard--- if experiment tells you something, and careful analysis shows that it is correct, then that's that.
It is my opinion that these three principles by themselves suffice to distinguish right ideas from wrong ideas, without any need for political labels like pseudoscience, fringe science, and so on. This way you don't take any chances dismissing an idea politically. If the idea is wrong, it should be trivial to refute it by finding an internal contradiction, a theoretical weakness like a huge amount of unnatural parameter tuning, or a flat out contradiction with experiment.
In today's media climate, it takes less time and effort to fully refute a wrong idea than it takes to come up with it in the first place. So wrong ideas today have a negative multiplication factor, and it should be a short while before they are all extinct. This is a pity, in a certain sense, because it means that future generations will never know an Archimedes Plutonium, or an Alexander Abian, they were quite possibly the last and best of their kind.
When evaluating theories, it is important to not restrict yourself to "right" and "wrong", although this classification is still important. You also need to consider "fruitful" vs. "dead-endy", "interesting" vs. "boring", "original" vs. "derivative". These criteria are more human, and more subject to error than the rigorous scientific standard of right and wrong, but they are necessary, because even wrong ideas can often be tweaked into correct ones, and you need to know where to tweak.
Most of the ideas that are traditionally labelled pseudoscience are generally easy to dismiss even in a theoretical evaluation without direct experimental evidence, because they are clearly boring, clearly derivative, and clearly dead-ends. One doesn't have to classify them as pseudoscience to see this--- one can label them boring, derivative, and dead-endy without distinguishing them from their peer-reviewed cousins which are just as boring, just as derivative, and just as dead-endy. I don't see much difference between a numerological analysis of the standard model that appears in a peer reviewed journal and a numerologically motivated analysis of the standard model that somebody publishes on a personal web-page.
Many ideas which were dismissed as pseudo-science turned out to be correct. So it is best to ignore the labels and consider the ideas on their merits. Here is an incontrovertible list:
There are further examples of theories which were dismissed as vague or ill-defined, perhaps not quite pseudoscience:
In addition, I personally find the following vague spiritual ideas impossible to refute, and perhaps they might gain statistical evidence in their favor with time, although they are currently not part of science:
Why do wrong ideas persist?
I believe that any persistent wrong idea, especially in today's media environment, is only alive because it is serving a social purpose which is not apparent. Once a good substitute correct idea is formulated which can serve the same social purpose, the idea can die. Alternatively, the social purpose might be rendered obsolete, by an evolution of society.
This, along with the published results of detailed models for the distribution of warming, ice-core data on the correlation between CO2 and temperature, and projected predictions that each successive year will be warmer than the last (predictions which are each exceedingly unlikely considering how hot current global climate is, and which are uniformly correct), make it certain that the world is warming due to the activity of humans. The only strike against this theory, as far as the media is concerned, is that it was predicted by left-wing activists in the early 1970s.
So there is a social force at work here. The obvious reason to deny warming is to prevent a carbon tax, or emissions cap, and this is supported by big money. So you have denials, but there is no sound science behind the denials. But global warming denial, like genocide denial or big-bang denial, is on the wane.
I think in this case it is important to recognize that the wrong ideas are persisting because of the important life-altering effects of religious experience, which has motivated people to allow reforms, even to the point where they will die for their beliefs.
The notion of religion, that it is possible to gain experience of consciousness different from that of the individual person, is to my mind entirely reasonable. But the authoritarian claim that the Bible is a good source of ethics is entirely bankrupt.
But people believe it, because these chants and prayers have a perceptual effect on the people who perform the ritual, and those that come in contact with them. This effect is real, but to what extent it is inter-objective remains to be seen. It is a powerful way to direct people's attention, see Allen Ginsberg's magical "Om": http://www.intrepidtrips.com/pranksters/ginsberg/ . These things transcends their emptiness as physics, because of their mental resonance.
Wrong ideas in science
In many fields of science there are flat out absurd ideas which gain traction, mostly because nobody thinks about them enough to realize that they are absurd. It is hard to name many of these, because I am just as blinded as anyone else by my place in time, but I will try:
These are a counterpoint to false ideas by non-scientists. These are false ideas promoted by scientists. I would call them pseudoscience, but unfortunately, they are mainstream positions today.
In physics, I compiled some of the persistent wrong ideas here: Common false beliefs in Physics
One of the most deplorable cases where the label "fringe science" and "pseudoscience" is thrown around a lot is in the field of cold fusion. Many dozens of groups, mostly in unpopular research centers, although a few in well financed respectable laboratories, have reported nuclear effects in deuterated Palladium. The political structure of physics dismisses these claims, but in my opinion, there is no sound theoretical argument against them.
I have not seen a convincing refutation of cold fusion, but I have seen papers with very solid evidence that nuclear effects are happening. The papers continue to trickle out, and cold fusion is now acceptable again to the American Chemical Society, although not yet to the American Physical Society, or the National Science Foundation.
It would be nice to see a debate of cold fusion on its merits, without political labels getting in the way. Only for some specific theoretical models, are there clear refutations.
Science is almost never revolutionary, it is mostly evolutionary: new, good science, usually takes care of explaining all the existing observations, and possibly providing
1) explanation for previously unexplained observations
2) new observations not previously thought about
Fringe science is usually quickly detected because it tries to debunk existing well established science without a proper account of the observations already consistent in the existing framework.
For instance, by axiom of choice, lets pick a random theory proving that special relativity is wrong. It almost sure does not care about explaining cosmic rays muon decay mean paths, time dilation in atomic clock or any of that boring stuff. It will cut right to trying to prove that the theory is wrong based on their own pseudo-logical arguments.
Also, another early symptom of fine crackpottery is try to cram a lot of concepts in as little text as possible, in an attempt to intimidate people out of debunking their assertions
There are no hard criteria... but, I think a very good general metric is the predictive power of the hypothesized model. Real science makes quantitative, testable, predictions based on a rigorous mathematical model. The more closely the proposed mathematics match observed data, the better the science.
Pseudoscience tends to make qualitative predictions based on ill-defined hypotheses. Creationists, for example, often claim that the speed of light has been slowing down over time (thus purporting to explain why we can see galaxies billions of light years away). What they don't do, however, is provide a concrete model of the nature of the change. Do photons change speed in flight or do they keep the speed associated with the time of their generation? They also don't provide a mathematical model with which to make predictions. How does the decaying light speed theory improve on calculations based on general relativity?
Many of the other answers overrate experiments too highly. Let me emphasize thought experiments instead. Many of the most important breakthroughs in physics, by Galileo, Newton, Einstein, quantum mechanics, etc. were due to thought experiments. Even the positivists who were so heavily leaning toward empiricism had to acknowledge this sneakily by subtly changing their position to logical positivism, to allow for the "rationalistic" element of thought experiments.
Metaphysics basically deals with statements which are undecidable given the current models of physics, i.e. statements which either it or its negation, but not both, can be added as an additional postulate and still give a consistent theory. But it’s entirely possible the next paradigm shift and the next version of physics models can firmly decide the truth or falsehood of some of these statements one way or another. This moves that topic from metaphysics to physics. This is why pursuing metaphysical questions is worthwhile because it can prepare the way for the next paradigm shift.
Time will tell. Wait a couple of decades, and nearly everyone will know the difference. Hindsight is 20-20.
There are no hard criteria. This is the demarcation problem, except that there is no way of sharply demarcating physics from metaphysics/philosophy/religion. They all blur into each other.
A long time ago, I was taught that science to be accepted must satisfy a set of simple criteria such that: Physics can only study phenomena which can be reproduced. A sudden flash of ligth that happens only once can not be studied. Observations must be matched by a mathematical model which can explain the observed facts and predict a few other. At last simplicity should be the thread to use to guide us in the darkness.
However nice is this set of criteria, one can not use it to discriminate true science from folklore: QM for instance, does not satisfy the reproductibility criterium, because of the impossibility to both know position and momemtum. One can indeed imagine a first experiment where I measure the position, and a second experiment made on a different particle produced in the same conditions where I measure momemtum. Thinking a little bit harder it is probably possible to dismiss all the above criteria with a long established theory, it being QM, statistical physics or else...
I now think that we should extend the postulate that reality is not independant from the observer to: the reality is created by the observer. And that a physical theory to be accepted must be thought and accepted by a large enought number of minds.
This position may appear extreme but consider for instance the paradigm about the motion of the Earth around the sun. Before Galileo everybody was convinced the sun was revolving around the earth, from Galileo's death up to now, everybody is convinced Galileo has proved the Earth is revolving around the sun. What are the facts: it is a daily experiment to see from earth, the sun rising and setting, and if one waits a full year to see the sun revolving around our position. In the same time, Galileo who is the father of the galilean relativity has clearly said that there is no absolute referential. We can thus doubt the words he is supposed to have pronounced about the earth revolving around the sun (making us think the sun is an absolute referential so much better than the geocentric referential). There was a turning point in history where a large enought number of minds has deformed Galileo's theory and transform it into a new paradigm: the sun is an absolute referential which is much more conveniant to use. And from this time on, humanity is firmly beleiving the truth is that the Earth is revolving around the sun.
At last, what do you think about the experiments which try to identify the interaction between mind and matter ? http://www.princeton.edu/~pear/
@Mike Dunlavey gave the answer in the comment above:
It is enough looking to the history. IMHO with some modification, the real order is the next:
If the scientist have enough power, can catch more others, and at some limit the theory became as real. Example: dark matter/energy. Army of scientist believe in its existence, but nobody know what is it. The theory has enough power.
Another example: Here are many pseudo(?) scientists who believe than here is faster speed as light. Of course, never get enough attention, because they are without any power. Now, here is a chance than CERN will have enough power to change this with it's neutrino experiment. Only when/if the experiments confirm the faster speed, the army of physics will start rewriting 100 years of "fundamental" laws. Maybe the next 20 years confirms that some (low power) pseudo-scientist two years ago was right. (But the Nobel Prize but will get someone else).
So, the answer to the question: Here aren't objective criteria. Only two thing differentiate the real and pseudo-scientists: they's COURAGE and POWER - and those are not objective.
Another question is why real-scientists haven't enough "imagination" to start developing new theories before things happens? E.g. when some "low-power" pseudo-scientists come with some theory why other scientists usually immediately flag them as "pseudo"? The lack of math or simple enviousness? As @AdamRedwine told above - here are believers of non-constant speed of light - why "big" scientists don't start making solid math for the theory? The worst thing what can happens than they confirm the current theory. Simply, the scientists haven't enough imagination and courage to start thinking differently = crowd effect.
It is the same as anywhere else. One of my friend years ago telling me about multi-touch(!!) full-screen mobile phones. He simple hasn't enough courage and power to patent it and start real development. Apple (years later) has enough power...
Ps: if someone care, correct please my "broken english".