The endless debate about where fundamental physics should be going, proceeds unabated. As can be expected, this soul searching exercise includes many discussions of a philosophical nature. The ideas of Popper and Kuhn are reassessed for the gazillionth time. Where is all this leading us?
The one thing I often identify in these discussions is the narrow-minded view people have of the diversity of humanity. Philosophers and physicists alike, come up with all sorts of ways to describe what science is supposed to be and what methodologies are supposed to be followed. However, they miss the fact that none of these “extremely good ideas” have any reasonable probability to be successful in the long run.
Why am I so pessimistic? Because humanity has the ability to corrupt almost anything that you can come up with. Those structures and systems that exist in our cultures that actual do work are not the result of some “bright individuals” that decided on some sunny day to suck some good ideas out of their thumbs. No, these structures have evolved into the forms that they have today over a long time. They work because they have been tested over generations by people trying to corrupt them with the devious ideas. (It reminds me that cultural anthropology is, according to me, one of the most underrated fields of study. The scientific knowledge of how cultures evolve would help many governments to make better decisions.)
The scientific method is one such cultural system that has evolved over many centuries. The remarkable scientific and technological knowledge that we posses today stand as clear evidence of the robustness of this method. There is not much, if anything, to be improved in this system.
However, we do need to understand that one cannot obtain all possible knowledge with the scientific method. It does have limitations, but these limitations are not failing of the method that can be improved on. These limitations lie in the nature of knowledge itself. The simple fact is that there are things that we cannot know with any scientific certainty.
So, the current problem in fundamental science is not something that can be overcome by “improving” the scientific method. The problem lies elsewhere. According to my understanding, this problem has one of two possible reasons, which I have discussed previously. It is either because people have lost their true curiosity in favor of vanity. Or it is because our knowledge is running into a wall that cannot be penetrated by the scientific method.
While the latter has no solution, the former may be overcome if people realize that a return to curiosity instead of vanity as the driving force behind scientific research may help to adjust their focus to achieve progress. Short term extravagant research results do not always provide the path to more knowledge. It is mainly designed to increase some individual’s impact with the aim to obtain fame and glory. The road to true knowledge may sometimes lead through mundane avenues that seem boring to the general public. Only the truly passionate researcher with no interest in fame and glory would follow that avenue. However, it may perhaps be what is needed to make the breakthrough that would advance fundamental physics.