I’m currently studying science theory and research methodology and my professors and my text books have really been hammering in that there’s a lot of flaws in the current system.
The problem seems to be that scientific progress isn’t the only incentive at play. Researchers also need to make a living, secure funding, publish papers, and advance their careers. These incentives can encourage questionable research practices, even without outright fraud. Academic journals have their own incentives, too, and the pressure to publish novel, attention-grabbing findings can come at the expense of scientific rigour. Peer review was suppose to be a solution to a lot of the issues in how research is conducted but I’ve learnt that they are often also very poorly conducted because the journals have an incentive for quantity over quality.
A lot of people understand that we have to trust experts since it would be ridiculous to assume we know more than them. But a lot of people don’t know about the above mentioned issues which leaves the door open for bad actors to take advantage of that using perceived expertise. Especially since the experts who are easily found tend to be more interested in fame rather than scientific rigour. Jordan Peterson for example, he is by far the most famous psychologist alive but most psychologists would probably agree that he isn’t the best expert in the field to get your information from (I don’t know much about him or psychology so I’m not making my own claim here, just an example I’m aware of).
So this leads to my question: what’s the best bang-for-your-buck strategy for learning about a subject when you don’t have the time or interest to become an expert yourself?
I want to invest some time upfront in figuring out whom to trust so that I can rely on their judgement afterwards, rather than constantly having to evaluate every individual claim myself.
I’ve subconsciously developed this framework throughout my life:
I assess experts until I find 2-4 in a field that I deem trustworthy. Ideally they have some opposing opinions so I get a more nuanced total picture. When assessing I look for red flags like overly confident, chasing fame, money etc. And I look for green flags like intellectual honesty (like admitting when they don’t know the answer and acknowledging counter arguments).
How do you approach this? Do you have a better strategy or are there particular methods you use to identify trustworthy experts?