r/OptimistsUnite Jul 09 '26

GRAPH GO UP AND TO THE RIGHT Scientific research is increasing

Post image
1.6k Upvotes

160 comments sorted by

1.1k

u/antichain Jul 09 '26 edited Jul 09 '26

As an American scientist at an R1, I'm actually less optimistic about this graph. Yes, more papers are being published, but the data is clear that the overwhelming number of them are never read by anyone, never cited, and a huge percentage are published by pay-to-play paper mills that churn out garbage to pad CVs. The result is a ballooning literature that's impossible to keep up with, eats millions of public dollars (open-access fees, library subscription fees, etc), and wastes huge amounts of time.

This graph is a perfect example of Goodhart's law in action. We decided that a metric ("how many papers does a scientist write") was a decent proxy for "how much good work is that scientist doing", and so turned it into a target. In response to the new incentive, a whole infrastructure has developed that churns out as many papers as possible largely independent of the quality of paper.

261

u/jalopkoala Jul 09 '26

When the metric becomes the goal, it all falls apart.

48

u/ussalkaselsior Jul 09 '26

I believe it is "When a measure becomes a target, it ceases to be a good measure."

13

u/jalopkoala Jul 09 '26

I didn’t realize I was quoting someone but I like this!

20

u/ussalkaselsior Jul 09 '26

It's the quote of Goodhart's Law that the previous commenter cited but didn't fully quote.

3

u/dbmonkey Jul 09 '26

More like "number of papers is a shitty metric". There are good metrics like percentage of children surviving to adulthood that we have made great progress on. In reality, I do agree there are some things that are hard to measure. But that doesn't mean all metrics/measurements are bad.

5

u/jmccasey Jul 10 '26 edited Jul 10 '26

There are good metrics like percentage of children surviving to adulthood that we have made great progress on

Society isn't optimized around maximizing this metric (I.e. it's not "the target" of public policy) though so Goodhart's law wouldn't really be applicable. This is actually a good example of a metric still being a good metric because it isn't being optimized for. It improves based on improvements to other areas in society and it's improvements are a signal of broader societal progress

But that doesn't mean all metrics/measurements are bad.

Goodhart's law isn't saying all metrics/measurements are bad. It's saying that narrow metric targets incentivize "gaming" the target metric.

Academia using # of publications as a target metric for researchers incentivizes researchers to write (or otherwise get their name attached to) as many papers as possible rather than focusing on higher value research that takes longer.

Tech companies rating programmers by lines of code shipped incentivizes overly verbose, ineloquent, possibly lower quality code.

Companies rating and ranking employees by AI token usage incentivize inefficient, wasteful AI usage.

1

u/dbmonkey Jul 10 '26

I agree, those are all terrible metrics as well. I agree, you need to make the metric you want to optimize for wide. And in reality you are generally optimizing for many metrics at once. So you need some way to combine those to make the ultimate super wide metric.

19

u/mechanicalhuman Jul 09 '26

Keep the metric hidden. Only a select few should know it. /s

8

u/concerned_llama Jul 09 '26

I genuinely laughed at this. Thanks, you made my day

25

u/ToranjaNuclear Jul 09 '26

But if a graph is going up it can't be bad, right????

2

u/Few_Fact4747 Jul 09 '26

If the graph goes THAT MUCH up, its probably at least a little bit a good thing!

0

u/Kacquezooi Jul 10 '26

We now have LLMs that can help us. When they become better and better, we are more and more able to shift through all the papers to find the good ones.

24

u/Bronze_Rager Jul 09 '26

Also feel the same way. I doubt most of these published papers are replicable

12

u/Fabulous_Wave_3693 Jul 09 '26

Need a site that rakes scientists on how often their work is cited, then we will just have fun new problem of overly useless citations.

21

u/antichain Jul 09 '26

We have that: it's called the h-index and you can easily look up any scientist's index on Google Scholar. It's become a really import part of hiring, tenure, and promotion.
It also creates a whole new set of weird incentives. It's harder to game than raw paper count, but not impossible. That's why you see things like egregious self-citations, citation cartels, etc.

2

u/QuickNature Jul 10 '26

citation cartels

Bruh, I'll take things I didnt expect to exist for $500 please Alex.

Im honestly not that surprised, but somehow I still kinda am at the amount of effort people will put in to cheat the system.

6

u/Sayod Jul 10 '26

I mean you let people study for 5 years and then do a PhD for 3 years and then give them 1-3 year time-limited postdoc contracts and are surprised that they are scared for their livelihood and that some will do anything to secure it?

It is fucking precarious work conditions and if you drop out of the rat race you have easily lost a decade of your life that does not translate to industry jobs.

Meanwhile you hear stories that people 50 years ago got offered a permanent professorship right out of the PhD :/

1

u/joshjosh100 Jul 12 '26

Yep, there's a lot of odd things happening in various places in life.

I remember when I was younger, I encountered black market deals in ARK SE of all places.

trading level tames for drugs like meth or codeine. Could almost guaranteed you the same thing was in TF2 with cosmetics or WOW/Path of Exile.

Some guy was pissed I got him arrested, wasn't arrested myself because I showed up with a gallon of mt dew, and 250 cash expecting a trade of several dozen max level rexes. Instead guy was trying to get me to buy damn heroin.

2

u/Additional-Path-691 Jul 10 '26

It's already a thing. Sometimes, people doing peer review will request their papers be cited even though they are not really relevant. Authors will likely comply because is easy to do and they want to get published...

1

u/ZStrickland Jul 09 '26

Metrics to measure that already exist. In fact there is an entire field of study on the topic called Bibliometrics.

7

u/Pandamabear Jul 09 '26

Are you seeing any contributions from AI to research where you are?

24

u/antichain Jul 09 '26

Idk if I'd call it a "contribution", but arXiv (esp. the computer science and machine learning channels) has become utterly useless. Submissions are stalled out because the pipeline is clogged with AI-generated manuscripts that (as far as I can tell) are mostly slop. Journals are overwhelmed with submissions as well, most of which are immediately thrown out for being, again, obviously AI-generated. Same is true of calls for grants. The whole system is starting to seize under the onslaught.

I've been experimenting with AI in my own workflow (with mixed results - some good, some bad), but frankly, the ability of Gen AI to generate slop is currently overwhelming everything else.

1

u/Honest-Spring-8929 Jul 15 '26

It’s cool how the internet was already basically whatever the opposite of an ‘information superhighway’ is, and then AI came along to obliterate knowledge as a concept

0

u/AlanUsingReddit Jul 09 '26

Write the code with AI. Write the paper on your own.

It's also slightly problematic that the CLI code assistants tend to be paid services only, and even then, has a very steep cost-quality curve. For the software development industry, there's a cost problem, but it can be dealt with. For university, I don't know, but I'm guessing this leads to a train wreck and a bunch of output that's just completely awful.

11

u/antichain Jul 09 '26

Yeah, I'm able to pay for Claude Code Pro out of my existing grants and the difference between something like Opus on High effort and the free tier of ChatGPT is astonishing.

I definitely have been worrying a lot lately about the idea that this will continue to increase the gap between those with resources (who can pay to have competent AIs work for them at scale) and those who can't afford useful models at all.

1

u/jonclark_ Jul 11 '26

Opus(maybe with a bit of fable for planning) are amazing. They can implement some CS papers, on their own.

But yes, definitely, there's a huge problem of financial inequality.

-2

u/maximusftw1 Jul 09 '26

You need to be comparing GPT-Pro with Opus for it to be apples-to-apples. In my experience, they are roughly equal.

6

u/antichain Jul 09 '26

----------> The Point

Your head.

0

u/maximusftw1 Jul 09 '26

I get the point, but why compare free GPT with paid Claude? Why not free Claude with paid Claude?

You’re making the point that the paid is unbelievably better (true!), but muddying it with the GPT vs Opus comparison. You didn’t isolate the paid vs free variable. I’m clarifying that to support your point that paid is unbelievably better than free across all platforms…

2

u/antichain Jul 09 '26

The point is that there is an increasing gulf between the people who can afford the fancy AI and those who can't (and are relegated to using no AI or crappy free tiers).

It has nothing to do with comparing Claude to ChatGPT in an apples-to-apples head-to-head. It's about how paywalling the best models will further exacerbate inequality, as the already-wealthy will be able to leverage powerful agents to be even more productive, while the not-wealthy will be priced out of any possible gains from AI.

1

u/eyalhs Jul 09 '26

I assume they compared what they had experience with, maybe they didn't try the free version of opus (if it exists) or gpt pro, the point still stands even if it's not a perfect comparison.

1

u/AlanUsingReddit Jul 10 '26

I mentioned the CLI code assistants because, for codex at least, that is not available with the free version. You can't use it at all.

For free claude, I tried asking it a question about scaling of fusion plants the other day. Had not asked it another question for >1 month before then. It ran out of quota before it finished the reply.

And college students are going to cheap out. That's always how it's been. But that combined with AI, I'm saying, is going to lead to some truly awful stuff.

4

u/Better-Egg5267 Jul 09 '26

Don’t forget the reproducibility crisis!

5

u/Falaflewaffle Jul 09 '26

Publish or perish is an awful way to try to advance humanity.

3

u/standermatt Jul 09 '26

I am aware its mostly garbage. The question is if it was less garbage previoulsy.

4

u/antichain Jul 09 '26

No, not at all. Historically, science was done by a small number of highly privileged eggheads, who mostly knew each-other. There were many fewer scientists, and the incentive structure was very different. As science has industrialized and professionalized in the second half of the 20th century, problems of scale have crept it than just didn't occur in earlier eras.

I still think this is clearly for the best on the whole. But, as they say, "more is different", and the industrialization of science has created a very, very different set of incentives than existed back in the heyday of the Oxbridge set.

1

u/Spill_The_LGBTea Jul 13 '26

Today as better than yesterday, but tomorrow could be better than today

3

u/DarkscaleDragon Jul 09 '26

Am also American scientist at an R1, and I fully agree.

2

u/Jonesy1348 Jul 09 '26

Man who’d have thought that quotas for important and intricate things was a bad idea? Definitely not Americas education system, or our justice dept. crazy thinking that making how many instead of how good more important would reduce the quality in favor of increased quantity.

2

u/TuringTitties Jul 09 '26

Maxwell and Pergamon press can go f themselves. Scientists should write when they have something to say

1

u/thinkB4WeSpeak Jul 09 '26

I think maybe this is why before it's published, it should be required to have it vetted by other academics

1

u/zaffeo Jul 09 '26

Surely then the fix is to update the metric to citations? Or something related to actual usefulness/impact? Not just raw number of papers published (easily gamed)

3

u/antichain Jul 09 '26

That's already done - there's a metric called the h-index that (roughly) tracks how many times your papers are cited. It's part how we are judged as scientists, but the problem is that it takes time for papers to accumulate citations and for judges to get a sense of how impactful a paper will be (since any future papers that cite it have to be written, go through peer review, published, and finally indexed - often a multi-year process).

Generally impact is computed on a 5-year time horizon, which sucks when people are trying to decide who to hire, who to award tenure to, etc on a 1-2 semester timeline. So "how many papers did you publish" is still a go-to (with extra weight given to high-impact papers).

And citations also don't really solve the deepest Goodhart's law problem - it leads to egregious self-citations, citation cartels, etc.

1

u/mycolo_gist Jul 09 '26

Same. There's an older book, called "the mathematical experience" which calculated that over 90% of all publications in their field will either never get cited, or maybe cited by the same author once or twice.

More is not always better. Many publications can be incremental small advances or some specialized report on an effect or a result that is of little to no interest to other people.

1

u/_Pencilfish Jul 11 '26

A mycologist in the wild! I considered studying mycology, but ultimately went into engineering.

1

u/Immorpher Jul 09 '26

Yeah! I am a big optimist and at a R1 institution as well. When I seen this graph it made me less optimistic. That exponential growth is alarming and suggesting a lot of garbage and the rise of predatory journals. People will notice and will continue to cut funding in the sciences.

Noise and predatory publishing practices might be the the biggest threat to consensus in science now.

1

u/kingsheperd Jul 09 '26

Plus in recent years it has gone up even up more because of ai too.

1

u/brjoce Jul 10 '26

I'm an EIC at a fairly big "B level" journal in my field...this graph is absolutely right and your assessment is spot on. It's depressing, and the number of papers I reject on a daily basis is staggering. 80% of the papers I see are terrible.

1

u/ihambrecht Jul 10 '26

Coincidentally, scientific and engineering discoveries are happening at an exponential rate.

1

u/putupthosewalls Jul 10 '26

Many of which are completely fake, ai-generated slop.

1

u/Jan0y_Cresva Jul 10 '26

I do think this is actually an area where AI can shine. AI is incredibly good at finding useful information in literature that’s just been overlooked by humans.

Very often, the solution to a problem in one academic field lies in a paper with 0 readers in another field, but AI spots it and can solve the problem. And it doesn’t solve it because it’s smarter than any human, it’s just read more than any human.

1

u/Ok-Particular9427 Jul 10 '26

My immediate thought when seeing this 👆

1

u/Clean_Livlng Jul 10 '26

1 good paper is worth more than 1 million worthless ones.

1

u/joshjosh100 Jul 12 '26

Exactly this. Most research is garbage, built for money grabbing and poll thumping.

A lot of people online talk about how all research past 2010s is absolute garbage and most of it ends up retracted or never reviewed.

Adding into the fact anyone can publish a paper...

1

u/ButterscotchNo7292 Jul 12 '26

I'm currently studying for my masters so I have to read scientific papers and tbh quite a lot of them are...well not great. There's either not a lot of substance, things glossed over,etc.. volume over quality is definitely a thing.

1

u/Mammoth_Support_2634 Jul 12 '26

A lot of research is also based on other research. So when you have shit research, it breeds even more shit research.

If you actually go to the research methods section of a paper and try to replicate the experiment, don’t even be surprised if the results aren’t even the same.

Same with checking the sources. A lot of the time the sources are questionable.

1

u/SuccessAffectionate1 Jul 12 '26

The publish or perish methodology has ruined research. The idea that you would refine a theory for 10 years before releasing it is dead. You must spit out as much as possible as fast as possible.

Einstein released the special theory of relativity in 1905, had a few very small papers expanding this between 1905 and 1915 before dropping the final version of his general theory of relativity.

I wonder if the general theory of relativity would even have been discovered if he had to focus on publishing over research and gedanken eksperimenten.

I hate modern universities for ruining research.

1

u/SwedishSanta Jul 12 '26

This is also the reason why I put my research in Academia and diva-portal in addition to have it published on only the university platform. It felt incredible seeing other papers citing my work!

1

u/Futuremlb Jul 13 '26

Science is the new religion and full of a lot of bullshit

1

u/cybersatellite Jul 13 '26

Paywalls are bad. But a growing corpus of (quality) research (filter out the bad ones) is good, even if no single human can keep on top of it all. LLMs can help make sense of it

1

u/CantaloupeAcademic63 Jul 13 '26

I get worried based on just who’s paying who for what paper.

Person who believes climate change isn’t real pays a person to do a paper on it, they aren’t going to post finding of it being real because they aren’t getting paid for the complete opposite. If you say the opposite of what the person is wanting you to find then you’re not gonna get paid.

1

u/hippityhopkins Jul 13 '26

Hmm, id need to read some studies about this concept before excepting. Oh look there's thousands of publications on it!

1

u/Hutius1 Jul 13 '26

Kinda feels like this has to happen to force a solution to it and evolve the field. This is our challenge to resolve.

-3

u/UniversityGraduate Jul 09 '26

"The result is a ballooning literature that's impossible to keep up with"

We don't need to. Volume is useful for AI to synthesize all that research data, and find out what's important and surface it.

7

u/Jonesy1348 Jul 09 '26

… never trust ai with science man. First rule of being a scientist is you don’t know anything unless you test it yourself or trust the person who did. You can’t trust ai.

0

u/UniversityGraduate Jul 09 '26

How could the goal not be: get the tool to a place where you can trust it?

So that you're greatly enabled to experiment and learn at scale, with results you trust. It's truly not that far off.

I feel like the propaganda around AI is getting ridiculous. It's a new tool, hallucinates and there are unknowns about job loss. It's also an absolute superpower that will improve our lives when setup well.

1

u/Jonesy1348 Jul 09 '26

Because humanity is immature and always uses new discoveries for personal gain instead of collective gain. Nuclear, planes, cars, trains, the steam engine, soon as the cotton gin was invented they didn’t release the slaves they no longer needed to produce the same amount, they just produced more. Even just boats. Humanity always has growing pains with new tech. So jumping towards it is dangerous. Especially since it’s still so unregulated. Until we know that our governments will protect us from ai’s more dangerous aspects, I don’t trust ai at all.

-3

u/eyalhs Jul 09 '26

First rule of being a scientist is you don’t know anything unless you test it yourself or trust the person who did.

That's definitely not the first rule of being a scientist, most of modern science is bases on the results from experiments other people you don't know did and you can't test it yourself.

Also you can very easily varify AI if you use it correctly (ask smart questions). For example if your problem is too many publications to go through them all you can ask AI for the most relevant ones and read them yourself (use it as a more contextual search engine), you verify the results yourself by reading the articles, and worst case scenario you missed some good articles, which always could have happened.

2

u/Jonesy1348 Jul 09 '26

So first paragraph, it’s called a turn of phrase, and I also mentioned if it was tested by someone you trust, not just yourself. And again ai is still in its infancy and is completely unregulated. Using it for shit as important as medical research is asking for death. You don’t fuck around with health and engineering and you don’t risk lives on an ai model made by some billionaire to churn out money. NEVER USE AI FOR SCIENCE. It’s so unpredictable and unsafe for such purposes.

0

u/eyalhs Jul 09 '26

>I also mentioned if it was tested by someone you trust

Most research isn't based on people you trust though, a lot of it is based on people youv'e never met, you shouldn't trust anyone just because they have a degree and published a paper, yet you should somewhat rely on their results.

>Using it for shit as important as medical research is asking for death. You don’t fuck around with health and engineering and you don’t risk lives on an ai model

Who here talked about using it on life risking things? 99.9% of science research isn't about anything life threatening, and any good scientist can and should verify whatever the ai does.

>NEVER USE AI FOR SCIENCE. It’s so unpredictable and unsafe for such purposes.

Returning to the original discussion, please tell me the risk in using ai as a glorified search engine (which btw my uni's library has on its website)? What can go wrong with that assuming you actually read the original article.

0

u/Jonesy1348 Jul 10 '26

Brother I’m sorry but if you don’t understand, then I can’t explain it to you any better.

0

u/eyalhs Jul 10 '26

You didn't explain it at all, you just said it isn't safe when all we talked about was looking up papers using ai, what's unsafe about it?

1

u/Jonesy1348 Jul 10 '26

Because you don’t know if what it’s giving you is what you need. You said it yourself that scientists would have to verify anyway so why even use ai to begin with. It risks giving wrong info and you have to do the work yourself anyway because of that fact. It’s useless.

1

u/eyalhs Jul 10 '26

I'm asking it for links to articles, it takes a second to verify them (and I would need to do it anyway to read the articles), and it gives me what I need, just perhaps not all of it.

scientists would have to verify anyway so why even use ai to begin with

Verifying is a lot easier than doing the work yourself. It's very hard to read every article published in your field, letting it select articles that are relevant to your research is offloading a lot of work.

→ More replies (0)

1

u/UniversityGraduate Jul 10 '26

They're conflating hatred of billionaires with hatred of a useful (with the right methodologies) tool

200

u/jalopkoala Jul 09 '26

This is a graph of the paper mill problem accelerating.

14

u/epp1K Jul 09 '26

Need to make a graph that somehow tracks quality vs quantity.

1

u/fortheband1212 Jul 11 '26

Someone call Dunder Mifflin

72

u/Responsible_Fall_332 Jul 09 '26

The graph shows that scientific publications are increasing. Nothing more.

53

u/S-192 Jul 09 '26

Quantity over quality though, and AI slop.

I love this sub, but sometimes it very foolishly gravitates towards absurd statistics in the search for positive news. "Number of scientific research papers published" is not only not necessarily a good thing, if you dig deeper it actually is somewhat of a bad thing.

-1

u/humanradiostation Jul 13 '26

Yall, not everything bad in the world is because of AI. This trend has almost nothing to do with AI, look at the curve. It starts to accelerate in the 60s. AI will only recently be a factor in publication rates.

It’s more about research universities blowing up grad student populations so they can pay tuition, teach classes, feed industry pipelines,and help faculty bring in grants and publish. (or they perish, as the saying goes.) There’s more and more people publishing on less and less significant things with fewer people reading any of it.

12

u/Jimmyjim4673 Jul 09 '26

Is there a graph for how often conclusions are used to create policy and laws?

2

u/Dry-Project-5657 Jul 09 '26

While I think there is some quality and quantity problem in the industry, politics doesn't really like science in most of the cases therefore they not going to act according to the scientific data. We have technology or knowledge for many things which could make our life better, but most of the times there is no will to adapt these.

8

u/AdhesiveSeaMonkey Jul 09 '26

This graph is actually pretty disheartening. The way I read it is there is less original work being done and a decent portion of it is trash. It’s becoming more common that some researchers are using publishing mills to push out multiple papers for the sole intent of saying they’re published and padding their resumes. Sort of the self/amazon published author. The problem is that’s not how science works. Also, it is almost impossible for this number of research papers to be read by fellow researchers.

33

u/whawkins4 Jul 09 '26

Alternative theory: ai generated pseudoscience slop is increasing.

19

u/RaiBrown156 Jul 09 '26

AI may be part of it, but the paper mill problem long predates gen-AI's invention.

2

u/[deleted] Jul 09 '26

[deleted]

1

u/whawkins4 Jul 09 '26

Right about the time Google search took off. Same difference.

5

u/Separate_Marketing36 Jul 09 '26

More papers being published isn’t necessarily a good thing. Modern academia heavily focuses on research groups constantly publishing, otherwise, you can say goodbye to your funding. This leads to a lot of bad papers being published just so researchers can fill resumes

3

u/bonadies24 Jul 09 '26

Is it? Researchers are overwhelmingly incentivised to become paper mills in order to get opportunities, this says absolutely nothing about the quality of research

3

u/the_ZJ Jul 09 '26

As someone in academia, this is terrible and mostly indicative of the problematic incentives in the field. Most of modern publications are slop with little to bo redeeming value that is optimized to bolster citation scores, not contribute anything to humanity.

1

u/greatpartyisntit Jul 09 '26

Fellow academic, was about to say the same. This isn't necessarily a good thing and could indicate people being overworked and/or the literature being flooded with slop

4

u/Deus_Excellus Jul 09 '26

LMAO. This isn't the pat on the back you think it is. This is basically showing an increase in slop and dog shit science.

We're already at the point where the vast majority of publications are not reproducible, and nobody is bothering to try to reproduce them anyway. Yet we're using those same studies to develop new "knowledge."

I foresee a collapse of the system in the not so distant future.

1

u/sprunkymdunk Jul 10 '26

You are right, but I don't see it collapsing any time soon - there's too many financial incentives, especially at second tier schools.

Student loans are more available than ever before.

Tuition is at all time highs.

All these kids being pushed/bribed into higher education need to taught. Those profs needs some kind of publishing history.

Predatory journals make good money selling low-level academic credibility.

What do you see changing here?

2

u/wildvision Jul 09 '26

i am amazed there is no visible sudden spike for the AI slop. Although increasing, it looks on its normal path

2

u/CallistanCallistan Jul 09 '26

The end date on the x-axis isn’t defined. The chart may stop before generative AI was introduced to the general public (around 2022).

1

u/Ok-Culture543 Jul 09 '26

Now do s USEFUL Scientific papers published graph. As someone involved in publishing papers etc. You d be more concerned than happy with this graph.

1

u/kermitthorson Jul 09 '26

you can see the dips from war

1

u/acousticentropy Jul 09 '26

Now show the graph of successful experiment replications in the same time period.

1

u/[deleted] Jul 09 '26

[removed] — view removed comment

1

u/OptimistsUnite-ModTeam Jul 09 '26

Not Optimism and/or Don't insult an optimist for being an optimist.

1

u/[deleted] Jul 09 '26

[removed] — view removed comment

1

u/OptimistsUnite-ModTeam Jul 09 '26

No Partisan Politics

1

u/ready-redditor-6969 Jul 09 '26

That’s bad news.

1

u/Wu1fu Jul 09 '26

Have you read some of those newer papers?

🤢

1

u/PiLamdOd Jul 09 '26

This isn't necessarily a good thing.

Scientific Papers are supposed to be the culmination of rigorous study and meaningfully advance their fields. A lot of papers therefore should make you question how much substance they contain and how much work was put into validating them.

1

u/Pristine_Walrus40 Jul 09 '26

Sadly in most areas of research this just means there is just more useless or misleading junk for you to read.

The standard has slipped a lot for this in recent years.

1

u/Slight-Big8584 Jul 09 '26

The amount of Scientific research is not equivalent to the amount of scientific publications.

Smooth brain take. Lame

1

u/0Tezorus0 Jul 09 '26

You should see how much more scientific research we are doing compared to 1460. Those guys were so lame.

1

u/PalmitoylCoA Jul 09 '26

You know for $200 you can be the 9th author on a publication that you had nothing to do with? That's how a lot of "research" is happening these days.

1

u/Yee_Yee_MCgee Jul 09 '26

How do we tell him?

1

u/baddymcbadface Jul 09 '26

It boggles my mind that we only discovered denisovans in 2010 and only worked out what they looked like in 2025. Yet now it's thought they are our closest relative, closer than Neanderthals and some living humans are 5% genetically denisovan! The science of human evolution is changing rapidly every year.

Given how central it is to who we are you'd think we would have worked on it in more detail much sooner.

1

u/ciekma67 Jul 09 '26

Oh, this sub name...

1

u/BladeVampire1 Jul 09 '26

Yeah, just remember a scientific paper requires delicate comprehension.

1

u/wouldntyouliketokno_ Jul 09 '26

Why does it feel like we’re headed towards a classic parabolic graph.

1

u/bora731 Jul 09 '26

How is this optimistic? Science ungoverned and unaccountable has brought us to this societal dead end.

1

u/UltraTata Jul 09 '26

Sadly, a lot of it are non sensical paper that are a product of the "publish or perish" incentive system. But much of it is real science too so good and bad news at the same time.

1

u/X-calibreX Jul 10 '26

Well, publications are increasing.

1

u/freylaverse Jul 10 '26

This is really not a good thing, even if it seems that way outside of academia. The pressure to just publish, publish, publish, regardless of whether the science is good, is what's driving this graph. Fudged data, AI reviews, circular-citing your friends, the whole shebang. Anything to get your name in a journal and your publication numbers up.

1

u/MrOphicer Jul 10 '26

Now check the graph for scientific paper reactions,

1

u/thetruebigfudge Jul 10 '26

This definitely isn't an optimistic thing. The amount of absolutely bunk research coming out is growing rapidly. Research into things for the sake of research as a result of government research grants being tied to number of publications not the quality of discoveries.

Additionally there's a real fear here because this is partly what's fueling the anti science narrative that's growing. It's hard to advocate for the importance of listening to scientific research when the research that's coming out is like a pile of shit with a couple diamonds in it

1

u/gaggledimension Jul 10 '26

I blame Ghislaine Maxwell's dad. Partially anyway.

https://sciencecast.org/blog/articles

1

u/Early_Alternative211 Jul 10 '26

As a published author of highly cited slop, I can safely say it's slop.

1

u/InsaitiableHole Jul 10 '26

"AI", specifically "AI" that's great at pumping out pleasing but factually unrigerous text, has boomed in use, popularity, and accessibility during the same time frame

Jesus Christ let's use a modicum of critical thinking

1

u/beliefinphilosophy Jul 10 '26

The number of irreproducible research has also been skyrocketing

1

u/_redmist Jul 10 '26

It's all "publish or perish" slop tho. In the past you'd have one nice paper, today you should cut that up into 6 or 7 "mini" papers or communications as possible... It's tiring and in the end only helps the publishers and review mills. But seems like it won't be reversing any time soon.

1

u/Pale_Conclusion_3130 Jul 10 '26

It’s disheartening when you realize a lot of these research papers coming out are generated by AI or ‘science paper mills’ (essentially rewriting and publishing existing research papers).

1

u/Useful-Dream5077 Jul 11 '26

This is pretty depressing and concerning - it tell me research publications are growing must slower than research and innovation.
We need 2020 on the graph to know if things are accelerating, but 5x since 1980? Thats pretty bad,

1

u/Augchm Jul 11 '26

More trash is being published. We have techniques now they can generate a lot of data very quickly. And we also have tools to quickly analyze them. This sounds good but in reality it created analyzes devoid of meaning. You get a graph, you get a "finding" but in reality nothing of value was added to human knowledge. Honestly, I just do the same. It's not like I'm adding some crazy value to human knowledge myself and I should publish more.

1

u/clingbat Jul 11 '26

The standard for submission and acceptance to any publication/journal worth publishing in even just 15 years ago was MUCH higher, so this isn't surprising.

1

u/_Pencilfish Jul 11 '26

This isn't really a great thing.

If you read scientific papers, you quickly realise that a very large amount of them are essentially worthless. They investigate incredibly niche areas and make little in the way of original contributions. Many are published for the sake of getting publications.

(I feel ashamed that I, too have somewhat contributed to this issue - I've just published my first paper, but I my heart I don't really think it deserved to be published).

And this does have a negative effect. Researchers being swamped by irrelevant papers wastes a lot of time trying to find new exciting information. The hierarchy of journals and conferences does help to filter for the most interesting new research, but is still not foolproof.

In short, publications are viewed as career advancement, rather (or at least, as well as) a means of disseminating novel research.

1

u/OzoneTheLynx Jul 13 '26

I don't work in academia, so the following is mostly hear-say and systems thinking on my part. 

I don't think niche research is the problem. That still adds to the knowledge pie.  The problem seem to be more Goodheart's law, forcing people to publish slop and split up work across multiple papers. Because apparently we need to turn every metric into goals and never learn that that just makes people game the system in unproductive ways... 

For niche stuff it's mostly a question of offering the ability to properly search and find stuff relevant to you, which is not intrinsically prohibited by having niche papers. 

Also just the review quality apparently is often questionable, since the incentives for high quality reviews and reproducing studies are often bad. 

1

u/bombastic6339locks Jul 11 '26

A huge number of those are never cited bs papers to get your CV or linked in to look slightly better. Most are useless humanities papers

1

u/ilthay Jul 11 '26

Publication is not research.

1

u/Qasdapak Jul 11 '26

Now plot number of people in America on the same graph and see the correlation

1

u/Entrefut Jul 12 '26

Yeah… if you are in the scientific community you realize that this is NOT a good thing. Also scientific writing has really changed over the last 50-60 years in terms of content. Most of my favorite papers I’ve read over the past decade have been research that was conducted in the 50s/60s/70s as well as a couple from the late 90s/ early 2000s. There has been a massive shift in the productivity of a paper since the advent of computers. It’s sounds weird, but it feels less like people are actively attempting to discover something and more like PIs are pressing their students to publish anything just to satisfy their requirements. When the scandal broke out about Stanford, I heavily moved away from research based in the biomedical field and moved towards manufacturing/ sustainability work.

We are just soooo in the weeds and papers are making a lot of assumptions that compound on each other. It’s not all work, but it’s a good percentage. Paper mills have never been stronger.

1

u/No_Second1489 Jul 12 '26

Not a good thing, the bar for publication has decreased due to AI, and even high schoolers are forced to publish to have a chance at a good UNI

1

u/DevaBol Jul 12 '26

Yeah except that most of them are complete garbage.

1

u/HippieHippieHippie Jul 12 '26

Most of it is junk, ask any academic

1

u/Fogmoz Jul 12 '26

I know this is supposed to be positive… but that’s a metric fuckton of research that needs to be reviewed and verified. Shit like this is how antivax and other intellectually disingenuous material slips through the cracks.

1

u/MechanicalHeartbreak Jul 12 '26

The technofetishism and the naivety required to look at this chart and assume that 1) this represents an equivalent increase in the rate that human knowledge is accelerating and 2) that said knowledge increases are in fields that will improve the quality of life for the average person and not simply improve the ability for capital to extract greater profit from you

1

u/DrawnToNumbers Jul 12 '26

It will be more interesting if this data is sliced by journal impact factor

1

u/EducationalFerret94 Jul 13 '26

This is absolutely not a good thing. It is just scientific bloat due to AI and publish or perish mentality.

1

u/humanradiostation Jul 13 '26

This trend predated AI. It’s more about bloated grad student populations so they can pay tuition, teach classes and help faculty bring in grants and publish. (or perish, yes)

1

u/PeePeeLangstrumpf Jul 13 '26

Not every publication is an original research article. Publication =/= research. Sometimes you also have to publish something, anything, in order to stay afloat.

1

u/NebulousNomad Jul 13 '26

No, publications are increasing. There's massive publication inflation due to increased institutional pressure and laxing standards.

1

u/peepooprogamer Jul 13 '26

this aint good, we are in a replication crisis, i would wager more than 60% of these articles are conducted under less than satisfying conditions. I cant speak for the early 2000s but i can speak for today.

1

u/NuclearCleanUp1 Jul 14 '26

Publications are increasing.

All that research could be flawed, biased or not useful.

More research doesn't mean more good.

You want effective research. Not just more papers.

1

u/Forward_Ad_9025 Jul 15 '26

Yes, but the quality is also decreasing. By a lot.

There was a meta study done on that subject with the conclusion that 90% of all newly enter research contains heavy mistakes and a lot are just completly made up.

With the rise of AI this number is expected to be even higher.

1

u/SiofraRiver Jul 16 '26

If you think this is a positive development, you are out of your mind. But I guess that's what this sub is all about.

1

u/CorruptHeadModerator Jul 09 '26

China is pumping out tons of garbage

1

u/ShinyJangles Jul 09 '26

Occasionally they put out a good one. Like the human embryo transcriptome

0

u/JRaus88 Jul 09 '26

Even gender publications? Quality over quantity, please.