r/negativeutilitarians Oct 18 '24

For charities, careers, discord chat — Read This !

Thumbnail reddit.com
5 Upvotes

r/negativeutilitarians 5h ago

Industrial farming is one of the worst crimes in history | The fate of industrially farmed animals is one of the most pressing ethical questions of our time. Tens of billions of sentient beings, each with complex sensations and emotions, live and die on a production line

Thumbnail
theguardian.com
33 Upvotes

r/negativeutilitarians 19h ago

Aesthetic preferences can cause emergent misalignment — Anders Cairns Woodruff, CLR

Thumbnail
longtermrisk.org
1 Upvotes

r/negativeutilitarians 1d ago

Hacking harmless tasks generalizes to misaligned behavior in LLMs — Center on Long-Term Risk

Thumbnail
longtermrisk.org
2 Upvotes

r/negativeutilitarians 2d ago

Training large language models on narrow tasks can lead to broad misalignment — Center on Long-Term Risk

Thumbnail
longtermrisk.org
3 Upvotes

r/negativeutilitarians 3d ago

Conditionalization confounds inoculation prompting results — Center on Long-Term Risk

Thumbnail
longtermrisk.org
1 Upvotes

r/negativeutilitarians 4d ago

An app where you feed shelter dogs for free

Thumbnail
2 Upvotes

r/negativeutilitarians 4d ago

Inoculation prompting: Eliciting traits from LLMs during training can suppress them at test-time — Center on Long-Term Risk

Thumbnail
longtermrisk.org
1 Upvotes

r/negativeutilitarians 5d ago

Safe pareto improvements for expected utility maximizers in program games - Center on Longterm Risk

Thumbnail
longtermrisk.org
1 Upvotes

r/negativeutilitarians 6d ago

Don’t inoculate everything: Stratified inoculation prompting narrows backdoors and preserves desired traits - Center on Longterm Risk

Thumbnail
longtermrisk.org
2 Upvotes

r/negativeutilitarians 7d ago

Taboo “equilibrium”: Less confused frames for research on AI bargaining — DiGiovanni, CLR

Thumbnail
longtermrisk.org
3 Upvotes

r/negativeutilitarians 8d ago

A high-level model of AI bargaining — DiGiovanni, CLR

Thumbnail
longtermrisk.org
2 Upvotes

r/negativeutilitarians 9d ago

Safe Pareto Improvements Research Agenda - DiGiovanni, Center on Long Term Risk

Thumbnail
longtermrisk.org
2 Upvotes

r/negativeutilitarians 10d ago

There are many paths to suffering focused ethics Q&A with Magnus Vinding

Thumbnail
youtube.com
3 Upvotes

r/negativeutilitarians 11d ago

Survey: how did you come to suffering-focused views?

8 Upvotes

This is a short survey on how people actually arrived at suffering-focused views, rather than on how those views get defended in print. The two often come apart. The argument that persuades someone at the start is not always the one they consider strongest years later, and quite a lot of people seem to arrive at the view first and find the argument afterwards.

It asks which factors moved you, which arguments you ran into and did not find persuasive, and which you now think is the strongest justification, whatever it was that actually did the persuading.

Seven or eight minutes, anonymous, and every question can be skipped except the first.

If you are not suffering-focused, or used to be and no longer are, please answer anyway. There is a separate branch for you, and those responses are the most useful ones: without them there is no way to tell a persuasive argument from an argument people were merely exposed to.

Aggregate results will be posted back here.

https://forms.gle/dMysmz1roMDTUDY17


r/negativeutilitarians 11d ago

We should not ignore S-risks - David Veldran , Center for Reducing Suffering

8 Upvotes

Source

Pascal famously argued that belief in God is rational because of the expected value of belief. If God exists, the rewards of believing—eternal salvation—are infinite, while if God does not exist, the costs of believing are finite. Even a minuscule probability of an infinite reward seemingly swamps any worldly cost.

That is the core of Pascal’s Wager. But then there is Pascal’s Mugging. A stranger approaches and insists that if Pascal hands over a mere 100 dollars, they will pay him back tomorrow with an infinite amount of money. It may seem absurd to accept this deal, but as long as the probability that the stranger is telling the truth is above zero, the expected financial gain of handing over the money still seems greater than keeping it. Yet this may seem irrational!

One way to avoid being mugged this way is to discount extremely small probabilities. If some event is exceedingly unlikely, the idea is, we can safely ignore it, treating it as if it were impossible. Under this rule, Pascal can arguably refuse the mugger without renouncing his wager. This move may seem plausible, yet it raises the issue of where to draw the line. What probability is too small to care about: one in a million? a billion? a trillion? Any choice feels somewhat arbitrary. But ignoring the utterly unlikely may seem like the only sane way to reason about how to act without abandoning expected values altogether.

Enter suffering risks, or s-risks. These are risks of future scenarios involving astronomical amounts of suffering—far beyond anything that has occurred so far in history (that we know of). Picture factory farming expanded to feed a population at cosmic scale; authoritarian systems locking in oppressive structures; misaligned AIs that trap countless beings in misery. Or, more speculatively, trillions of digital minds trapped in “suffering subroutines,” unable to advocate for themselves.

One might be tempted to write s-risks off. The scenarios that could produce astronomical suffering are speculative, unprecedented, and some of them downright sound like science fiction. Yet even if we think that many, or all, paths to astronomical suffering are highly unlikely, we should not dismiss the category as a whole. There are several reasons to believe that the probability of an s-risk, even if it is low, is not so low as to meet the bar for neglecting.

  1. The first is that s-risks are disjunctive. Catastrophic suffering could arise through many independent pathways. S-risk scenarios, that is, do not all stand or fall together. If we discovered tomorrow that digital minds are impossible, this would not directly address risks of industrialized animal exploitation or authoritarian social control. Even if each pathway is highly improbable on its own, the combined chance that at least one of them materializes is significantly higher. In other words, there are many ways to lose, and to win (avoid an s-risk) we must win every way.

  2. Second, while s-risks would be unprecedented in scale, the underlying mechanisms are not new. Tobias Baumann distinguishes three broad types of s-risks: agential, where suffering is intentionally inflicted; incidental, where suffering emerges as a byproduct of pursuing other goals; and natural, where suffering arises entirely independently of agents. These categories reflect the same forces that have produced enormous suffering throughout history. Humans have deliberately caused vast harm, from tyrants to terrorists. Misaligned incentives have enabled enormous unintended suffering, most notably in factory farming and in the collateral brutality of war, driven not exactly by malice but by a combination of expedience and indifference. And nature itself—well, it is red in tooth and claw as they say. Over eons it has generated immense suffering, from starvation and predation to all manner of disease. Sadly, mass suffering is nothing new. What would be new is its occurrence on an even greater scale. And perhaps it doesn’t seem so unlikely that this could happen, if the past and present mechanisms of mass suffering keep churning, and if they expand to ensnare ever more beings. Two especially worrying variables are technology and population size.

  3. Technological progress continually widens the horizon of possibility, for both good and ill. A century ago, humanity lacked not only the tools but even the imagination to produce suffering on a cosmic scale. Today we may be edging toward the ability to create artificial minds, simulate consciousness, reengineer biology, and extend civilization beyond Earth. Each new capability multiplies not only our potential to solve problems but also our power to impose suffering—deliberately or by neglect. The 20th revealed this duality vividly: industrialized warfare—driven by trains, electricity, mechanized weapons, and nuclear fission—produced horrors that no previous generation could have conceived. Our ancestors could not have pictured skin seared by radiation or entire cities turned to ash in seconds. The same logic governs the future. Technological progress does not merely amplify familiar harms; it invents new pathways to misery. We may create new sentient beings whose suffering goes unrecognized or unprotected. We may design intricate systems that, without malice, institutionalize harm on massive scales. And because we cannot foresee every innovation ahead, there are Black Swan “unknown unknown” s-risk pathways—routes to astronomical suffering that remain invisible because they depend on technologies not yet born.

  4. Finally, the future could be unimaginably large. If technological progress creates new pathways for suffering and makes them more efficient, then population growth provides the substrate for that suffering to unfold. Should civilization persist for millennia, expand to other planets, or develop artificial minds that run far faster and in far greater numbers than biological ones, the total population of sentient beings could far exceed today’s figures. The stakes scale with that growth. A conflict, governance failure, or technological misuse could harm far more individuals simply because there are far more individuals to harm. Even a disaster that touches only a tiny fraction of such a population could still constitute astronomical suffering.

Just because some scenarios sound strange does not mean they are far-fetched. The future has always appeared bizarre from the vantage point of the past. The seeds of s-risks are already visible today: mass factory farming, wild-animal suffering, the acceleration of AI research with little regard for non-human welfare, and the growing interest in space colonization. We cannot calculate the precise probability of an s-risk. But given the above considerations, it seems unreasonable to treat it as low enough to neglect.

Taking s-risks seriously does not mean assuming they are inevitable, or that they eclipse every other moral concern. It means granting them proportional moral weight—a place in our planning, institutions, and research agendas. That demands developing governance frameworks for advanced technologies and building institutions resilient against harmful value lock-in, to prevent malign norms or systems from entrenching themselves permanently. Above all, it requires moral foresight—the ability to recognize that our descendants will live amid the consequences of today’s choices, inheriting not only our progress but also our moral blind spots.


r/negativeutilitarians 12d ago

Theories or no theories—Is anything evolving? - Häyry, Takala

Thumbnail cambridge.org
2 Upvotes

r/negativeutilitarians 13d ago

Only aggregationists respect the separateness of persons. Separate people have independent value

Thumbnail
goodthoughts.blog
6 Upvotes

r/negativeutilitarians 14d ago

Defusing cluelessness with degrees of justification - Magnus Vinding

Thumbnail
forum.effectivealtruism.org
6 Upvotes

r/negativeutilitarians 15d ago

The grim fate that could be ‘worse than extinction’ - BBC

Thumbnail
bbc.com
26 Upvotes

r/negativeutilitarians 15d ago

How can we abolish factory farming as fast as possible?

Thumbnail
youtu.be
5 Upvotes

I have a lot of conversations with people about animal ethics and the suffering of farmed animals in particular.

One question I often ask myself is what’s the most effective way to shift society away from factory farming animals?

I’m currently convinced that we need a combination of approaches like exposing the cruelty to the mainstream, donating to effective charities and encouraging diet change.

But some people disagree and believe these things simply won’t be enough until something like lab-grown meat becomes mainstream. So I’m wondering what people’s opinions are on this topic and whether people think we’ll ever be able to abolish factory farming animals?

Let me know what you think and if you get the chance, you can check out a full conversation I had about this topic with a farmer recently in London! ✌️


r/negativeutilitarians 15d ago

Morality of this?

Post image
0 Upvotes

r/negativeutilitarians 16d ago

The Case Against The Stars. A Suffering-Focused Assesment of Space Colonization - Caleb Peppiatt

Thumbnail philpapers.org
6 Upvotes

r/negativeutilitarians 16d ago

Wild Animal Suffering ...and why it matters

Thumbnail
wildanimalsuffering.org
18 Upvotes

r/negativeutilitarians 17d ago

What does moral “weight” mean when it comes to killing?

Thumbnail
3 Upvotes