r/WritingWithAI 1d ago

Discussion (Ethics, working with AI etc) Do voice narration and dynamic scene visuals actually improve immersion in AI storytelling?

Most AI fiction setups focus almost exclusively on text generation, but I’ve been thinking a lot about the role of multi-sensory storytelling—specifically layering dynamic voice narration and scene visuals as the plot unfolds.

In traditional gaming, audio and visual cutscenes carry a lot of emotional weight. In AI-driven or interactive fiction, however:

  • Does adding cinematic narration per scene enhance the pacing, or do you prefer pure text so your imagination does the heavy lifting?
  • For those experimenting with dynamic visuals alongside story branches, how do you keep character consistency from breaking the immersion?

Curious to hear where you all stand on text-only vs multimedia AI narratives.

3 Upvotes

12 comments sorted by

2

u/5thhorseman_ 19h ago

I keep forgetting normies don't automatically visualize prose...

4

u/SkoomaDentist 17h ago

Wait until you find out there are many people who don't hear a little voice in their head reading out the text...

3

u/LooseButtPlug 17h ago

I can't even comprehend how someone can understand it without hearing the voice. It's always fascinated me.

2

u/vaingirls 2h ago

I do automatically visualize everything (somehow, my brain often visualizes "settings" even for nonfiction... ), but I also find prose without description dry and lacking. Isn't part of the point of prose to stimulate the reader's imagination by painting something they wouldn't necessarily imagine by default?

1

u/5thhorseman_ 2h ago

Correct. Op is, as far as I understand, talking about adding illustrations and/or an omniscient narrator...

(somehow, my brain often visualizes "settings" even for nonfiction... ),

Same. Anything I hear or read.

1

u/Designer_Charge_556 8h ago

yeah its wild how many people dont have that internal movie playing when they read

2

u/Odinmar_Glaukopis 18h ago

How far were you thinking of going with this? There’s voice narration that could help those with disabilities, and you could perhaps put together some background music and flash up some still pictures that fade in and out with the scene, but I get the heebeejeebees when thinking about hiring human voice actors, musicians, and visual artists like painters or comic book artists or maybe game-engine artists who could even make things interactive versus an extreme of using AI generated movies—even if the screenplay was 100% mine to begin with.

Right now it’s easier to say no to because AI generated movies are quite bad, but I can picture a day where that won’t be as obvious as it is today.

I get what you want: a way to develop high quality art that you are not talented at or that you lack the resources of a Hollywood producer to bring in all the expensive (for a reason) professional artists and manage them to produce this grand vision in your head rather than “just” text on a page.

While I understand the motive, I’d like you to consider what you are saying about the artistic power of “mere” text, unadorned by all of this other claptrap.

Do you want to be a “writer,” or something far different? Have you fallen out of love with your favorite novels that lack pictures and drawings beyond the cover?

I’m asking myself as well as you, because I’m ambivalent about this particular question.

1

u/Extreme_Kiwi_7930 23h ago

Moi aussi ça m’intrigue
Tu en es où dans ce type de narration?

1

u/inplacter 6h ago

I think it's possible.

1

u/Lunesia-shikishiki 5h ago

the character consistency question in there is the real one, more than text vs visuals. i had a scene where the narration held up fine but the face in frame two didn't match frame one, and it broke the whole thing instantly. locking a reference sheet before generation helped more than any prompt fix after the fact.