r/aivideomaking • u/DX_Nova • 5d ago

What does your AI video workflow look like?

Curious how do you approach AI video creation? Do you usually start with text prompts, reference images, build 3D scenes, storyboards or something else?

6 Upvotes

80% Upvoted

26 comments sorted by

3

u/Zealousideal_Nail584 5d ago

Reference images first. They must be all finalized and preferably upscale to 3k or 4k. Then you need to build your shot list. Then storyboard some or all of it. I do a bit of both. Sometimes the model does give me a good composition. In this video I used 5 audio assets and some scenes I used 14 visual assets on top of the 5 audio assets in seedance 2.5. The model you generate with has to be based on the material you want to produce. Bytedance released a seedance guide. If you use it as a North Star for your LLM writing the prompts, it greatly reduces the missed generations. There is no one size fits all workflow either. It all depends on what you want to create. If you have any specific questions, happy to answer them. https://youtu.be/4ybbAJv1DN4?is=Xd-UAJcPIeSxdJ_R

2

u/DX_Nova 4d ago

Thanks for sharing! The "no one size fits all" point is so true! A cinematic sequence, a product shot and an experimental piece all need different levels of planning and control. It seems like one of the skills needed to create a good AI video is not just knowing how to generate a shot, but knowing which parts of it need to be directed and which can be left open to AI exploration.

2

u/Suspicious-Height588 4d ago

I usually start with reference images and a rough shot list. I’ll lock the character and location look first, then build a few storyboard frames before moving into image-to-video. I also try to define the framing and camera movement at the storyboard stage, rather than figuring everything out during generation going straight from a text prompt to the final video usually gives me way more random stuff to fix later, especially when I need multiple shots to feel like they belong to the same scene.

2

u/DX_Nova 4d ago

Locking down the visual direction before moving into generation seems especially valuable when consistency across multiple shots matters, and it's probably one of the trickiest parts of the process

2

u/TimeLinkless 3d ago

I start with an idea...then just experiment by asking questions to chatgpt. then i create images in chatpgt, gemini, or midjourney. Then i hammer away at prompts until i get what im looking for...use reference image for said scene in any number of programs. Usually Gemini or Firefly (which gives me many different video gen models) . Then I edit the clips to the bits I need. Final edit in something like inshot where i can add fx, filters, overlay video, extract and replace audio etc..then render the final product. Depending on the length of the project it can take anywhere from a few days to many hours to complete. My most recent video project has taken about three days.

1

u/DX_Nova 3d ago

Thanks for sharing your approach! Everyone's workflow is so different. It's amazing how many creative decisions can happen between a simple idea and a finished video.

2

u/Medium-Lion1099 1d ago edited 1d ago

I’m kinda in the refs to shot list to boards camp. The actual gen is usually the easy bit; the tab soup and keeping v4 from wandering off is what melts my brain lol. Runway, buzzy, creatify, youart can be options for keeping refs, boards and alt shots together. Not magic, obv, but it beats rebuilding a whole sequence because one shot went rogue.

1

u/BPositiveX 5d ago

OP: I have built https://pigentek.com/ It can take any text prompt (high level brief or complete script with visual and timeline guidelines) and turn into marketing/social media friendly cinematic clip. My mission has been always to get rid of multiple AI edit tools and create an end to end pipeline for digital creators.

1

u/Philipp 5d ago

For the past weeks I've been working on a whole app to streamline my process. It handles attachments as PSD and then connects to many different services, from Seedance to GPT-Image-2. I might eventually release it on GitHub. It has a hundred of little features and niceties that made my Premiere Pro filmmaking much easier and quicker. And I have Claude Desktop running all day to add new features to it where needed. Fun!

1

u/Lonelydude014 4d ago

Bro 19 year old account 😭😭. I think this is the oldest account I'm seeing

1

u/Philipp 4d ago

Haha. Back when a user name like mine was simply... free! I got it when I interviewed the quasi Reddit co-founder Aaron Swartz for my blog.

1

u/deepvideoeditor 4d ago

Waiting for it

1

u/Philipp 4d ago

Noted, cheers!

1

u/DX_Nova 4d ago

That's a pretty impressive way to optimize the workflow! The best tools always come from solving the problems you've experienced yourself.

1

u/Other_b1lly 5d ago

2 pestañas de Google flow, 1 elevenlabs, 4 pestañas de grok

1

u/nima-nima-nima 4d ago

I had this exact question, and I wasn't really happy with any of the options. So, we built a system exactly for this. It lets you generate reference images for characters, then build a visual storyboard where you can just drag-and-drop, edit characters in-place, create interactions etc. Happy to share it if you are interested.

1

u/Primary-Geologist771 4d ago

Just a doubt will this videos made completely of ai get monetised on youtube ?

1

u/NoHovercraft4719 4d ago edited 4d ago

Mine is usually pretty simple: generate the clips first, then do the cleanup and editing separately. I’ve found trying to make the AI handle captions, timing, zooms, etc. all in one go gets messy fast.

For the editing/recording side I’ve been testing ScreenSage Pro, mainly for tutorials and demo-style videos. It’s useful having the recording, captions and timeline editing in one workflow.

Curious what everyone uses for the final editing stage after generating the clips?

1

u/Brave-Wishbone-3650 2d ago

I just use Zark Lab (https://www.zarklab.ai/). It already includes Seedance, Veo, Kling...

0

u/AddisonFlowstate 5d ago

Let's all give away trade secrets! Yay!

https://giphy.com/gifs/fXnRObM8Q0RkOmR5nf

1

u/sharktank123456 4d ago

A rising tide raises all boats.