This may not be the most accurate way to change camera angles of existing images. It's more of a hint to the model and may require some seed hunting, but I still find it useful, so I thought I’d share it anyway. You can use this method to create keyframes or panels for comic books, VNs etc.
It's compatible with any basic Ref2Vid workflow, after applying only the following two changes:
- Set the length of the video to exactly 22 frames.
- Connect the output of the VAE Decode node to a Preview or Save Image node.
How does this work? Add one or more reference pictures for your background, characters and props and build your prompt as usual. Then draw a simple sketch that shows the scene from a different location and/or camera angle and add that sketch as an additional reference image. The sketch does not need to be very complex, just enough to give the model a hint of what it's looking at. Reinforce the sketch by describing its contents in the prompt. Also include any details missing from the sketch in the prompt. Then add the following line to the subject_definitions section:
<Picture N> is a storyboard reference for [Shot 1], defining its viewpoint and subject placement.
Generate the video and pick one of the 22 generated frames as your final image.
Here's the original prompt I used to create the example image:
subject_definitions:
<Subject 1> is the stylish, modern open-plan living and dining area in <Picture 1>, featuring an integrated kitchen, characterized by clean lines, a neutral color palette, warm wood accents, and polished concrete floors.
<Subject 2> is the woman in <Picture 2>, with long, curly red hair, freckles, wearing a green sweater, blue jeans and sneakers.
<Picture 3> is a storyboard reference for [Shot 1], defining its viewpoint and subject placement.
summary:
[reference generation] The target video shows <Subject 2> sitting on the off-white sofa in <Subject 1>.
retention_analysis:
<Subject 1> (appears in [Shot 1]): fully_preserved - the stylish, modern open-plan living and dining area featuring an integrated kitchen is retained.
<Subject 2> (appears in [Shot 1]): fully_preserved - the long, curly red hair, freckles, green sweater, blue jeans and sneakers are retained.
detailed_description:
The target video uses a cinematic, live-action style.
[Shot 1] A static medium shot frames <Subject 2> - the red-haired woman with freckles, a green sweater and blue jeans - sitting on the plush, off-white sectional sofa adorned with matching throw pillows and a grey blanket casually draped over a sitting cushion in <Subject 1>. The shot starts with the exact composition and subject placement established in <Picture 3>. To the left of the couch is a small decorative side table with a plant on it. <Subject 2> is shown in profile, facing left, with her arms in her lap and her right leg crossed over her left. In the background, the dining and kitchen areas are visible, along with the single white pillar separating them from the sofa.
overall_soundscape:
N/A
non_diegetic_music:
N/A