First-frame + Last-frame workflow for video generation?

#12
by Dodome - opened

In older video workflows, we could provide a starting image and an ending image, and the model would generate the frames in between.
Is something like that possible with LTX-2 right now? Is there any workaround or planned support?

@Dodome yes, it's absolutely possible

see this workflow (native Comfy)

https://gist.github.com/kabachuha/dafd6952bdc00050b4d6b594d11bec6c

@kabachuha Thank you, it worked.

I just tried it. It made the most jank output ever. Instantly abandoned the first frame input and the last frame is something out of lala land. Im not sure what is going on here but that wonder.json workflow does NOT work.

I just tried it. It made the most jank output ever. Instantly abandoned the first frame input and the last frame is something out of lala land. Im not sure what is going on here but that wonder.json workflow does NOT work.

Yeah, it's not yet supported properly but it works play with the strength of frame_idx.
Though it won't give you good results always, for me it worked on some tests.

@Dodome yes, it's absolutely possible

see this workflow (native Comfy)

https://gist.github.com/kabachuha/dafd6952bdc00050b4d6b594d11bec6c

Hello sir, i want to make a difficult transition from this image

4Gemini_Generated_Image_nclz4cnclz4cnclz

to this image

4.2Gemini_Generated_Image_a2dicaa2dicaa2di

BUT RESULT COMES OUT TOO JUMPY, no smooth transition at all

JUST WONDERING, what happens if i change this strength?

adada

will it help somehow?

i have triend many SELF made prompts, but also tried this gemini made prompt using YOUR sample prompt

Video Style & Mood:
Cinematic, claustrophobic luxury, neo-noir, high-contrast lighting, seamless interior-exterior transition, fast-paced bokeh, 24fps.

Scene 1 (The Street Approach):
A cinematic medium shot in the gritty alley. Marlon is already in the driver’s seat of a dark luxury car, the engine idling with a low growl. The camera focuses on Julio (the bald man) as he walks decisively toward the rear passenger door. Paco (fade haircut) is already positioned on the other side. The wet pavement reflects the red and amber glow of the car's taillights.

Transition 1 (Entering the Vehicle):
As Julio reaches for the door handle, the camera follows his hand in a tight tracking motion. As the door opens, the camera "glides" inside the cabin behind him—no cut—transitioning from the cold, foggy street air to the warm, red-lit interior of the luxury car. The sound of the street muffles as the door heavy-clicks shut.

Scene 2 (Inside the Cabin):
The camera settles into a wide interior angle. Marlon (goatee/leather coat) is visible in the foreground at the steering wheel, his gold grills catching the sharp red light from the dashboard. Julio (shaved head) and Paco (fade haircut) occupy the back seat, the shadows of the city passing over their faces. They are calmly checking their weapons, the metal glinting in the dark.

Final Scene (The Vow):
Marlon’s eyes shift to the rearview mirror, locking his sharp gaze with the camera. In a cinematic close-up reflected in the mirror, Marlon says firmly: “The city is ours tonight. No turning back.” Outside the windows, the city lights blur into a high-speed bokeh effect as the car accelerates into the night.

AND I STILL DONT GET A GOOD RESULT AFTER 5 attempts,,,,, what do you recommend? are the images TOO different to make a nice transition? on WAN 2.2 FLF i can make it easier...... but i want to achieve it HERE on LTX 2

Sign up or log in to comment