Tutorial – How to use Prompt Travel with ControlNet (Stable Diffusion)
Timestamps:
0:00 [Intro] Example of prompt traveling with smooth transitions
0:39 [Intro] Introduction to scope of tutorial
0:55 [AUTOMATIC1111] Installation of Prompt Travel extension
1:16 [AUTOMATIC1111] Setting up for prompt travel generation
3:37 [AUTOMATIC1111] Generating without ControlNet as a point of reference
4:16 [AUTOMATIC1111] Generating with ControlNet active
4:41 [FFmpeg] Stitching the frames with FFmpeg
5:57 [Flowframes] Interpolating the video with Flowframes to make it longer and smoother
7:26 [Outro] Output video
.........................................
Links:
Previous tutorial (which this tutorial builds upon):
• Tutorial – How to use Stable Diffusio...
Tutorial assets for previous tutorial (including prompt recipe used in this one):
https://drive.google.com/drive/folder...
Prompt Travel extension:
https://github.com/Kahsolt/stable-dif...
Flowframes:
https://github.com/n00mkrad/flowframes
https://nmkd.itch.io/flowframes
.........................................
PowerShell FFmpeg command (make sure to change the command so that the first part reflects where you personally have FFmpeg installed):
D:\FFmpeg\ffmpeg-2023-05-18-git-01d9a84ef5-full_build\bin\ffmpeg.exe -f image2 -framerate 10 -i "output (%d).jpg" -r 10 Animation.mp4
.........................................
Hardware requirements:
NVIDIA dedicated GPU with minimum 6 GB of VRAM
.........................................
This tutorial demonstrates to KTH Architecture students how to use the Stable Diffusion extensions Prompt Travel and ControlNet to generate a transitional animation between prompts.
Prompt traveling uses a single seed to reduce excessive variety/flickering in the transition, so using wildcards (of the Dynamic Prompts extension) is of no use, since that uses different seeds to create variety (thus resulting in no variety for the same seed when prompt traveling).
The operating system used for this tutorial is Windows 10. Running another operating system (e.g. Linux, MacOS) might amount to a different user experience or software incompatibility.
If you want to check in which computer room(s) any relevant software might be installed in – CADLAB, DFL, and ARCPLAN are in the KTH School of Architecture building – please check the following link for current status:
https://www.kth.se/en/student/it/camp...
Disclaimer:
This tutorial aims to increase student awareness of the versatility of the digital tools available for use within the context of the architectural education offered by KTH. As such, it might not be generally applicable, but on the other hand, if at least one architecture student is helped by it in fulfilling deliverables requirements or being taught something of genuine interest, the purpose of this tutorial is satisfactorily achieved. There might be inaccuracies in this tutorial – if you identify any significant one, please tell us in the comments.
![Tutorial – How to find the best free Digital Elevation Model for use in QGIS as a heightmap [GLO-30]](https://images.videosashka.com/watch/nHV8sW2BUhQ)
