How To Use

Add a few scenes and enter a story for them, a TTS will be speaking them back, for now no voice controls.

If you want to remove a scene hit the - next to it

Run the process by clicking submit.

If you want to have audio reactivity you can click the Enable music peak detection for strength.

This will give you the final length of the video, you need this value to match the music length entered. Either cut the audio, or change the scene

Scene length is currently limited to 75 words

Suggestion

Any part you want to see a specific image of, make it its own scene the more descriptive the better

You can use the auto generated scenes, but they are pretty random.

A way to come up with a story is to ask for a short 3-6 scene story from claude.ai you want the scenes to be 75 words max

If you want to check if the system is available currently going to discord to see if its in a run is the easiest way, ill add an indicator here soon

Notes

now using dreamsharperxl10alpha2 and SD XL 1.0 refined for the deforum run

The system currently has only 1 node running the API with limited queing, so if someone else is using it the generation start after theirs is done