A free generative AI movie studio integrated into the Blender Video Editor.
0001-2199.mp4
AI-generate video, image, and audio from text prompts or video, image, or text strips.
This matrix provides a quick overview of the core generative capabilities, mapping input types to possible outputs.
| Input | Image | Video | Text | Audio | Music | Speech |
|---|---|---|---|---|---|---|
| Text | ✅ | ✅ | ✅ | ✅ | ✅ | ✅ |
| Image | ✅ | ✅ | ✅ | ✅ | ||
| Video | ✅ | ✅ | ✅ | ✅ |
| Text to video | Text to image | Text to text |
| Text to speech | Text to audio | Text to music |
| Image to image | Image to video | Image to text |
| Video to video | Video to Image | Video to text |
| ControlNet | OpenPose | Canny |
| ADetailer | IP Adapter Face | IP Adapter Style |
| Multiple LoRAs | LoRA Weight | Style selector |
| Seed | Quality steps | Strip power |
| Frames (Duration) | Word power | Model card selector |
| Batch conversion | Batch refinement of images. | Prompt batching |
| Batch upscale & refinement of movies. | Render-to-path selector. | Render finished notification. |
| User-defined file path for generated files. | Seed and prompt added to strip name. | One-click install and uninstall dependencies. |
- Windows. Limited support for Linux and MacOS
- Blender 4.5.3
- A CUDA-supported Nvidia card with at least 6 GB VRAM or MPS.
- CUDA: 12.4
- 20+ GB HDD. (Each model is 6+ GB).
For Mac and Linux, we'll have to rely on contributor support. So, post your issues here for Mac: #106 and here for Linux: #105, and hope some contributor wants to help you out.
-
First, download and install git (must be on PATH): https://git-scm.com/downloads
-
Download Blender 4.5.3 (not 5.0) https://builder.blender.org/download/daily/ and unzip it into the Documents folder.
-
Download the add-on: https://github.com/tin2tin/text_to_video/archive/refs/heads/main.zip
-
On Windows, right-click on the Blender(blender.exe) icon and "Run Blender as Administrator"(or you'll get write permission errors).
-
Install the add-on as usual: Preferences > Add-ons > Install > select file > enable the add-on.
-
In the Generative AI add-on preferences, hit the "Uninstall Dependencies" button (to clear out any incompatible libs).
-
Restart Blender via "Run as Administrator".
-
In the Generative AI add-on preferences, hit the "Install Dependencies" button.
-
Restart the computer and run Blender via "Run as Administrator".
-
Open the add-on UI in the Sequencer > Sidebar > Generative AI.
-
5-10 GB must be downloaded first the first time any model is executed.
-
When you have Pallaidium installed, reach out on Discord: https://discord.gg/HMYpnPzbTm or leave a note on how it is working for you. It means the world to me to know someone is using it!
| If any Python modules are missing, use this add-on to install them manually: |
|---|
| https://github.com/tin2tin/blender_pip |
| If "WARNING: Failed to find MSVC", install "Tools for Visual Studio": |
| https://aka.ms/vs/17/release/vs_BuildTools.exe |
| If error: "Missing DLL", install Microsoft Visual C++ Redistributable: |
| https://learn.microsoft.com/en-us/cpp/windows/latest-supported-vc-redist?view=msvc-170 |
Hugging Face Diffusers models are downloaded from the hub and saved to a local cache directory. Delete the folder manually:
On Linux and macOS: ~/.cache/huggingface/hub
On Windows: %userprofile%\.cache\huggingface\hub
The addon panel is located in the Video Sequence Editor > Sidebar (N-Panel) > Generative AI tab.
- Choose Output: In the "Output" section of the panel, select whether you want to generate an
Image,Video,Audio, orText. - Select Model: Based on your output choice, select a specific AI model from the dropdown list.
- Set Input:
- For Prompts: Leave the
Inputdropdown onPrompts. - For Strips: Select one or more strips in the VSE timeline and set the
Inputdropdown toStrips.
- For Prompts: Leave the
- Configure: Enter your text prompts and adjust parameters like resolution, quality steps, and guidance scale.
- Generate:
- If using
Prompts, click theGeneratebutton. - If using
Strips, click theGenerate from Stripsbutton.
- If using
The generated media will be saved to the directory specified in the addon preferences and automatically added to your VSE timeline on a new channel.
2026-01-23: Add: Support for BFL-FLUX.2 Klein 4B and 9B
2025-11-28: Add: FLUX2 & Z-Image & Optimized model-loading
2025-10-27: Remove 30 dead models.
2025-10-1: Fix: Deps. Add: Qwen Multi-image Edit.
2025-7-05: Add: FLUX Kontext Relight.
Older Changes
2025-6-26: Add: FLUX.1 Dev Kontext. Update Diffusers by installing this: "git+https://github.com/huggingface/diffusers.git" with the Python Module Manager add-on (link below), and restart Blender.
2025-6-22: Add: Long string parsing for Chatterbox (for Audiobooks). Use Blender 5.0 Alpha.
2025-6-14: Add: Chroma txt2vid
2025-6-12: Add: ZuluVision/MoviiGen1.1_Prompt_Rewriter
2025-6-01: Add: Chatterbox with zero shot text to speech and speech to speech voice cloning.
2025_5_29: Add: Flux depth+canny+redux Fix: neg Flux input + py libs
2025-5-12: Add: F5-TTS Voice Cloning
2025-5-09: Update: LTX 0.9.7 w. img, txt & vid input
2025-5-08: FramePack (Img/+Last Img), Img+txt for MMAudio, Flux De-distilled
2025-4-11: Improved LTX 0.95, MetaData, StripPicker, Wan t2i
2025-2-25: Add: MMAudio for Video to Sync Audio
2025-2-21: Support for Skywork/SkyReels-V1-Hunyuan-T2V/I2V. Need a full update of dependencies! (Thx newgenai79 for int4 transformer)
2025-2-15: Add: LoRA support for HunyuanVideo + better preset
2025-2-12: Add multi-media prompting via: OmniGen
2025-2-10: Update: a-r-r-o-w/LTX-Video-0.9.1-diffusers ZhengPeng7/BiRefNet_HR MiaoshouAI/Florence-2-large-PromptGen-v2.0 New: ostris/Flex.1-alpha Alpha-VLLM/Lumina-Image-2.0 Efficient-Large-Model/Sana_1600M_1024px_diffusers Fix: Frame by frame (SD XL) Remove: Corcelio/mobius
2025-1-26: Add: MiniMax Cloud txt/img/subject to video (insert your MiniMax API key in MiniMax_API.txt) and fast FLUX LoRA
2025-1-15: FLUX: faster img2img and inpaint
2024-11-2: Add: Image Background Removal, Stable Diffusion 3.5 Medium, Fast Flux(t2i)
2024-9-19: Add: Image to Video for CogVideoX
2024-9-15: Add: LoRA import for Flux
2024-9-14: Add: Flux Inpaint & Img2img.
2024-9-4: Add: Florence 2 (Image Caption), AudioLDM2-Large, CogVideox-2b, flash_attn on Win.
2024-9-2: Add: Vid2vid for CogVideoX-5b and Parler TTS
2024-8-28: Make CogVideox-5b run on 6 GB VRAM & Flux on 2 GB VRAM
2024-8-27: Add: CogVideoX-5b Remove: Low-quality models
2024-8-5: Add: Flux Dev - NB. needs update of dependencies and 24 GB VRAM
2024-8-2: Add: Flux Schnell - NB. needs update of dependencies and 24 GB VRAM
2024-7-12: Add: Kwai/Kolors (txt2img & img2img)
2024-6-13: Add: SD3 - A "Read" token from HuggingFace must be entered, it's free (img2img). Fix: Installation of Dependencies
2024-6-6: Add: Stable Audio Open, Frame:-1 will inherit duration.
2024-6-1: IP Adapter(When using SDXL): Face (Image or folder), Style (image or folder) New image models: Mobius, OpenVision, Juggernaut X Hyper
2024-4-29: Add: PixArt Sigma 2k, PixArt 1024 and RealViz V4
2024-2-23: Add: Proteus Lightning and Dreamshaper XL Lightning
2024-2-21: Add: SDXL-Lightning 2 Step & Proteus v. 0.3
2024-1-02: Add: WhisperSpeech
2024-01-01: Fix installation and Bark bugs.
2024-01-31: Add OpenDalle, Speed option, SDXL, and LoRA support for Canny and OpenPose, including OpenPose rig images. Prune old models including SD.
2023-12-18: Add: Bark audio enhance, Segmind Vega.
2023-12-1: Add SD Turbo & MusicGen Medium, MPS device for MacOS.
2023-11-30: Add: SVD, SVD-XT, SDXL Turbo
Install Dependencies, and set Sound Notification in the add-on preferences:
Video Sequence Editor > Sidebar > Generative AI:
See SDXL handling most of the styles here: https://stable-diffusion-art.com/sdxl-styles/
- If the image of your renders breaks, use the resolution from the Model Card in the Preferences.
- If the image of your playback stutters, then select a strip > Menu > Strip > Movie Strip > Set Render Size.
- If you get the message that CUDA is out of memory, restart Blender to free up memory and make it stable again.
- New to Blender? Watch this tutorial: https://youtu.be/4_MIaxzjh5Y?feature=shared
Select multiple strips and hit Generate. When doing this, the file name, and if found, also the seed value, are automatically inserted into the prompt and seed value. However, in the add-on preferences, this behavior can be switched off.
ai_batch_ex2_0000-0574.mp4
Laura, Gary, Jon, Lea, Karen, Rick, Brenda, David, Eileen, Jordan, Mike, Yann, Joy, James, Eric, Lauren, Rose, Will, Jason, Aaron, Naomie, Alisa, Patrick, Jerry, Tina, Jenna, Bill, Tom, Carol, Barbara, Rebecca, Anna, Bruce, Emily
Use GPT4ALL to generate image prompts or stories:
https://github.com/tin2tin/GPT4BLENDER
Convert text from the Text Editor to strips, which can be used as prompts for batch generation.
https://github.com/tin2tin/text_to_strip
Edit, navigate, and i/o text strips.
https://github.com/tin2tin/Subtitle_Editor
For creating a mask on top of a clip in the Sequencer, this add-on can be used to input the clip as background in the Blender Image Editor. The created mask can then be added to the VSE as a strip, and converted to video with the above add-on:
https://github.com/tin2tin/vse_masking_tools
Since the Generative AI add-on can only input images or movie strips, you'll need to convert other strip types to movie-strip. For this purpose, this add-on can be used:
https://github.com/tin2tin/Add_Rendered_Strips
Add-on to check if the gen AI models are running error-free in Pallaidium.
https://github.com/tin2tin/pallaidium_module_checker
Write screenplays, add image prompts, and convert everything to times text strips, ready for batch convering to ex. imgage, video or speech.
https://github.com/tin2tin/Blender_Screenwriter
Disable System memory fallback: https://nvidia.custhelp.com/app/answers/detail/a_id/5490/~/system-memory-fallback-for-stable-diffusion
https://github.com/Nerogar/OneTrainer
derush20001-0571.mp4
scribble_0001-0156.mp4
TEXTs_010000-0495.mp4
Controlnet_final_0001-0603.mp4
OpenPose10000-0320.mp4
bagel.mp4
Burger4.mp4
3160-3714.mp4
- The team behind Pallaidium does not endorse or take responsibility for third-party use.
- The team behind Pallaidium requires verification or explicit permission for redistribution.
- It is prohibited to use Pallaidium to generate content that is demeaning or harmful to people, their environment, culture, religion, etc.
- It is prohibited to use Pallaidium for pornographic, violent, and bloody content generation.
- It is prohibited to use Pallaidium for error and false information generation.
- It is prohibited to use Pallaidium for commercial misuse or misrepresentation.
- Pallaidium does not include any genAI models(weights). If the user decides to use a model, it is downloaded from HuggingFace.
- In general, the models can only be used for non-commercial purposes and are meant for research purposes.
- Consult the individual models on HuggingFace to read up on their licenses and ex. if they can be used commercially.
- The Diffusers lib makes the following weights accessible through the Pallaidium UI:
- stabilityai/stable-diffusion-xl-base-1.0
- black-forest-labs/FLUX.1-schnell
- black-forest-labs/FLUX.1-dev
- black-forest-labs/FLUX.1-Kontext-dev
- diffusers/controlnet-canny-sdxl-1.0-small
- xinsir/controlnet-openpose-sdxl-1.0
- xinsir/controlnet-scribble-sdxl-1.0
- ZhengPeng7/BiRefNet
- Lumina 2
- OmniGen
- Chroma
- Relight
- stabilityai/stable-audio-open-1.0
- facebook/musicgen-stereo-medium
- F5-TTS
- WhisperSpeech
- MMAudio
- Chatterbox
Warning
SCAM ALERT! Scammers are misusing our free software, Pallaidium, along with our content and name, on a phishing site: pallaidium . com. We are NOT associated with this site! 🚨 Please help us report this scam — otherwise, we may be forced to delete this GitHub repository.