ACE-Step is a new, free and open source text to music generator with some inpainting / outpainting capabilities too!
Runs in under 10GB with ComfyUI native, or they have a Gradio web interface option too.
Generation times are LIGHTNING fast, with 4 minutes of AI audio taking just 20 seconds on an A100.
-- FREE WORKFLOW EXAMPLE! --
https://github.com/comfyanonymous/ComfyUI/pull/7972
Links:
https://github.com/ace-step/ACE-Step
https://huggingface.co/ACE-Step/ACE-Step-v1-3.5B
https://github.com/comfyanonymous/ComfyUI/pull/7972
https://github.com/billwuhao/ComfyUI_ACE-Step
https://youtu.be/6FBnKIjqT04
Want to support the channel?
https://www.patreon.com/posts/ace-step-open-ai-128457952
== Beginners Guides! ==
1. Installing Anaconda for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
2. Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflows for Beginners - https://youtu.be/VM9snsuoqBc
Pick an image, then change it via a prompt. Seems to be all the rage nowadays thanks to ChatGPT, but us nerds like Open Source things and the freedom to run stuff at home on our own computers.
HiDream E1 is the latest in the HiDream series, features an MIT license and works well with 16GB+ VRAM. It's a bit like inpainting - but without first needing to select a mask. Instead, everything just follows your instructions.
Change styles, remove objects, change items... so many things to try!
(One day I’ll even get seconds per iteration and iterations per second right as well :)
-- FREE WORKFLOW!! --
https://docs.comfy.org/tutorials/advanced/hidream-e1#comfyui-native-hidream-e1-workflow-example
== Links ==
https://github.com/HiDream-ai/HiDream-E1
https://huggingface.co/spaces/HiDream-ai/HiDream-E1-Full
https://docs.comfy.org/tutorials/advanced/hidream-e1#comfyui-native-hidream-e1-workflow-example
Want to support the channel?
https://www.patreon.com/posts/hidream-e1-now-128017969
== Beginners Guides! ==
1. Installing Anaconda for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
2. Properly Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. An Introduction to ComfyUI Workflows - https://youtu.be/VM9snsuoqBc
HiDream has some great image to image capabilities. Change anime to photo, or photo to anime... and a whole lot more!
All you need is an input image combined with a good prompt and the right denoise...
Twitter post - https://x.com/NerdyRodent/status/1914019719469842892
== Workflow Options ==
There are two workflows shown in this video, giving you the freedom to choose the option that best fits your needs 😀
1. FREE LEARNING OPTION - Build it yourself in 60 seconds!
Starting with the HiDream Example Workflow - https://comfyanonymous.github.io/ComfyUI_examples/hidream/ - this video walks you through adding the nodes to create a powerful image-to-image workflow. Perfect for beginners who want to understand how ComfyUI works rather than just downloading files. Watch the tutorial section and follow along - you'll learn valuable skills while creating the workflow!
2. PREMIUM READY-MADE OPTION - Support the channel!
If you prefer a plug-and-play solution without building it for yourself, the alternative completed workflow file is available to channel supporters. Not as ideal for learners because it also uses custom nodes (KJnodes) to reduce spaghetti length 😉
https://www.patreon.com/posts/hidream-style-to-127382900
Remember: Following the tutorial teaches you skills that will help with ALL your future ComfyUI projects! 🚀
== Beginners Guides! ==
1. Installing Anaconda for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
2. Installing ComfyUI Properly - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflow Basics for Beginners - https://youtu.be/VM9snsuoqBc
4. HiDream in ComfyUI - https://youtu.be/-RtspvK0jzs
== Contents ==
0:00 HiDream Style Introduction
0:27 Updating the Comfy Hidream example workflow
1:22 New to ComfyUI - Dual Clip Loader for HiDream
1:40 Anime to Realistic
3:24 Realistic to Anime
4:14 Yarn Style
4:34 Wood Style in 4 steps
5:05 Ice-cream Style
5:32 Denoise vs input image
7:17 Prompting tips
8:20 Style Hybrids
9:29 Easy style
9:50 Keeping text
11:09 Model bias
11:31 HiDream Inpainting
HiDream is now supported in ComfyUI without installing any custom nodes! Use a variety of text encoders, and have fun with both FP8 and various GGUF options too :) It comes with a FOSS license, so freedom is yours.
With nothing to install it’s super easy to use for ComfyUI beginners, and HiDream is just a model download away.
I think the image quality is better, but why not take a look and find out?
Want to support the channel?
https://www.patreon.com/posts/comfyui-native-126854253
Links:
FREE WORKFLOW!! - https://comfyanonymous.github.io/ComfyUI_examples/hidream/
GGUFs - https://huggingface.co/collections/city96/gguf-image-model-quants-67199ef97bf1d9ca49033234
== Beginners Guides! ==
1. Installing Anaconda for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
2. Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflow Basics - https://youtu.be/VM9snsuoqBc
HiDream is one of the latest free and open source text-2-image models to be released, and also quite possibly the best so far...
Want to support the channel?
https://www.patreon.com/posts/hidream-ai-126445068
Links:
HiDream - https://github.com/HiDream-ai/HiDream-I1
HiDream NF4 - https://github.com/hykilpikonna/HiDream-I1-nf4
ComfyUI - https://github.com/lum3on/comfyui_HiDream-Sampler
OminiControl Art - https://huggingface.co/spaces/Yuanshi/OminiControl_Art
== Beginners Guides! ==
1. Installing Python for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
2. Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflows for Beginners - https://youtu.be/VM9snsuoqBc
WAN Fun Control is here and with both 1.3 and 14B models available, there's something for everyone! Bringing the power of control net to WAN AI Video, WAN Fun Control is an excellent addition to all of the recent WAN models. Apache licensed to boot, so who could want more?
Want to support the channel?
https://www.patreon.com/posts/controlnets-for-125976378
Wan Fun - https://huggingface.co/collections/alibaba-pai/wan21-fun-67e4fb3b76ca01241eb7e334
Workflows:
https://github.com/nerdyrodent/AVeryComfyNerd/tree/main/workflows
== Beginners Guides! ==
1. Installing Anaconda for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
2. Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflows for Beginners - https://youtu.be/VM9snsuoqBc
== More Flux.1 ==
* Flux.1 in ComfyUI - https://youtu.be/DLUx-mK4g0c
* AI Enhanced Prompting in Flux - https://youtu.be/4d5zIBNuMRA
* Train your own Flux LoRA - https://youtu.be/7AhQcdqnwfs
A WAN LoRA is quick and easy to train, but getting the right elements in your dataset is key. Plain backgrounds are great as they can simply be prompted away, and so aren’t a concern, but what about interacting with other characters?
This video will guide you through creating the ideal dataset for LoRA training - all using WAN 2.1 in ComfyUI!
Works great for both the 1.3B and 14B versions :)
Want to support the channel?
https://www.patreon.com/posts/consistent-for-125451952
== Beginners Guides! ==
1. Installing Anaconda for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
2. Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflows for Beginners - https://youtu.be/VM9snsuoqBc
=== More Videos ===
Remade AI WAN LoRA Collection - https://youtu.be/07MhTdONvg8
LoRA Training with ai-toolkit - https://youtu.be/7AhQcdqnwfs
Remade-AI has released a whole bunch on fun LoRAs for WAN Image2Video 480p! Squish, Inflate, Crush, Rotate, Cakeify and more are available - and they work right in native ComfyUI :)
Use their prompt templates, and get consistent results every time.
Ps. They’ve released even more now. Check them out!
Want to support the channel?
https://www.patreon.com/posts/wan-i2v-loras-124308228
Links:
https://github.com/comfyanonymous/ComfyUI
https://comfyanonymous.github.io/ComfyUI_examples/wan/
https://huggingface.co/Remade-AI
== Beginners Guides! ==
1. Installing Anaconda for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
2. Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflows for Beginners - https://youtu.be/VM9snsuoqBc
== More Flux.1 ==
* Flux.1 in ComfyUI - https://youtu.be/DLUx-mK4g0c
* AI Enhanced Prompting in Flux - https://youtu.be/4d5zIBNuMRA
* Train your own Flux LoRA - https://youtu.be/7AhQcdqnwfs
Use the amazing Loom nodes with WAN 2.1 1.3B text-to-video, and you too can do video-2-video in ComfyUI in under 8GB VRAM. Being a nice small model, 81 frames can be done in less than 2 mins on an old 3090.
Want to support the channel?
https://www.patreon.com/posts/fast-video-to-123923106
Links:
https://comfyanonymous.github.io/ComfyUI_examples/wan/
https://github.com/logtd/ComfyUI-HunyuanLoom
== Beginners Guides! ==
Unsure about downloading and installing programs on your computer? Start here!
1. Installing Anaconda for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
2. Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflows for Beginners - https://youtu.be/VM9snsuoqBc
WAN 2.1 is an AI Image and Text to Video model release you can run at home, on your own computer :)
Full tutorial - https://youtu.be/a_nI32cnJfA
#wanai #shorts #imagetovideoai
WAN 2.1 by WAN AI is a set of video models for AI video generation which seem to be very good indeed! Both image to video and text to video models are available. With native support in ComfyUI and free example workflows, WAN image to video and text to video have never been easier to install and use - just download the models!
With both 14B and 1.3B models available for text to video, almost any GPU will be able to run this one! 14B text and Image to Video models give even better results too, so why not give it a go yourself, at home, on your own computer? :)
I show the smaller and larger text to video models, image to video, options for smaller GGUF models from city96 and a way to train WAN LoRAs! All in under 10 mins 🤓
Want to support the channel?
https://www.patreon.com/posts/wan-ai-image-to-123251264
Links:
https://github.com/Wan-Video/Wan2.1
https://comfyanonymous.github.io/ComfyUI_examples/wan/
https://github.com/tdrussell/diffusion-pipe
https://huggingface.co/city96/Wan2.1-T2V-14B-gguf
https://huggingface.co/city96/Wan2.1-I2V-14B-480P-gguf
== Beginners Guides! ==
1. Installing Anaconda for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
2. Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflows for Beginners - https://youtu.be/VM9snsuoqBc
== More Flux.1 ==
* Flux.1 in ComfyUI - https://youtu.be/DLUx-mK4g0c
* AI Enhanced Prompting in Flux - https://youtu.be/4d5zIBNuMRA
* Train your own Flux LoRA - https://youtu.be/7AhQcdqnwfs
SkyworkAI has relased two new AI video generation models called SkyReels - one for Text-2-Video and one for Image-2-Video.
Both are supported in ComfyUI, and can be run on consumer graphics cards. The video quality is decent, and you can make videos in just a few minutes.
Being new, I’ve only had a few days to test things - but everything I found from those days of testing have been compacted down into less than 15 minutes, just for you!
Want to support the channel?
https://www.patreon.com/posts/skyreels-v1-text-122858638
Links:
https://github.com/SkyworkAI/SkyReels-V1
https://huggingface.co/Kijai/SkyReels-V1-Hunyuan_comfy
https://huggingface.co/Comfy-Org/HunyuanVideo_repackaged
== Beginners Guides! ==
1. Installing Anaconda for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
2. Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflows for Beginners - https://youtu.be/VM9snsuoqBc
AI image generation doesn't always need the best GPUs, as these 3 smaller models show. Smaller can often mean faster too, so even higher-end owners can benefit. Lumina 2.0 is great at following prompts, TinyBreaker uses an interesting mix of Pixart with Stable Diffusion, and Animagine XL 4 is the latest anime SDXL model in the series.
Want to support the channel?
https://www.patreon.com/posts/new-models-ideal-122400407
Links:
https://github.com/comfyanonymous/ComfyUI
https://github.com/Alpha-VLLM/Lumina-Image-2.0
https://comfyanonymous.github.io/ComfyUI_examples/lumina2/
https://github.com/martin-rizzo/ComfyUI-TinyBreaker
https://huggingface.co/cagliostrolab/animagine-xl-4.0
== Beginners Guides! ==
1. How to install and run Python environments on MS Windows - https://youtu.be/OjOn0Q_U8cY
2. Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflow Basics - https://youtu.be/VM9snsuoqBc
YuE now has a free and open source license, switching from non-commercial over to Apache 2.0. This means you can now make AI generated music at home, for free on your own computer with as little as 6GB VRAM and generation times of only 4 minutes!
No more running out of credits on websites 😉
Writing your own lyrics and style tags isn't your only control though, as you can also upload your own vocals, instrumental or both to serve as a prompt! Plus you can get vocal or instrumental stems as output to enable even more creative options. Make some music and then sing over it yourself without needing to separate the vocals, for example.
Various options for using YuE are available, and I compare some of them here.
Want to support the channel?
https://www.patreon.com/posts/yue-foss-music-121804728
Links:
YuE Project - https://map-yue.github.io/
YuE GitHub - https://github.com/multimodal-art-projection/YuE
YuE for Windows - https://github.com/sdbds/YuE-for-windows
YuEGP - https://github.com/deepbeepmeep/YuEGP
YuE-exllamav2 - https://github.com/sgsdxzy/YuE-exllamav2
Yue-exllamav2-UI - https://github.com/alisson-anjos/YuE-exllamav2-UI.git
VoC - https://softology.pro/voc.htm
Installing Anaconda for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
DeepSeek. It's a Large language model. Very large. Thankfully, there are smaller, distilled versions available to run at home for FREE, and all you need to enhance any of your workflows is 2 nodes. Nice.
But how well does DeepSeek do when it comes to prompt generation for FLux.1 in ComfyUI? I guess it's time to find out!
* Want to support the channel? It’s you who keeps things going!
https://www.patreon.com/posts/deepseek-r1-flux-121216013
* Links:
https://github.com/comfyanonymous/ComfyUI
https://ollama.com/
https://ollama.com/library/deepseek-r1
https://huggingface.co/deepseek-ai/Janus-Pro-7B
== Beginners Guides! ==
1. A Beginner's Guide to Installing Python - https://youtu.be/OjOn0Q_U8cY
2. Properly Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflow Basics - https://youtu.be/VM9snsuoqBc
== More Flux.1 ==
* Flux.1 in ComfyUI - https://youtu.be/DLUx-mK4g0c
* AI Enhanced Prompting in Flux - https://youtu.be/4d5zIBNuMRA
* Train your own Flux LoRA - https://youtu.be/7AhQcdqnwfs
* Speed Boost Flux, SDXL, LTVX or HunyuanVideo with TeaCache & WaveSpeed! - https://youtu.be/beiVSzsH2R0
* Using Detail Daemon in ComfyUI for Extra Details! - https://youtu.be/dG9HfgngsqM
Image to Video, Video to Video, Text to Video and Camera Controls. What more could you want from an AI video generation model? Maybe control using pose, scribble or depth videos? That's there too. How about trajectory based control? Also possible! Maybe you'd like camera control too? Is panning, zooming and rotating enough? And the license... Apache-2.0 license :)
Want to support the channel?
https://www.patreon.com/posts/image-2-video-120765322
== Links ==
GitHub - https://github.com/aigc-apps/EasyAnimate
Qwen VL Int 8 - https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8
== Beginners Guides! ==
1. Installing Anaconda for MS Windows Beginners - https://youtu.be/OjOn0Q_U8cY
2. Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflows for Beginners - https://youtu.be/VM9snsuoqBc
== Flux.1 in ComfyUI ==
* Flux.1 in ComfyUI - https://youtu.be/DLUx-mK4g0c
* AI Enhanced Prompting in Flux - https://youtu.be/4d5zIBNuMRA
* Train your own Flux LoRA - https://youtu.be/7AhQcdqnwfs
Nvidia Cosmos has a set of "world" models designed to generate synthetic data for training... but it can do so much more than that, such as animating images and even image interpolation! Oh, and it can generate rodents too.
Run it at home, for free, on your own computer with just 12GB VRAM. ~7 minutes for a 704x704 121 frame video :)
Want to support the channel? -
https://www.patreon.com/posts/image-2-video-in-120326825
== Links ==
Blog: https://blog.comfy.org/p/comfyui-now-supports-nvidia-cosmos
Example: https://comfyanonymous.github.io/ComfyUI_examples/cosmos/
Nvidia's Cosmos Video: https://www.youtube.com/watch?v=9Uch931cDx8
Ollama: https://ollama.com/
== Beginners Guides! ==
Step 1. Anaconda (python) Installation - https://youtu.be/OjOn0Q_U8cY
Step 2. Standard ComfyUI Installation - https://youtu.be/2r3uM_b3zA8
Step 3. An Introduction to ComfyUI Workflows - https://youtu.be/VM9snsuoqBc
== Flux.1 in ComfyUI ==
* Flux.1 in ComfyUI - https://youtu.be/DLUx-mK4g0c
* AI Enhanced Prompting in Flux - https://youtu.be/4d5zIBNuMRA
* How to Train A Flux LoRA for FREE! - https://youtu.be/7AhQcdqnwfs
Faster image and video generation with SDXL, Flux, LTVX and Hunyuan Video is here thanks to the power of caches. Speed up a little - or a lot! TeaCache claims a 1.4x lossless speedup, and at a push I’m e found you can just about get to 3x speedup with images.
These handy ComfyUI nodes are quick to install, and then all you need to do then is pop a cache node into your existing workflow for an instant speed boost!
I put a couple of options through their paces, with some interesting results...
Links:
https://github.com/welltop-cn/ComfyUI-TeaCache
https://github.com/chengzeyi/Comfy-WaveSpeed
Want to support the channel?
https://www.patreon.com/posts/boost-sdxl-flux-119802818
== Beginners Guides! ==
ComfyUI has been around for a while now, but if you’re just starting your AI journey it’s a good idea to start at the beginning…
1. MS Windows Beginners Need Anaconda for Python - https://youtu.be/OjOn0Q_U8cY
2. Installing ComfyUI for Beginners - https://youtu.be/2r3uM_b3zA8
3. ComfyUI Workflows for Beginners - https://youtu.be/VM9snsuoqBc
== More Flux.1 ==
* Using Flux in ComfyUI - https://youtu.be/DLUx-mK4g0c
* AI Enhanced Prompting with Flux - https://youtu.be/4d5zIBNuMRA
* Train your own Flux LoRA for Free at Home - https://youtu.be/7AhQcdqnwfs