Hi there guys, hope is all going good.

​

I decided after forge not being updated after ~5 months, that it was missing a lot of important or small performance updates from A1111, that I should update it so it is more usable and more with the times if it's needed.

​

So I went, commit by commit from 5 months ago, up to today's updates of the dev branch of A1111 (https://github.com/AUTOMATIC1111/stable-diffusion-webui/commits/dev) and updated the code, manually, from the dev2 branch of forge (https://github.com/lllyasviel/stable-diffusion-webui-forge/commits/dev2) to see which could be merged or not, and which conflicts as well.

​

Here is the fork and branch (very important!): https://github.com/Panchovix/stable-diffusion-webui-forge/tree/dev_upstream_a1111

​

Make sure it is on dev_upstream_a111

​

All the updates are on the dev_upstream_a1111 branch and it should work correctly.

​

Some of the additions that it were missing:

• Scheduler Selection
• DoRA Support
• Small Performance Optimizations (based on small tests on txt2img, it is a bit faster than Forge on a RTX 4090 and SDXL)
• Refiner bugfixes
• Negative Guidance minimum sigma all steps (to apply NGMS)
• Optimized cache
• Among lot of other things of the past 5 months.

If you want to test even more new things, I have added some custom schedulers as well (WIPs), you can find them on https://github.com/Panchovix/stable-diffusion-webui-forge/commits/dev_upstream_a1111_customschedulers/

• CFG++
• VP (Variance Preserving)
• SD Turbo
• AYS GITS
• AYS 11 steps
• AYS 32 steps

​

What doesn't work/I couldn't/didn't know how to merge/fix:

• Soft Inpainting (I had to edit sd_samplers_cfg_denoiser.py to apply some A1111 changes, so I couldn't directly apply https://github.com/lllyasviel/stable-diffusion-webui-forge/pull/494)
• SD3 (Since forge has it's own unet implementation, I didn't tinker on implementing it)
• Callback order (https://github.com/AUTOMATIC1111/stable-diffusion-webui/commit/5bd27247658f2442bd4f08e5922afff7324a357a), specifically because the forge implementation of modules doesn't have script_callbacks. So it broke the included controlnet extension and ui_settings.py.
• Didn't tinker much about changes that affect extensions-builtin\Lora, since forge does it mostly on ldm_patched\modules.
• precision-half (forge should have this by default)
• New "is_sdxl" flag (sdxl works fine, but there are some new things that don't work without this flag)
• DDIM CFG++ (because the edit on sd_samplers_cfg_denoiser.py)
• Probably others things

​

The list (but not all) I couldn't/didn't know how to merge/fix is here: https://pastebin.com/sMCfqBua.

​

I have in mind to keep the updates and the forge speeds, so any help, is really really appreciated! And if you see any issue, please raise it on github so I or everyone can check it to fix it!

If you have a NVIDIA card, I suggest to use --cuda-malloc --cuda-stream --pin-shared-memory to get more performance.

After ~20 hours of coding for this, finally sleep...

​

Happy genning!

​

A new SDXL ControlNet from xinsir

Control Mode

Control Mode

Github Page：ControlNetPlus

https://preview.redd.it/4olq4ials3bd1.jpg?width=1110&format=pjpg&auto=webp&s=e7949cc3fba537c587f112d19844d9e060877f7e

The weights have been open sourced: https://huggingface.co/xinsir/controlnet-union-sdxl-1.0/tree/main

But it doesn't seem to work with ComfyUI or A1111 yet

Is like blue balling, if you are scared then why show it in the first place, should we only open source unusable trash or what, keep your secrets to you then, so you don't have to worry about anything.

I used FSPY and Blender to incorporate my 3D animation made with the 3D motion capture project "Freemocap." This allows me to create a shadow in a realistic way. After creating an alpha mask and doing a style transfer with ComfyUI, I did a bit of compositing, and the result is as follows:

I saw this open position looking for a Senior Stable Diffusion Engineer with 5+ years of experience in Stable Diffusion. How can this possible?

https://www.onstrider.com/jobs/stable-diffusion-engineer-7e6c7266?referral=tammyindica

Is anyone here working as a Stable Diffusion Engineer?