Rattus 521c4dad1e sd: fix VAE tiled fallback VRAM leak ... When the VAE catches this VRAM OOM, it launches the fallback logic straight from the exception context. Python however refs the entire call stack that caused the exception including any local variables for the sake of exception report and debugging. In the case of tensors, this can hold on the references to GBs of VRAM and inhibit the VRAM allocated from freeing them. So dump the except context completely before going back to the VAE via the tiler by getting out of the except block with nothing but a flag. The greately increases the reliability of the tiler fallback, especially on low VRAM cards, as with the bug, if the leak randomly leaked more than the headroom needed for a single tile, the tiler would fallback would OOM and fail the flow.		2025-10-01 20:49:05 +10:00
..
audio_encoders	Support the HuMo model. (#9903)	2025-09-17 00:12:48 -04:00
cldm	Replace print with logging (#6138)	2024-12-20 16:24:55 -05:00
comfy_types	LoRA Trainer: LoRA training node in weight adapter scheme (#8446)	2025-06-13 19:25:59 -04:00
extra_samplers	Uni pc sampler now works with audio and video models.	2025-01-18 05:27:58 -05:00
image_encoders	Add Hunyuan 3D 2.1 Support (#8714)	2025-09-04 20:36:20 -04:00
k_diffusion	Fix depending on asserts to raise an exception in BatchedBrownianTree and Flash attn module (#9884)	2025-09-15 20:05:03 -04:00
ldm	Reduce Peak WAN inference VRAM usage - part II (#10062)	2025-09-27 18:14:16 -04:00
sd1_tokenizer	Silence clip tokenizer warning. (#8934)	2025-07-16 14:42:07 -04:00
t2i_adapter
taesd
text_encoders	Don't add template to qwen2.5vl when template is in prompt. (#10043)	2025-09-26 18:34:17 -04:00
weight_adapter	Fix LoRA Trainer bugs with FP8 models. (#9854)	2025-09-20 21:24:48 -04:00
checkpoint_pickle.py
cli_args.py	Print all fast options in --help (#9737)	2025-09-06 01:05:05 -04:00
clip_config_bigg.json
clip_model.py	USO style reference. (#9677)	2025-09-02 15:36:22 -04:00
clip_vision_config_g.json
clip_vision_config_h.json
clip_vision_config_vitl_336_llava.json	Support llava clip vision model.	2025-03-06 00:24:43 -05:00
clip_vision_config_vitl_336.json
clip_vision_config_vitl.json
clip_vision_siglip_384.json	Support new flux model variants.	2024-11-21 08:38:23 -05:00
clip_vision_siglip_512.json	Support 512 siglip model.	2025-04-05 07:01:01 -04:00
clip_vision.py	Some changes to the previous hunyuan PR. (#9725)	2025-09-04 20:39:02 -04:00
conds.py	Add some warnings and prevent crash when cond devices don't match. (#9169)	2025-08-04 04:20:12 -04:00
context_windows.py	Make step index detection much more robust (#9392)	2025-08-17 18:54:07 -04:00
controlnet.py	Support qwen inpaint controlnet. (#9772)	2025-09-08 17:30:26 -04:00
diffusers_convert.py	Remove useless code.	2025-01-24 06:15:54 -05:00
diffusers_load.py
float.py
gligen.py	Remove some useless code. (#8812)	2025-07-06 07:07:39 -04:00
hooks.py	Hooks Part 2 - TransformerOptionsHook and AdditionalModelsHook (#6377)	2025-01-11 12:20:23 -05:00
latent_formats.py	Add support for Chroma Radiance (#9682)	2025-09-13 17:58:43 -04:00
lora_convert.py	Implement the USO subject identity lora. (#9674)	2025-09-01 18:54:02 -04:00
lora.py	Support the omnigen2 umo lora. (#9886)	2025-09-15 18:10:55 -04:00
model_base.py	Basic WIP support for the wan animate model. (#9939)	2025-09-19 03:07:17 -04:00
model_detection.py	Basic WIP support for the wan animate model. (#9939)	2025-09-19 03:07:17 -04:00
model_management.py	Fix memory leak by properly detaching model finalizer (#9979)	2025-09-24 22:35:12 -04:00
model_patcher.py	USO style reference. (#9677)	2025-09-02 15:36:22 -04:00
model_sampling.py	Basic initial support for cosmos predict2 text to image 2B and 14B models. (#8517)	2025-06-13 07:05:23 -04:00
ops.py	Fix LoRA Trainer bugs with FP8 models. (#9854)	2025-09-20 21:24:48 -04:00
options.py
patcher_extension.py	Implement EasyCache and Invent LazyCache (#9496)	2025-08-22 22:41:08 -04:00
pixel_space_convert.py	Changes to the previous radiance commit. (#9851)	2025-09-13 18:03:34 -04:00
rmsnorm.py	Add warning when using old pytorch. (#9347)	2025-08-15 00:22:26 -04:00
sample.py	Auto reshape 2d to 3d latent for single image generation on video model.	2024-12-29 02:26:49 -05:00
sampler_helpers.py	Added context window support to core sampling code (#9238)	2025-08-13 21:33:05 -04:00
samplers.py	Add 'input_cond' and 'input_uncond' to the args dictionary passed into sampler_cfg_function (#10044)	2025-09-26 19:55:03 -07:00
sd1_clip_config.json
sd1_clip.py	Disable prompt weights for qwen. (#9438)	2025-08-20 01:08:11 -04:00
sd.py	sd: fix VAE tiled fallback VRAM leak	2025-10-01 20:49:05 +10:00
sdxl_clip.py	Add a T5TokenizerOptions node to set options for the T5 tokenizer. (#7803)	2025-04-25 19:36:00 -04:00
supported_models_base.py	Mixed precision diffusion models with scaled fp8.	2024-10-21 18:12:51 -04:00
supported_models.py	Lower wan memory estimation value a bit. (#9964)	2025-09-20 22:09:35 -04:00
utils.py	Add WAN ATI support (#8874)	2025-07-24 20:59:19 -04:00