Rattus 4bb34b85b7 mm: make model offloading deffered with weakrefs ... RAMPressure caching may ned to purge the same model that you are currently trying to offload for VRAM freeing. In this case, RAMPressure cache takes priority and needs to be able to pull the trigger on dumping the whole model and freeing the ModelPatcher in question. To do this, defer the actual tranfer of model weights from GPU to RAM to model_management state and not as part of ModelPatcher. This is dones as a list of weakrefs. If RAM cache decides to free to model you are currently unloading, then the ModelPatcher and refs simply dissappear in the middle of the unloading process, and both RAM and VRAM will be freed. The unpatcher now queues the individual leaf modules to be offloaded one-by-one so that RAM levels can be monitored. Note that the UnloadPartially that is potentially done as part of a load will not be freeable this way, however it shouldn't be anyway as that is the currently active model and RAM cache cannot save you if you cant even fit the one model you are currently trying to use.		2025-12-19 19:32:51 +10:00
..
audio_encoders	Support the HuMo model. (#9903)	2025-09-17 00:12:48 -04:00
cldm	Add better error message for common error. (#10846)	2025-11-23 04:55:22 -05:00
comfy_types	LoRA Trainer: LoRA training node in weight adapter scheme (#8446)	2025-06-13 19:25:59 -04:00
extra_samplers	Uni pc sampler now works with audio and video models.	2025-01-18 05:27:58 -05:00
image_encoders	Add Hunyuan 3D 2.1 Support (#8714)	2025-09-04 20:36:20 -04:00
k_diffusion	Fix the last step with non-zero sigma in sa_solver (#11380)	2025-12-17 13:57:40 -05:00
ldm	Diffusion model part of Qwen Image Layered. (#11408)	2025-12-18 20:21:14 -05:00
sd1_tokenizer	Silence clip tokenizer warning. (#8934)	2025-07-16 14:42:07 -04:00
t2i_adapter	Controlnet refactor.	2024-06-27 18:43:11 -04:00
taesd	Support video tiny VAEs (#10884)	2025-11-28 19:40:19 -05:00
text_encoders	Fix qwen scaled fp8 not working with kandinsky. Make basic t2i wf work. (#11162)	2025-12-06 17:50:10 -08:00
weight_adapter	Fix loras not working on mixed fp8. (#10899)	2025-11-26 00:07:58 -05:00
checkpoint_pickle.py	Remove pytorch_lightning dependency.	2023-06-13 10:11:33 -04:00
cli_args.py	feat(preview): add per-queue live preview method override (#11261)	2025-12-15 15:57:39 -08:00
clip_config_bigg.json	Fix potential issue with non clip text embeddings.	2024-07-30 14:41:13 -04:00
clip_model.py	USO style reference. (#9677)	2025-09-02 15:36:22 -04:00
clip_vision_config_g.json	Add support for clip g vision model to CLIPVisionLoader.	2023-08-18 11:13:29 -04:00
clip_vision_config_h.json	Add support for unCLIP SD2.x models.	2023-04-01 23:19:15 -04:00
clip_vision_config_vitl_336_llava.json	Support llava clip vision model.	2025-03-06 00:24:43 -05:00
clip_vision_config_vitl_336.json	support clip-vit-large-patch14-336 (#4042)	2024-07-17 13:12:50 -04:00
clip_vision_config_vitl.json	Add support for unCLIP SD2.x models.	2023-04-01 23:19:15 -04:00
clip_vision_siglip_384.json	Support new flux model variants.	2024-11-21 08:38:23 -05:00
clip_vision_siglip_512.json	Support 512 siglip model.	2025-04-05 07:01:01 -04:00
clip_vision.py	Some changes to the previous hunyuan PR. (#9725)	2025-09-04 20:39:02 -04:00
conds.py	Add some warnings and prevent crash when cond devices don't match. (#9169)	2025-08-04 04:20:12 -04:00
context_windows.py	Add context windows callback for custom cond handling (#11208)	2025-12-15 16:06:32 -08:00
controlnet.py	Fix Race condition in --async-offload that can cause corruption (#10501)	2025-10-29 17:17:46 -04:00
diffusers_convert.py	Remove useless code.	2025-01-24 06:15:54 -05:00
diffusers_load.py	load_unet -> load_diffusion_model with a model_options argument.	2024-08-12 23:20:57 -04:00
float.py	Clamp output when rounding weight to prevent Nan.	2024-10-19 19:07:10 -04:00
gligen.py	Remove some useless code. (#8812)	2025-07-06 07:07:39 -04:00
hooks.py	Hooks Part 2 - TransformerOptionsHook and AdditionalModelsHook (#6377)	2025-01-11 12:20:23 -05:00
latent_formats.py	Support video tiny VAEs (#10884)	2025-11-28 19:40:19 -05:00
lora_convert.py	Implement the USO subject identity lora. (#9674)	2025-09-01 18:54:02 -04:00
lora.py	Support "transformer." LoRA prefix for Z-Image (#11135)	2025-12-08 15:17:26 -05:00
model_base.py	sd: Free RAM on main model load	2025-12-19 19:32:51 +10:00
model_detection.py	Diffusion model part of Qwen Image Layered. (#11408)	2025-12-18 20:21:14 -05:00
model_management.py	mm: make model offloading deffered with weakrefs	2025-12-19 19:32:51 +10:00
model_patcher.py	mm: make model offloading deffered with weakrefs	2025-12-19 19:32:51 +10:00
model_sampling.py	Refactor model sampling sigmas code. (#10250)	2025-10-08 17:49:02 -04:00
nested_tensor.py	WIP way to support multi multi dimensional latents. (#10456)	2025-10-23 21:21:14 -04:00
ops.py	Fix pytorch warnings. (#11314)	2025-12-13 18:45:23 -05:00
options.py	Only parse command line args when main.py is called.	2023-09-13 11:38:20 -04:00
patcher_extension.py	Fix order of inputs nested merge_nested_dicts (#10362)	2025-10-15 16:47:26 -07:00
pixel_space_convert.py	Changes to the previous radiance commit. (#9851)	2025-09-13 18:03:34 -04:00
quant_ops.py	Fix nan issue when quantizing fp16 tensor. (#11213)	2025-12-09 17:03:21 -05:00
rmsnorm.py	Add warning when using old pytorch. (#9347)	2025-08-15 00:22:26 -04:00
sample.py	Fix mistake. (#10484)	2025-10-25 23:07:29 -04:00
sampler_helpers.py	skip_load_model -> force_full_load (#11390)	2025-12-17 23:29:32 -05:00
samplers.py	Add exp_heun_2_x0 sampler series (#11360)	2025-12-16 23:35:43 -05:00
sd1_clip_config.json	Fix potential issue with non clip text embeddings.	2024-07-30 14:41:13 -04:00
sd1_clip.py	Make old scaled fp8 format use the new mixed quant ops system. (#11000)	2025-12-05 14:35:42 -05:00
sd.py	sd: Free RAM on main model load	2025-12-19 19:32:51 +10:00
sdxl_clip.py	Add a T5TokenizerOptions node to set options for the T5 tokenizer. (#7803)	2025-04-25 19:36:00 -04:00
supported_models_base.py	Fix some custom nodes. (#11134)	2025-12-05 18:25:31 -05:00
supported_models.py	Only enable fp16 on ZImage on newer pytorch. (#11344)	2025-12-15 22:33:27 -05:00
utils.py	Update warning for old pytorch version. (#11319)	2025-12-14 04:02:50 -05:00