Kohaku-Blueleaf eb2f78b4e0 [Training Node] algo support, grad acc, optional grad ckpt (#9015) ... * Add factorization utils for lokr * Add lokr train impl * Add loha train impl * Add adapter map for algo selection * Add optional grad ckpt and algo selection * Update __init__.py * correct key name for loha * Use custom fwd/bwd func and better init for loha * Support gradient accumulation * Fix bugs of loha * use more stable init * Add OFT training * linting		2025-07-23 20:57:27 -04:00
..
cldm	Replace print with logging (#6138)	2024-12-20 16:24:55 -05:00
comfy_types	LoRA Trainer: LoRA training node in weight adapter scheme (#8446)	2025-06-13 19:25:59 -04:00
extra_samplers	Uni pc sampler now works with audio and video models.	2025-01-18 05:27:58 -05:00
image_encoders	Fix for dino lowvram. (#7748)	2025-04-23 04:12:52 -04:00
k_diffusion	Separate denoised and noise estimation in Euler CFG++ (#9008)	2025-07-23 19:47:05 -04:00
ldm	LTXV VAE decoder: switch default padding mode (#8930)	2025-07-16 13:54:38 -04:00
sd1_tokenizer	Silence clip tokenizer warning. (#8934)	2025-07-16 14:42:07 -04:00
t2i_adapter	Controlnet refactor.	2024-06-27 18:43:11 -04:00
taesd	Improvements to the TAESD3 implementation.	2024-06-16 02:04:24 -04:00
text_encoders	Remove windows line endings. (#8866)	2025-07-11 02:37:51 -04:00
weight_adapter	[Training Node] algo support, grad acc, optional grad ckpt (#9015)	2025-07-23 20:57:27 -04:00
checkpoint_pickle.py	Remove pytorch_lightning dependency.	2023-06-13 10:11:33 -04:00
cli_args.py	Add default device argument. (#9023)	2025-07-23 14:20:49 -04:00
clip_config_bigg.json	Fix potential issue with non clip text embeddings.	2024-07-30 14:41:13 -04:00
clip_model.py	Support llava clip vision model.	2025-03-06 00:24:43 -05:00
clip_vision_config_g.json	Add support for clip g vision model to CLIPVisionLoader.	2023-08-18 11:13:29 -04:00
clip_vision_config_h.json	Add support for unCLIP SD2.x models.	2023-04-01 23:19:15 -04:00
clip_vision_config_vitl_336_llava.json	Support llava clip vision model.	2025-03-06 00:24:43 -05:00
clip_vision_config_vitl_336.json	support clip-vit-large-patch14-336 (#4042)	2024-07-17 13:12:50 -04:00
clip_vision_config_vitl.json	Add support for unCLIP SD2.x models.	2023-04-01 23:19:15 -04:00
clip_vision_siglip_384.json	Support new flux model variants.	2024-11-21 08:38:23 -05:00
clip_vision_siglip_512.json	Support 512 siglip model.	2025-04-05 07:01:01 -04:00
clip_vision.py	throw away alpha channel in clip vision preprocessor (#7769)	2025-04-23 21:28:36 -04:00
conds.py	Make it easier to pass lists of tensors to models. (#8358)	2025-05-31 20:00:20 -04:00
controlnet.py	Alternate fix for #8435 (#8442)	2025-06-06 09:43:27 -04:00
diffusers_convert.py	Remove useless code.	2025-01-24 06:15:54 -05:00
diffusers_load.py	load_unet -> load_diffusion_model with a model_options argument.	2024-08-12 23:20:57 -04:00
float.py	Clamp output when rounding weight to prevent Nan.	2024-10-19 19:07:10 -04:00
gligen.py	Remove some useless code. (#8812)	2025-07-06 07:07:39 -04:00
hooks.py	Hooks Part 2 - TransformerOptionsHook and AdditionalModelsHook (#6377)	2025-01-11 12:20:23 -05:00
latent_formats.py	Initial ACE-Step model implementation. (#7972)	2025-05-07 08:33:34 -04:00
lora_convert.py	Support the wan fun reward loras.	2025-04-07 05:01:47 -04:00
lora.py	Support HiDream SimpleTuner loras. (#8318)	2025-05-28 18:47:15 -04:00
model_base.py	Fix memory estimation bug with kontext. (#8709)	2025-06-27 17:21:12 -04:00
model_detection.py	Omnigen2 model implementation. (#8669)	2025-06-25 19:35:57 -04:00
model_management.py	Enable pytorch attention by default for gfx1201 on torch 2.8 (#9029)	2025-07-23 19:21:29 -04:00
model_patcher.py	Initial code for new SLG node (#8759)	2025-07-02 20:13:43 -04:00
model_sampling.py	Basic initial support for cosmos predict2 text to image 2B and 14B models. (#8517)	2025-06-13 07:05:23 -04:00
ops.py	Fallback to regular op when fp8 op throws exception. (#8761)	2025-07-02 00:57:13 -04:00
options.py	Only parse command line args when main.py is called.	2023-09-13 11:38:20 -04:00
patcher_extension.py	Add prepare_sampling wrapper allowing custom nodes to more accurately report noise_shape (#7500)	2025-04-09 09:43:35 -04:00
rmsnorm.py	Fix issue with old pytorch RMSNorm. (#8095)	2025-05-13 07:54:28 -04:00
sample.py	Auto reshape 2d to 3d latent for single image generation on video model.	2024-12-29 02:26:49 -05:00
sampler_helpers.py	Memory estimation code can now take into account conds. (#8307)	2025-05-27 15:09:05 -04:00
samplers.py	Add SA-Solver sampler (#8834)	2025-07-08 16:17:06 -04:00
sd1_clip_config.json	Fix potential issue with non clip text embeddings.	2024-07-30 14:41:13 -04:00
sd1_clip.py	Omnigen2 model implementation. (#8669)	2025-06-25 19:35:57 -04:00
sd.py	Add model detection error hint for lora. (#8880)	2025-07-12 03:49:26 -04:00
sdxl_clip.py	Add a T5TokenizerOptions node to set options for the T5 tokenizer. (#7803)	2025-04-25 19:36:00 -04:00
supported_models_base.py	Mixed precision diffusion models with scaled fp8.	2024-10-21 18:12:51 -04:00
supported_models.py	Fix wrong reference bug (#8910)	2025-07-14 20:45:55 -04:00
utils.py	Add attempt to work around the safetensors mmap issue. (#8928)	2025-07-16 03:42:17 -04:00