2194 Commits

Author	SHA1	Message	Date
Yousef R. Gamaleldin	ce0c979e96	Merge 553f71aa9e into fc1fdf3389	2026-03-28 18:06:24 +00:00
rattus	b353a7c863	Integrate RAM cache with model RAM management (#13173)	2026-03-27 21:34:16 -04:00
comfyanonymous	3a56201da5	Allow flux conditioning without a pooled output. (#13198)	2026-03-27 20:36:26 -04:00
Jukka Seppänen	b0fd65e884	fix: regression in text generate with LTXAV model (#13170)	2026-03-26 09:55:05 -07:00
comfyanonymous	2a1f402601	Make Qwen 8B work with TextGenerate node. (#13160)	2026-03-25 23:21:44 -04:00
Jukka Seppänen	404d7b9978	feat: Support Qwen3.5 text generation models (#12771)	2026-03-25 22:48:28 -04:00
Kohaku-Blueleaf	5ebb0c2e0b	FP8 bwd training (#13121)	2026-03-24 20:39:04 -04:00
Jukka Seppänen	e87858e974	feat: LTX2: Support reference audio (ID-LoRA) (#13111)	2026-03-23 18:22:24 -04:00
Talmaj	d49420b3c7	LongCat-Image edit (#13003)	2026-03-21 23:51:05 -04:00
rattus	25b6d1d629	wan: vae: Fix light/color change (#13101) ... There was an issue where the resample split was too early and dropped one of the rolling convolutions a frame early. This is most noticable as a lighting/color change between pixel frames 5->6 (latent 2->3), or as a lighting change between the first and last frame in an FLF wan flow.	2026-03-21 18:44:35 -04:00
comfyanonymous	11c15d8832	Fix fp16 intermediates giving different results. (#13100)	2026-03-21 17:53:25 -04:00
comfyanonymous	b5d32e6ad2	Fix sampling issue with fp16 intermediates. (#13099)	2026-03-21 17:47:42 -04:00
Jedrzej Kosinski	87cda1fc25	Move inline comfy.context_windows imports to top-level in model_base.py (#13083) ... The recent PR that added resize_cond_for_context_window methods to model classes used inline 'import comfy.context_windows' in each method body. This moves that import to the top-level import section, replacing 4 duplicate inline imports with a single top-level one.	2026-03-20 20:03:42 -04:00
Yousef Rafat	553f71aa9e	.	2026-03-20 20:47:28 +02:00
Yousef Rafat	739191df33	Merge branch 'seedvr2' of https://github.com/yousef-rafat/ComfyUI into seedvr2	2026-03-20 20:40:34 +02:00
Yousef Rafat	c6217aa799	output reshape	2026-03-20 20:40:24 +02:00
drozbay	589228e671	Add slice_cond and per-model context window cond resizing (#12645) ... * Add slice_cond and per-model context window cond resizing * Fix cond_value.size() call in context window cond resizing * Expose additional advanced inputs for ContextWindowsManualNode Necessary for WanAnimate context windows workflow, which needs cond_retain_index_list = 0 to work properly with its reference input. ---------	2026-03-19 20:42:42 -07:00
rattus	f49856af57	ltx: vae: Fix missing init variable (#13074) ... Forgot to push this ammendment. Previous test results apply to this.	2026-03-19 22:34:58 -04:00
rattus	82b868a45a	Fix VRAM leak in tiler fallback in video VAEs (#13073) ... * sd: soft_empty_cache on tiler fallback This doesnt cost a lot and creates the expected VRAM reduction in resource monitors when you fallback to tiler. * wan: vae: Don't recursion in local fns (move run_up) Moved Decoder3d’s recursive run_up out of forward into a class method to avoid nested closure self-reference cycles. This avoids cyclic garbage that delays garbage of tensors which in turn delays VRAM release before tiled fallback. * ltx: vae: Don't recursion in local fns (move run_up) Mov the recursive run_up out of forward into a class method to avoid nested closure self-reference cycles. This avoids cyclic garbage that delays garbage of tensors which in turn delays VRAM release before tiled fallback.	2026-03-19 22:30:27 -04:00
Yousef R. Gamaleldin	3bd7d8b15d	Merge branch 'master' into seedvr2	2026-03-20 03:39:56 +02:00
Yousef Rafat	3b418dab2c	...	2026-03-19 21:32:23 +02:00
comfyanonymous	8458ae2686	Revert "fix: run text encoders on MPS GPU instead of CPU for Apple Silicon (#…" (#13070) ... This reverts commit b941913f1d.	2026-03-19 15:27:55 -04:00
Yousef Rafat	af6c5d6de9	tested with a modern version of comfyui	2026-03-19 21:09:11 +02:00
Jukka Seppänen	fd0261d2bc	Reduce tiled decode peak memory (#13050)	2026-03-19 13:29:34 -04:00
rattus	ab14541ef7	memory: Add more exclusion criteria to pinned read (#13067)	2026-03-19 10:03:20 -07:00
rattus	fabed694a2	ltx: vae: implement chunked encoder + CPU IO chunking (Big VRAM reductions) (#13062) ... * ltx: vae: add cache state to downsample block * ltx: vae: Add time stride awareness to causal_conv_3d * ltx: vae: Automate truncation for encoder Other VAEs just truncate without error. Do the same. * sd/ltx: Make chunked_io a flag in its own right Taking this bi-direcitonal, so make it a for-purpose named flag. * ltx: vae: implement chunked encoder + CPU IO chunking People are doing things with big frame counts in LTX including V2V flows. Implement the time-chunked encoder to keep the VRAM down, with the converse of the new CPU pre-allocation technique, where the chunks are brought from the CPU JIT. * ltx: vae-encode: round chunk sizes more strictly Only powers of 2 and multiple of 8 are valid due to cache slicing.	2026-03-19 09:58:47 -07:00
Yousef Rafat	459150582e	Merge branch 'seedvr2' of https://github.com/yousef-rafat/ComfyUI into seedvr2	2026-03-19 14:18:39 +02:00
Yousef Rafat	3d2c4d48cd	.	2026-03-19 14:18:31 +02:00
Yousef R. Gamaleldin	a1257d0426	Merge branch 'master' into seedvr2	2026-03-19 14:16:59 +02:00
Yousef Rafat	35aa850c93	Merge branch 'seedvr2' of https://github.com/yousef-rafat/ComfyUI into seedvr2	2026-03-19 14:15:31 +02:00
Yousef Rafat	a64414a0fc	simplified var attn	2026-03-19 14:11:02 +02:00
comfyanonymous	f6b869d7d3	fp16 intermediates doen't work for some text enc models. (#13056)	2026-03-18 19:42:28 -04:00
comfyanonymous	56ff88f951	Fix regression. (#13053)	2026-03-18 18:35:25 -04:00
Jukka Seppänen	9fff091f35	Further Reduce LTX VAE decode peak RAM usage (#13052)	2026-03-18 18:32:26 -04:00
comfyanonymous	dcd659590f	Make more intermediate values follow the intermediate dtype. (#13051)	2026-03-18 18:14:18 -04:00
Anton Bukov	b941913f1d	fix: run text encoders on MPS GPU instead of CPU for Apple Silicon (#12809) ... On Apple Silicon, `vram_state` is set to `VRAMState.SHARED` because CPU and GPU share unified memory. However, `text_encoder_device()` only checked for `HIGH_VRAM` and `NORMAL_VRAM`, causing all text encoders to fall back to CPU on MPS devices. Adding `VRAMState.SHARED` to the condition allows non-quantized text encoders (e.g. bf16 Gemma 3 12B) to run on the MPS GPU, providing significant speedup for text encoding and prompt generation. Note: quantized models (fp4/fp8) that use float8_e4m3fn internally will still fall back to CPU via the `supports_cast()` check in `CLIP.__init__()`, since MPS does not support fp8 dtypes.	2026-03-17 21:21:32 -04:00
rattus	cad24ce262	cascade: remove dead weight init code (#13026) ... This weight init process is fully shadowed be the weight load and doesnt work in dynamic_vram were the weight allocation is deferred.	2026-03-17 20:59:10 -04:00
comfyanonymous	68d542cc06	Fix case where pixel space VAE could cause issues. (#13030)	2026-03-17 20:46:22 -04:00
Jukka Seppänen	735a0465e5	Inplace VAE output processing to reduce peak RAM consumption. (#13028)	2026-03-17 20:20:49 -04:00
rattus	035414ede4	Reduce WAN VAE VRAM, Save use cases for OOM/Tiler (#13014) ... * wan: vae: encoder: Add feature cache layer that corks singles If a downsample only gives you a single frame, save it to the feature cache and return nothing to the top level. This increases the efficiency of cacheability, but also prepares support for going two by two rather than four by four on the frames. * wan: remove all concatentation with the feature cache The loopers are now responsible for ensuring that non-final frames are processes at least two-by-two, elimiating the need for this cat case. * wan: vae: recurse and chunk for 2+2 frames on decode Avoid having to clone off slices of 4 frame chunks and reduce the size of the big 6 frame convolutions down to 4. Save the VRAMs. * wan: encode frames 2x2. Reduce VRAM usage greatly by encoding frames 2 at a time rather than 4. * wan: vae: remove cloning The loopers now control the chunking such there is noever more than 2 frames, so just cache these slices directly and avoid the clone allocations completely. * wan: vae: free consumer caller tensors on recursion * wan: vae: restyle a little to match LTX	2026-03-17 17:34:39 -04:00
rattus	1a157e1f97	Reduce LTX VAE VRAM usage and save use cases from OOMs/Tiler (#13013) ... * ltx: vae: scale the chunk size with the users VRAM Scale this linearly down for users with low VRAM. * ltx: vae: free non-chunking recursive intermediates * ltx: vae: cleanup some intermediates The conv layer can be the VRAM peak and it does a torch.cat. So cleanup the pieces of the cat. Also clear our the cache ASAP as each layer detect its end as this VAE surges in VRAM at the end due to the ended padding increasing the size of the final frame convolutions off-the-books to the chunker. So if all the earlier layers free up their cache it can offset that surge. Its a fragmentation nightmare, and the chance of it having to recache the pyt allocator is very high, but you wont OOM.	2026-03-17 17:32:43 -04:00
Paulo Muggler Moreira	8cc746a864	fix: disable SageAttention for Hunyuan3D v2.1 DiT (#12772)	2026-03-16 22:27:27 -04:00
comfyanonymous	ca17fc8355	Fix potential issue. (#13009)	2026-03-16 21:38:40 -04:00
Kohaku-Blueleaf	20561aa919	[Trainer] FP4, 8, 16 training by native dtype support and quant linear autograd function (#12681)	2026-03-16 21:31:50 -04:00
comfyanonymous	7a16e8aa4e	Add --enable-dynamic-vram options to force enable it. (#13002)	2026-03-16 16:50:13 -04:00
blepping	b202f842af	Skip running model finalizers at exit (#12994)	2026-03-16 16:00:42 -04:00
lostdisc	3814bf4454	Enable Pytorch Attention for gfx1150 (#12973)	2026-03-15 12:45:30 -07:00
rattus	e84a200a3c	ops: opt out of deferred weight init if subclassed (#12967) ... If a subclass BYO _load_from_state_dict and doesnt call the super() the needed default init of these weights is missed and can lead to problems for uninitialized weights.	2026-03-15 11:49:49 -07:00
Jukka Seppänen	0904cc3fe5	LTXV: Accumulate VAE decode results on intermediate_device (#12955)	2026-03-14 18:09:09 -07:00
comfyanonymous	c711b8f437	Add --fp16-intermediates to use fp16 for intermediate values between nodes (#12953) ... This is an experimental WIP option that might not work in your workflow but should lower memory usage if it does. Currently only the VAE and the load image node will output in fp16 when this option is turned on.	2026-03-14 19:18:19 -04:00