576 Commits

Author	SHA1	Message	Date
Barish Ozbay	a25f6f9d4e	Merge 065c1df017 into ec1896aceb	2026-05-29 18:21:14 +02:00
comfyanonymous	85a403d1ea	Disable sage attention in stable audio dit and VAE. (#14148)	2026-05-27 20:35:03 -04:00
Jukka Seppänen	987a937658	Support context window for PiD and fix lq_latent rounding (#14136)	2026-05-27 12:08:06 -07:00
Jukka Seppänen	28f4ef277c	feat: Support NVIDIA PixelDiT and PiD (CORE-201) (#14103)	2026-05-26 17:50:14 -07:00
Barish Ozbay	065c1df017	Merge branch 'master' into 20260322a_ltx_contextwin	2026-05-26 10:42:02 -06:00
Jukka Seppänen	f9f54cae42	Lens: some cleanup (#14112) ... * Lens: remove redundant memory optimization	2026-05-26 10:32:53 +03:00
Jukka Seppänen	41812fa0ac	feat: Microsoft Lens support (CORE-248) (#14077)	2026-05-25 23:01:51 -07:00
Ivan Zorin	57414dadfe	fix: cross-attention AdaLN scale, shift, sigma parameters calculation (#14097)	2026-05-25 20:07:09 -07:00
comfyanonymous	da49b7d0b6	Remove useless annotations imports. (#14105)	2026-05-25 19:23:29 -07:00
Jedrzej Kosinski	0a2dd86e78	MultiGPU Work Units For Accelerated Sampling (CORE-184) (#7063)	2026-05-25 18:26:40 -07:00
comfyanonymous	08d809d128	Fix --use-flash-attention ignored when xformers installed. (#14083)	2026-05-23 17:44:28 -07:00
comfyanonymous	f9c84c94b4	Support Stable Audio 3 model. (#14010)	2026-05-20 11:34:22 -04:00
Cezarijus Kivylius	78b5dec6b6	fix: Hunyuan3D 2.1 batch size crashes in attention and forward pass (#13699)	2026-05-20 19:58:49 +08:00
Jukka Seppänen	33ce449c8b	Reduce LTX2.3 peak VRAM when guide_mask is in use (CORE-166) (#13735) ... - Reduce peak VRAM by handling self_attn_mask more efficiently - Fallback to SDPA when self_attention_mask is used	2026-05-16 00:02:27 +03:00
Jukka Seppänen	77e2ed5e01	feat: Support MoGe (CORE-168) (#13878)	2026-05-15 10:34:56 +08:00
Jukka Seppänen	8e53f001a4	feat: Support HiDream-O1-Image (CORE-187) (#13817) ... * Initial HiDream01-image support * Cleanup nodes * Cleaner handling of empty placeholder models * Remove snap_to_predefined, prefer tooltip for the trained resolutions * Add model and block wrappers * Fix shift tooltip * Add node to work around the patch tile issue Experimental, runs multiple passes with the patch grid offset and blends with various different methods. * Qwen35 vision rotary_pos_emb cast fix * Fix embedding layout type * Some small optimizations * Cleanup, don't need this fallback * Prefix KV cache, cleanup Bit of speed, reduce redundant code * Get rid of redundant custom sampler, refactor noise scaling Our existing lcm sampler is mathematically same, just added the missing options to it instead and a node to control them. Refactored the noise scaling and fix it for the stochastic samplers, add a generic node to control the initial noise scale. * Update nodes_hidream_o1.py * Fix some cache validation cases * Keep existing sampling params * Remove redundant video vision path * Replace some numpy ops with torch * Fx RoPE index for batch size > 1 * Prefer torch preprocessing * Rename block_type to be compatible with existing patch nodes * Fixes and tweaks	2026-05-11 20:35:53 -07:00
Jukka Seppänen	3200f28e3a	Support Wan-Dancer (#13813) ... * initial WanDancer support * nodes_wandancer: Add list form of chunker. Create an alternate list form of the node so the chunk gens can be trivially looped by the comfy executor. * Closer match to original soxr resampling * Remove librosa node * Cleanup --------- Co-authored-by: Rattus <rattus128@gmail.com>	2026-05-09 14:02:56 -07:00
omahs	bac6fc35fb	Fix typos (#10986)	2026-05-08 17:14:45 +08:00
Jukka Seppänen	8dc3f3f209	Improve SAM3 large input handling (#13767)	2026-05-07 17:18:28 -07:00
ozbayb	e0ea2e41c8	Merge remote-tracking branch 'origin/master' into 20260322a_ltx_contextwin	2026-05-05 20:14:21 -06:00
Talmaj	fed8d5efa6	feat: Auto-regressive video generation (CORE-25) (#13082)	2026-05-04 21:01:22 -07:00
Jukka Seppänen	be95871adc	feat: Gemma4 text generation support (CORE-30) (#13376) ... * initial gemma4 support * parity with reference implementation outputs can 100% match transformers with same sdpa flags, checkpoint this and then optimize * Cleanup, video fixes * cleanup, enable fused rms norm by default * update comment * Cleanup * Update sd.py * Various fixes * Add fp8 scaled embedding support * small fixes * Translate think tokens * Fix image encoder attention mask type So it works with basic attention * Handle thinking tokens different only for Gemma4 * Code cleanup * Update nodes_textgen.py * Use embed scale class instead of buffer Slight difference to HF, but technically more accurate and simpler code * Default to fused rms_norm * Update gemma4.py	2026-05-02 22:46:15 -04:00
rattus	783782d5d7	Implement block prefetch + Lora Async load + and adopt in LTX (Speedup!) (CORE-111) (#13618) ... * mm: Use Aimdo raw allocator for cast buffers pytorch manages allocation of growing buffers on streams poorly. Pyt has no windows support for the expandable segments allocator (which is the right tool for this job), while also segmenting the memory by stream such that it can be generally re-used. So kick the problem to aimdo which can just grow a virtual region thats freed per stream. * plan * ops: move cpu handler up to the caller * ops: split up prefetch from weight prep block prefetching API Split up the casting and weight formating/lora stuff in prep for arbitrary prefetch support. * ops: implement block prefetching API allow a model to construct a prefetch list and operate it for increased async offload. * ltxv2: Implement block prefetching * Implement lora async offload Implement async offload of loras.	2026-05-02 19:23:24 -04:00
Talmaj	5eeae3f1d8	Cogvideox (#13402) ... --------- Co-authored-by: kijai <40791699+kijai@users.noreply.github.com> Co-authored-by: Talmaj Marinc <talmaj@comfy.org>	2026-04-29 19:30:08 -04:00
drozbay	f959e6bfa1	Merge branch 'master' into 20260322a_ltx_contextwin	2026-04-26 17:01:18 -06:00
Jukka Seppänen	084e08c6e2	Disable sageattention for SAM3 (#13529) ... Causes Nans	2026-04-23 11:14:42 -07:00
Jukka Seppänen	749d5b4e8d	feat: SAM (segment anything) 3.1 support (CORE-34) (#13408)	2026-04-23 00:07:43 -04:00
comfyanonymous	ad94d47221	Make the ltx audio vae more native. (#13486)	2026-04-21 11:02:42 -04:00
comfyanonymous	3d816db07f	Some optimizations to make Ernie inference a bit faster. (#13472)	2026-04-18 23:02:29 -04:00
Jukka Seppänen	b9dedea57d	feat: SUPIR model support (CORE-17) (#13250)	2026-04-18 23:02:01 -04:00
comfyanonymous	cb0bbde402	Fix ernie on devices that don't support fp64. (#13414)	2026-04-14 22:54:47 -04:00
comfyanonymous	402ff1cdb7	Fix issue with ernie image. (#13393)	2026-04-13 16:38:42 -04:00
drozbay	32e9e4a694	Merge branch 'master' into 20260322a_ltx_contextwin	2026-04-12 12:22:31 -06:00
comfyanonymous	31283d2892	Implement Ernie Image model. (#13369)	2026-04-11 22:29:31 -04:00
comfyanonymous	55ebd287ee	Add a supports_fp64 function. (#13368)	2026-04-11 21:06:36 -04:00
Jukka Seppänen	a134423890	SDPose: resize input always (#13349)	2026-04-10 11:26:55 -10:00
huemin	b615af1c65	Add support for small flux.2 decoder (#13314)	2026-04-07 03:44:18 -04:00
comfyanonymous	40862c0776	Support Ace Step 1.5 XL model. (#13317)	2026-04-07 03:13:47 -04:00
ozbayb	9566c18ced	LTX2 context windows - Fix crash when a window doesn't have a guide index	2026-04-06 10:10:19 -06:00
ozbayb	115dbb69d1	LTX2 context windows part 3 - Generalize guide splitting to windows	2026-04-06 10:10:19 -06:00
comfyanonymous	0c63b4f6e3	Remove dead code. (#13251)	2026-04-01 20:22:06 -04:00
Jukka Seppänen	a500f1edac	CORE-13 feat: Support RT-DETRv4 detection model (#12748)	2026-03-28 23:34:10 -04:00
Jukka Seppänen	e87858e974	feat: LTX2: Support reference audio (ID-LoRA) (#13111)	2026-03-23 18:22:24 -04:00
Talmaj	d49420b3c7	LongCat-Image edit (#13003)	2026-03-21 23:51:05 -04:00
rattus	25b6d1d629	wan: vae: Fix light/color change (#13101) ... There was an issue where the resample split was too early and dropped one of the rolling convolutions a frame early. This is most noticable as a lighting/color change between pixel frames 5->6 (latent 2->3), or as a lighting change between the first and last frame in an FLF wan flow.	2026-03-21 18:44:35 -04:00
rattus	f49856af57	ltx: vae: Fix missing init variable (#13074) ... Forgot to push this ammendment. Previous test results apply to this.	2026-03-19 22:34:58 -04:00
rattus	82b868a45a	Fix VRAM leak in tiler fallback in video VAEs (#13073) ... * sd: soft_empty_cache on tiler fallback This doesnt cost a lot and creates the expected VRAM reduction in resource monitors when you fallback to tiler. * wan: vae: Don't recursion in local fns (move run_up) Moved Decoder3d’s recursive run_up out of forward into a class method to avoid nested closure self-reference cycles. This avoids cyclic garbage that delays garbage of tensors which in turn delays VRAM release before tiled fallback. * ltx: vae: Don't recursion in local fns (move run_up) Mov the recursive run_up out of forward into a class method to avoid nested closure self-reference cycles. This avoids cyclic garbage that delays garbage of tensors which in turn delays VRAM release before tiled fallback.	2026-03-19 22:30:27 -04:00
rattus	fabed694a2	ltx: vae: implement chunked encoder + CPU IO chunking (Big VRAM reductions) (#13062) ... * ltx: vae: add cache state to downsample block * ltx: vae: Add time stride awareness to causal_conv_3d * ltx: vae: Automate truncation for encoder Other VAEs just truncate without error. Do the same. * sd/ltx: Make chunked_io a flag in its own right Taking this bi-direcitonal, so make it a for-purpose named flag. * ltx: vae: implement chunked encoder + CPU IO chunking People are doing things with big frame counts in LTX including V2V flows. Implement the time-chunked encoder to keep the VRAM down, with the converse of the new CPU pre-allocation technique, where the chunks are brought from the CPU JIT. * ltx: vae-encode: round chunk sizes more strictly Only powers of 2 and multiple of 8 are valid due to cache slicing.	2026-03-19 09:58:47 -07:00
Jukka Seppänen	9fff091f35	Further Reduce LTX VAE decode peak RAM usage (#13052)	2026-03-18 18:32:26 -04:00
rattus	cad24ce262	cascade: remove dead weight init code (#13026) ... This weight init process is fully shadowed be the weight load and doesnt work in dynamic_vram were the weight allocation is deferred.	2026-03-17 20:59:10 -04:00