219 Commits

Author	SHA1	Message	Date
ozbayb	d5badc5f38	LTX2 context windows - Clean up unnecessary code	2026-04-07 13:00:38 -06:00
ozbayb	f1acd5bd85	LTX2 context windows - Cleanup: Simplify window data handling, improve variable names, refactor and condense new context window methods to separate execution paths cleanly	2026-04-07 12:43:41 -06:00
ozbayb	874690c01c	LTX2 context windows - Refactor guide logic from context_windows into LTXAV model hooks	2026-04-06 11:44:14 -06:00
ozbayb	350237618d	LTX2 context windows - Cleanup: Remove model specific code from BaseModel. Older LTXV model's guides + context_windows will need to be re-implemented but outside the scope of LTX2 changes	2026-04-06 10:10:19 -06:00
ozbayb	3660533f83	LTX2 context windows - Cleanup: latent_start value is required for context windows with guides	2026-04-06 10:10:19 -06:00
ozbayb	ef61ddfaed	Fix freenoise application for LTXAV context windows, fix audio mapping to context windows	2026-04-06 10:10:19 -06:00
ozbayb	115dbb69d1	LTX2 context windows part 3 - Generalize guide splitting to windows	2026-04-06 10:10:19 -06:00
ozbayb	941d50e777	LTX2 context windows part 2b - Calculate guide parameters in model code, refactor	2026-04-06 10:10:19 -06:00
ozbayb	56de390c25	LTX2 context windows part 2 - Guide aware processing	2026-04-06 10:10:19 -06:00
ozbayb	5bfe660b7c	Test implementation for LTX2 context windows	2026-04-06 10:10:19 -06:00
Jukka Seppänen	a500f1edac	CORE-13 feat: Support RT-DETRv4 detection model (#12748)	2026-03-28 23:34:10 -04:00
comfyanonymous	3a56201da5	Allow flux conditioning without a pooled output. (#13198)	2026-03-27 20:36:26 -04:00
Jukka Seppänen	e87858e974	feat: LTX2: Support reference audio (ID-LoRA) (#13111)	2026-03-23 18:22:24 -04:00
Talmaj	d49420b3c7	LongCat-Image edit (#13003)	2026-03-21 23:51:05 -04:00
Jedrzej Kosinski	87cda1fc25	Move inline comfy.context_windows imports to top-level in model_base.py (#13083) ... The recent PR that added resize_cond_for_context_window methods to model classes used inline 'import comfy.context_windows' in each method body. This moves that import to the top-level import section, replacing 4 duplicate inline imports with a single top-level one.	2026-03-20 20:03:42 -04:00
drozbay	589228e671	Add slice_cond and per-model context window cond resizing (#12645) ... * Add slice_cond and per-model context window cond resizing * Fix cond_value.size() call in context window cond resizing * Expose additional advanced inputs for ContextWindowsManualNode Necessary for WanAnimate context windows workflow, which needs cond_retain_index_list = 0 to work properly with its reference input. ---------	2026-03-19 20:42:42 -07:00
comfyanonymous	43c64b6308	Support the LTXAV 2.3 model. (#12773)	2026-03-04 20:06:20 -05:00
Lodestone	9ebee0a217	Feat: z-image pixel space (model still training atm) (#12709) ... * draft zeta (z-image pixel space) * revert gitignore * model loaded and able to run however vector direction still wrong tho * flip the vector direction to original again this time * Move wrongly positioned Z image pixel space class * inherit Radiance LatentFormat class * Fix parameters in classes for Zeta x0 dino * remove arbitrary nn.init instances * Remove unused import of lru_cache --------- Co-authored-by: silveroxides <ishimarukaito@gmail.com>	2026-03-02 19:43:47 -05:00
Jukka Seppänen	1f6744162f	feat: Support SCAIL WanVideo model (#12614)	2026-02-28 16:49:12 -05:00
Talmaj	ac4412d0fa	Native LongCat-Image implementation (#12597)	2026-02-27 23:04:34 -05:00
comfyanonymous	8a4d85c708	Cleanups to the last PR. (#12646)	2026-02-26 01:30:31 -05:00
Tavi Halperin	a4522017c5	feat: per-guide attention strength control in self-attention (#12518) ... Implements per-guide attention attenuation via log-space additive bias in self-attention. Each guide reference tracks its own strength and optional spatial mask in conditioning metadata (guide_attention_entries).	2026-02-26 01:25:23 -05:00
Jukka Seppänen	907e5dcbbf	initial FlowRVS support (#12637)	2026-02-25 23:38:46 -05:00
comfyanonymous	f266b8d352	Move LTXAV av embedding connectors to diffusion model. (#12569)	2026-02-21 22:29:58 -05:00
comfyanonymous	c39653163d	Fix anima preprocess text embeds not using right inference dtype. (#12501)	2026-02-17 00:29:20 -05:00
comfyanonymous	76a7fa96db	Make built in lora training work on anima. (#12402)	2026-02-10 22:04:32 -05:00
comfyanonymous	17e7df43d1	Pad ace step 1.5 ref audio if not long enough. (#12341)	2026-02-07 00:02:11 -05:00
comfyanonymous	eba6c940fd	Make ace step 1.5 base model work properly with default workflow. (#12337)	2026-02-06 19:14:56 -05:00
comfyanonymous	c2d7f07dbf	Fix issue when using disable_unet_model_creation (#12315)	2026-02-05 19:24:09 -05:00
comfyanonymous	6555dc65b8	Make ace step 1.5 work without the llm. (#12311)	2026-02-05 16:43:45 -05:00
comfyanonymous	6125b80979	Add llm sampling options and make reference audio work on ace step 1.5 (#12295)	2026-02-04 21:29:22 -05:00
comfyanonymous	3c1a1a2df8	Basic support for the ace step 1.5 model. (#12237)	2026-02-03 00:06:18 -05:00
rattus	f8acd9c402	Reduce RAM usage, fix VRAM OOMs, and fix Windows shared memory spilling with adaptive model loading (#11845)	2026-02-01 01:01:11 -05:00
Omri Marom	d7f3241bf6	qwen_image: propagate attention mask. (#11966)	2026-01-22 20:02:31 -05:00
comfyanonymous	abe2ec26a6	Support the Anima model. (#12012)	2026-01-21 19:44:28 -05:00
comfyanonymous	2108167f9f	Support zimage omni base model. (#11979)	2026-01-19 23:17:38 -05:00
comfyanonymous	f2b002372b	Support the LTXV 2 model. (#11632)	2026-01-05 01:58:59 -05:00
woctordho	4c432c11ed	Implement Jina CLIP v2 and NewBie dual CLIP (#11415) ... * Implement Jina CLIP v2 * Support quantized Gemma in NewBie dual CLIP	2025-12-20 00:57:22 -05:00
comfyanonymous	56fa7dbe38	Properly load the newbie diffusion model. (#11172) ... There is still one of the text encoders missing and I didn't actually test it.	2025-12-07 07:44:55 -05:00
Jukka Seppänen	fd109325db	Kandinsky5 model support (#10988) ... * Add Kandinsky5 model support lite and pro T2V tested to work * Update kandinsky5.py * Fix fp8 * Fix fp8_scaled text encoder * Add transformer_options for attention * Code cleanup, optimizations, use fp32 for all layers originally at fp32 * ImageToVideo -node * Fix I2V, add necessary latent post process nodes * Support text to image model * Support block replace patches (SLG mostly) * Support official LoRAs * Don't scale RoPE for lite model as that just doesn't work... * Update supported_models.py * Rever RoPE scaling to simpler one * Fix typo * Handle latent dim difference for image model in the VAE instead * Add node to use different prompts for clip_l and qwen25_7b * Reduce peak VRAM usage a bit * Further reduce peak VRAM consumption by chunking ffn * Update chunking * Update memory_usage_factor * Code cleanup, don't force the fp32 layers as it has minimal effect * Allow for stronger changes with first frames normalization Default values are too weak for any meaningful changes, these should probably be exposed as advanced node options when that's available. * Add image model's own chat template, remove unused image2video template * Remove hard error in ReplaceVideoLatentFrames -node * Update kandinsky5.py * Update supported_models.py * Fix typos in prompt template They were now fixed in the original repository as well * Update ReplaceVideoLatentFrames Add tooltips Make source optional Better handle negative index * Rename NormalizeVideoLatentFrames -node For bit better clarity what it does * Fix NormalizeVideoLatentStart node out on non-op	2025-12-05 22:20:22 -05:00
comfyanonymous	43071e3de3	Make old scaled fp8 format use the new mixed quant ops system. (#11000)	2025-12-05 14:35:42 -05:00
comfyanonymous	58b8574661	Fix Flux2 reference image mem estimation. (#10905)	2025-11-26 02:36:19 -05:00
comfyanonymous	e9aae31fa2	Z Image model. (#10892)	2025-11-25 18:41:45 -05:00
comfyanonymous	6b573ae0cb	Flux 2 (#10879)	2025-11-25 10:50:19 -05:00
comfyanonymous	943b3b615d	HunyuanVideo 1.5 (#10819) ... * init * update * Update model.py * Update model.py * remove print * Fix text encoding * Prevent empty negative prompt Really doesn't work otherwise * fp16 works * I2V * Update model_base.py * Update nodes_hunyuan.py * Better latent rgb factors * Use the correct sigclip output... * Support HunyuanVideo1.5 SR model * whitespaces... * Proper latent channel count * SR model fixes This also still needs timesteps scheduling based on the noise scale, can be used with two samplers too already * vae_refiner: roll the convolution through temporal Work in progress. Roll the convolution through time using 2-latent-frame chunks and a FIFO queue for the convolution seams. * Support HunyuanVideo15 latent resampler * fix * Some cleanup Co-Authored-By: comfyanonymous <121283862+comfyanonymous@users.noreply.github.com> * Proper hyvid15 I2V channels Co-Authored-By: comfyanonymous <121283862+comfyanonymous@users.noreply.github.com> * Fix TokenRefiner for fp16 Otherwise x.sum has infs, just in case only casting if input is fp16, I don't know if necessary. * Bugfix for the HunyuanVideo15 SR model * vae_refiner: roll the convolution through temporal II Roll the convolution through time using 2-latent-frame chunks and a FIFO queue for the convolution seams. Added support for encoder, lowered to 1 latent frame to save more VRAM, made work for Hunyuan Image 3.0 (as code shared). Fixed names, cleaned up code. * Allow any number of input frames in VAE. * Better VAE encode mem estimation. * Lowvram fix. * Fix hunyuan image 2.1 refiner. * Fix mistake. * Name changes. * Rename. * Whitespace. * Fix. * Fix. --------- Co-authored-by: kijai <40791699+kijai@users.noreply.github.com> Co-authored-by: Rattus <rattus128@gmail.com>	2025-11-20 22:44:43 -05:00
contentis	8817f8fc14	Mixed Precision Quantization System (#10498) ... * Implement mixed precision operations with a registry design and metadate for quant spec in checkpoint. * Updated design using Tensor Subclasses * Fix FP8 MM * An actually functional POC * Remove CK reference and ensure correct compute dtype * Update unit tests * ruff lint * Implement mixed precision operations with a registry design and metadate for quant spec in checkpoint. * Updated design using Tensor Subclasses * Fix FP8 MM * An actually functional POC * Remove CK reference and ensure correct compute dtype * Update unit tests * ruff lint * Fix missing keys * Rename quant dtype parameter * Rename quant dtype parameter * Fix unittests for CPU build	2025-10-28 16:20:53 -04:00
comfyanonymous	1bcda6df98	WIP way to support multi multi dimensional latents. (#10456)	2025-10-23 21:21:14 -04:00
comfyanonymous	e693e4db6a	Always set diffusion model to eval() mode. (#10331)	2025-10-13 14:57:27 -04:00
comfyanonymous	dc95b6acc0	Basic WIP support for the wan animate model. (#9939)	2025-09-19 03:07:17 -04:00
comfyanonymous	dd611a7700	Support the HuMo 17B model. (#9912)	2025-09-17 18:39:24 -04:00