Jukka Seppänen be95871adc feat: Gemma4 text generation support (CORE-30) (#13376) ... * initial gemma4 support * parity with reference implementation outputs can 100% match transformers with same sdpa flags, checkpoint this and then optimize * Cleanup, video fixes * cleanup, enable fused rms norm by default * update comment * Cleanup * Update sd.py * Various fixes * Add fp8 scaled embedding support * small fixes * Translate think tokens * Fix image encoder attention mask type So it works with basic attention * Handle thinking tokens different only for Gemma4 * Code cleanup * Update nodes_textgen.py * Use embed scale class instead of buffer Slight difference to HF, but technically more accurate and simpler code * Default to fused rms_norm * Update gemma4.py		2026-05-02 22:46:15 -04:00
..
audio_encoders	Fix fp16 audio encoder models (#12811)	2026-03-06 18:20:07 -05:00
cldm
comfy_types	fix: use frontend-compatible format for Float gradient_stops (#12789)	2026-03-12 10:14:28 -07:00
extra_samplers
image_encoders
k_diffusion	ace15: Use dynamic_vram friendly trange (#12409)	2026-02-11 14:53:42 -05:00
ldm	feat: Gemma4 text generation support (CORE-30) (#13376)	2026-05-02 22:46:15 -04:00
sd1_tokenizer
t2i_adapter
taesd	Add high quality preview support for Flux2 latents (#13496)	2026-04-29 19:37:30 -04:00
text_encoders	feat: Gemma4 text generation support (CORE-30) (#13376)	2026-05-02 22:46:15 -04:00
weight_adapter	MPDynamic: force load flux img_in weight (Fixes flux1 canny+depth lora crash) (#12446)	2026-02-15 20:30:09 -05:00
cli_args.py	Remove IPEX and clean up checks and add missing synchronize during empty cache. (#13653)	2026-05-01 14:16:41 -07:00
clip_config_bigg.json
clip_model.py	Support the siglip 2 naflex model as a clip vision model. (#11831)	2026-01-12 17:05:54 -05:00
clip_vision_config_g.json
clip_vision_config_h.json
clip_vision_config_vitl_336_llava.json
clip_vision_config_vitl_336.json
clip_vision_config_vitl.json
clip_vision_siglip2_base_naflex.json	Support the siglip 2 naflex model as a clip vision model. (#11831)	2026-01-12 17:05:54 -05:00
clip_vision_siglip_384.json
clip_vision_siglip_512.json
clip_vision.py	Reduce RAM usage, fix VRAM OOMs, and fix Windows shared memory spilling with adaptive model loading (#11845)	2026-02-01 01:01:11 -05:00
conds.py	Cleanups to the last PR. (#12646)	2026-02-26 01:30:31 -05:00
context_windows.py	Add slice_cond and per-model context window cond resizing (#12645)	2026-03-19 20:42:42 -07:00
controlnet.py	Add working Qwen 2512 ControlNet (Fun ControlNet) support (#12359)	2026-02-13 22:23:52 -05:00
diffusers_convert.py
diffusers_load.py
float.py	feat: Support mxfp8 (#12907)	2026-03-14 18:36:29 -04:00
gligen.py
hooks.py
latent_formats.py	Add high quality preview support for Flux2 latents (#13496)	2026-04-29 19:37:30 -04:00
lora_convert.py	Use torch RMSNorm for flux models and refactor hunyuan video code. (#12432)	2026-02-13 15:35:13 -05:00
lora.py	Implement block prefetch + Lora Async load + and adopt in LTX (Speedup!) (CORE-111) (#13618)	2026-05-02 19:23:24 -04:00
memory_management.py	Integrate RAM cache with model RAM management (#13173)	2026-03-27 21:34:16 -04:00
model_base.py	Implement block prefetch + Lora Async load + and adopt in LTX (Speedup!) (CORE-111) (#13618)	2026-05-02 19:23:24 -04:00
model_detection.py	Cogvideox (#13402)	2026-04-29 19:30:08 -04:00
model_management.py	Implement block prefetch + Lora Async load + and adopt in LTX (Speedup!) (CORE-111) (#13618)	2026-05-02 19:23:24 -04:00
model_patcher.py	Implement block prefetch + Lora Async load + and adopt in LTX (Speedup!) (CORE-111) (#13618)	2026-05-02 19:23:24 -04:00
model_prefetch.py	Implement block prefetch + Lora Async load + and adopt in LTX (Speedup!) (CORE-111) (#13618)	2026-05-02 19:23:24 -04:00
model_sampling.py	Cogvideox (#13402)	2026-04-29 19:30:08 -04:00
nested_tensor.py
ops.py	feat: Gemma4 text generation support (CORE-30) (#13376)	2026-05-02 22:46:15 -04:00
options.py
patcher_extension.py
pinned_memory.py	dynamicVRAM + --cache-ram 2 (CORE-117) (#13603)	2026-04-28 19:15:02 -04:00
pixel_space_convert.py
quant_ops.py	feat: Support mxfp8 (#12907)	2026-03-14 18:36:29 -04:00
rmsnorm.py	feat: Gemma4 text generation support (CORE-30) (#13376)	2026-05-02 22:46:15 -04:00
sample.py	Fix fp16 intermediates giving different results. (#13100)	2026-03-21 17:53:25 -04:00
sampler_helpers.py	Disable dynamic_vram when weight hooks applied (#12653)	2026-02-28 16:50:18 -05:00
samplers.py	Fix sampling issue with fp16 intermediates. (#13099)	2026-03-21 17:47:42 -04:00
sd1_clip_config.json
sd1_clip.py	feat: Support Qwen3.5 text generation models (#12771)	2026-03-25 22:48:28 -04:00
sd.py	feat: Gemma4 text generation support (CORE-30) (#13376)	2026-05-02 22:46:15 -04:00
sdxl_clip.py
supported_models_base.py
supported_models.py	Reformat models variable into multiline array CORE-59 (#13513)	2026-05-01 17:20:11 +08:00
utils.py	feat: Gemma4 text generation support (CORE-30) (#13376)	2026-05-02 22:46:15 -04:00
windows.py	Reduce RAM usage, fix VRAM OOMs, and fix Windows shared memory spilling with adaptive model loading (#11845)	2026-02-01 01:01:11 -05:00