wangbo/ComfyUI
1
0
Fork 0
mirror of https://github.com/comfyanonymous/ComfyUI.git synced 2026-05-23 07:27:24 +08:00
Code Issues Actions 28 Packages Projects Releases Wiki Activity
d111c97ae6
ComfyUI/comfy_extras
History
Jukka Seppänen be95871adc
feat: Gemma4 text generation support (CORE-30) (#13376) 
* initial gemma4 support

* parity with reference implementation

outputs can 100% match transformers with same sdpa flags, checkpoint this and then optimize

* Cleanup, video fixes

* cleanup, enable fused rms norm by default

* update comment

* Cleanup

* Update sd.py

* Various fixes

* Add fp8 scaled embedding support

* small fixes

* Translate think tokens

* Fix image encoder attention mask type

So it works with basic attention

* Handle thinking tokens different only for Gemma4

* Code cleanup

* Update nodes_textgen.py

* Use embed scale class instead of buffer

Slight difference to HF, but technically more accurate and simpler code

* Default to fused rms_norm

* Update gemma4.py
2026-05-02 22:46:15 -04:00
..
chainner_models
frame_interpolation_models feat: RIFE and FILM frame interpolation model support (CORE-29) (#13258) 2026-04-22 04:16:02 -07:00
nodes_ace.py Refactor io to IO in nodes_ace.py (#13485) 2026-04-20 21:59:26 -04:00
nodes_advanced_samplers.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_align_your_steps.py
nodes_apg.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_attention_multiply.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_audio_encoder.py
nodes_audio.py Make the ltx audio vae more native. (#13486) 2026-04-21 11:02:42 -04:00
nodes_camera_trajectory.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_canny.py Fix canny node not working with fp16. (#13085) 2026-03-20 23:15:50 -04:00
nodes_cfg.py
nodes_chroma_radiance.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_clip_sdxl.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_color.py
nodes_compositing.py
nodes_cond.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_context_windows.py Add slice_cond and per-model context window cond resizing (#12645) 2026-03-19 20:42:42 -07:00
nodes_controlnet.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_cosmos.py
nodes_curve.py image histogram node (#13153) 2026-04-06 14:54:02 -07:00
nodes_custom_sampler.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_dataset.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_differential_diffusion.py
nodes_easycache.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_edit_model.py
nodes_eps.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_flux.py Lower kv cache memory usage. (#12909) 2026-03-12 16:54:38 -04:00
nodes_frame_interpolation.py feat: RIFE and FILM frame interpolation model support (CORE-29) (#13258) 2026-04-22 04:16:02 -07:00
nodes_freelunch.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_fresca.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_gits.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_glsl.py Add has_intermediate_output flag for nodes with interactive UI (#13048) 2026-03-27 21:06:38 -04:00
nodes_hidream.py
nodes_hooks.py Disable dynamic_vram when weight hooks applied (#12653) 2026-02-28 16:50:18 -05:00
nodes_hunyuan3d.py Change the save 3d model node's filename prefix to 3d/ComfyUI (CORE-106) (#12826) 2026-04-28 00:59:59 -07:00
nodes_hunyuan.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_hypernetwork.py
nodes_hypertile.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_image_compare.py feat: add essentials_category to nodes and blueprints for Essentials tab (#12573) 2026-03-15 16:18:04 -07:00
nodes_images.py Add has_intermediate_output flag for nodes with interactive UI (#13048) 2026-03-27 21:06:38 -04:00
nodes_ip2p.py
nodes_kandinsky5.py
nodes_latent.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_load_3d.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_logic.py
nodes_lora_debug.py
nodes_lora_extract.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_lotus.py
nodes_lt_audio.py Make the ltx audio vae more native. (#13486) 2026-04-21 11:02:42 -04:00
nodes_lt_upsampler.py
nodes_lt.py Fix LTXV Reference Audio node (#13531) 2026-04-23 11:13:17 -07:00
nodes_lumina2.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_mahiro.py refactor: rename Mahiro CFG to Similarity-Adaptive Guidance (#12172) 2026-02-28 20:59:24 -08:00
nodes_mask.py Fix SolidMask and MaskComposite device mismatch with --gpu-only (#13296) 2026-04-28 01:18:19 -07:00
nodes_math.py feat: add Math Expression node with simpleeval evaluation (#12687) 2026-03-05 18:51:28 -08:00
nodes_mochi.py
nodes_model_advanced.py initial FlowRVS support (#12637) 2026-02-25 23:38:46 -05:00
nodes_model_downscale.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_model_merging_model_specific.py
nodes_model_merging.py
nodes_model_patch.py feat: SUPIR model support (CORE-17) (#13250) 2026-04-18 23:02:01 -04:00
nodes_morphology.py
nodes_nag.py Add category to Normalized Attention Guidance node (#12565) 2026-02-21 19:51:21 -05:00
nodes_nop.py
nodes_number_convert.py fix(number-convert): preserve int precision for large numbers (#13147) 2026-03-25 18:06:34 -04:00
nodes_optimalsteps.py
nodes_pag.py
nodes_painter.py Add has_intermediate_output flag for nodes with interactive UI (#13048) 2026-03-27 21:06:38 -04:00
nodes_perpneg.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_photomaker.py
nodes_pixart.py
nodes_post_processing.py feat: SUPIR model support (CORE-17) (#13250) 2026-04-18 23:02:01 -04:00
nodes_preview_any.py Print more tensor values in the preview any node. (#13544) 2026-04-23 22:19:00 -04:00
nodes_primitive.py fix: swap essentials_category from CLIPTextEncode to PrimitiveStringMultiline (#12553) 2026-02-20 23:46:46 -08:00
nodes_qwen.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_rebatch.py
nodes_replacements.py
nodes_resolution.py refactor: use AspectRatio enum members as ASPECT_RATIOS dict keys (#12689) 2026-02-27 20:53:46 -08:00
nodes_rope.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_rtdetr.py SDPose: resize input always (#13349) 2026-04-10 11:26:55 -10:00
nodes_sag.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_sam3.py feat: SAM (segment anything) 3.1 support (CORE-34) (#13408) 2026-04-23 00:07:43 -04:00
nodes_sd3.py Make EmptySD3LatentImage node use intermediate dtype. (#13577) 2026-04-26 23:23:57 -04:00
nodes_sdpose.py SDPose: resize fix (#13656) 2026-05-01 14:17:25 -07:00
nodes_sdupscale.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_slg.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_stable3d.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_stable_cascade.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_string.py Add JsonExtractString node. (#13435) 2026-04-17 00:20:16 -04:00
nodes_tcfg.py
nodes_textgen.py feat: Gemma4 text generation support (CORE-30) (#13376) 2026-05-02 22:46:15 -04:00
nodes_tomesd.py
nodes_toolkit.py
nodes_torch_compile.py Disable dynamic_vram when using torch compiler (#12612) 2026-02-24 19:13:46 -05:00
nodes_train.py Fix Train LoRA crash when training_dtype is "none" with bfloat16 LoRA weights (#13145) 2026-03-24 23:53:44 -04:00
nodes_upscale_model.py Make ImageUpscaleWithModel node work with intermediate device and dtype. (#13357) 2026-04-10 21:48:26 -04:00
nodes_video_model.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_video.py fix: move essentials_category to correct replacement nodes (#12568) 2026-02-26 01:00:32 -08:00
nodes_wan.py feat: Support SCAIL WanVideo model (#12614) 2026-02-28 16:49:12 -05:00
nodes_wanmove.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00
nodes_webcam.py
nodes_zimage.py feat: mark 429 widgets as advanced for collapsible UI (#12197) 2026-02-19 19:20:02 -08:00