Jedrzej Kosinski 819c7c0702 Refactor MultiGPU scheduler for readability and termination safety (#14001) ... Behaviour-equivalent cleanup of _calc_cond_batch_multigpu device scheduling. No change to batching decisions or memory checks for any valid input. Changes: * Replace re-summed batched_to_run_length with a per-device load dict (device_load), so capacity checks are O(1) and use a single source of truth. * Extract device selection into next_available_device(), which scans at most len(devices) positions and raises if no device has remaining capacity. This makes the 'skip a full device' rule live in one place instead of two and guarantees the outer while loop cannot spin forever on a scheduling bug. * Drop the unused current_device assignment before the outer loop and the index_device % len(devices) modulo dance (now handled inside next_available_device). * Minor cleanups: list comprehensions for total_conds, conds_to_batch, and the devices list.		2026-05-19 21:23:56 -07:00
..
audio_encoders	Fix fp16 audio encoder models (#12811)	2026-03-06 18:20:07 -05:00
cldm	Add better error message for common error. (#10846)	2025-11-23 04:55:22 -05:00
comfy_types	fix: use frontend-compatible format for Float gradient_stops (#12789)	2026-03-12 10:14:28 -07:00
extra_samplers
image_encoders
k_diffusion	ace15: Use dynamic_vram friendly trange (#12409)	2026-02-11 14:53:42 -05:00
ldm	Merge master into worksplit-multigpu (#13546)	2026-04-23 19:20:14 -07:00
sd1_tokenizer
t2i_adapter
taesd	Support LTX2 tiny vae (taeltx_2) (#11929)	2026-01-21 23:03:51 -05:00
text_encoders	Merge master into worksplit-multigpu (#13546)	2026-04-23 19:20:14 -07:00
weight_adapter	MPDynamic: force load flux img_in weight (Fixes flux1 canny+depth lora crash) (#12446)	2026-02-15 20:30:09 -05:00
cli_args.py	Merge branch 'master' into worksplit-multigpu	2026-03-30 06:24:55 -07:00
clip_config_bigg.json
clip_model.py	Support the siglip 2 naflex model as a clip vision model. (#11831)	2026-01-12 17:05:54 -05:00
clip_vision_config_g.json
clip_vision_config_h.json
clip_vision_config_vitl_336_llava.json
clip_vision_config_vitl_336.json
clip_vision_config_vitl.json
clip_vision_siglip2_base_naflex.json	Support the siglip 2 naflex model as a clip vision model. (#11831)	2026-01-12 17:05:54 -05:00
clip_vision_siglip_384.json
clip_vision_siglip_512.json
clip_vision.py	Reduce RAM usage, fix VRAM OOMs, and fix Windows shared memory spilling with adaptive model loading (#11845)	2026-02-01 01:01:11 -05:00
conds.py	Cleanups to the last PR. (#12646)	2026-02-26 01:30:31 -05:00
context_windows.py	Add slice_cond and per-model context window cond resizing (#12645)	2026-03-19 20:42:42 -07:00
controlnet.py	Merge branch 'master' into worksplit-multigpu	2026-02-17 02:53:06 -08:00
diffusers_convert.py
diffusers_load.py
float.py	feat: Support mxfp8 (#12907)	2026-03-14 18:36:29 -04:00
gligen.py
hooks.py	New Year ruff cleanup. (#11595)	2026-01-01 22:06:14 -05:00
latent_formats.py	Feat: z-image pixel space (model still training atm) (#12709)	2026-03-02 19:43:47 -05:00
lora_convert.py	Use torch RMSNorm for flux models and refactor hunyuan video code. (#12432)	2026-02-13 15:35:13 -05:00
lora.py	Fix text encoder lora loading for wrapped models (#12852)	2026-03-09 16:08:51 -04:00
memory_management.py	Integrate RAM cache with model RAM management (#13173)	2026-03-27 21:34:16 -04:00
model_base.py	Merge master into worksplit-multigpu (#13546)	2026-04-23 19:20:14 -07:00
model_detection.py	Merge master into worksplit-multigpu (#13546)	2026-04-23 19:20:14 -07:00
model_management.py	Merge master into worksplit-multigpu (#13546)	2026-04-23 19:20:14 -07:00
model_patcher.py	Merge master into worksplit-multigpu (#13546)	2026-04-23 19:20:14 -07:00
model_sampling.py	initial FlowRVS support (#12637)	2026-02-25 23:38:46 -05:00
multigpu.py	Implement persistent thread pool for multi-GPU CFG splitting (#13329)	2026-04-08 05:39:07 -07:00
nested_tensor.py
ops.py	Fix OOM regression in _apply() for quantized models during inference (#13372)	2026-04-15 02:10:36 -07:00
options.py
patcher_extension.py
pinned_memory.py	Integrate RAM cache with model RAM management (#13173)	2026-03-27 21:34:16 -04:00
pixel_space_convert.py
quant_ops.py	Re-enable comfy-kitchen cuda backend for multigpu testing	2026-03-30 08:32:52 -07:00
rmsnorm.py	Remove code to support RMSNorm on old pytorch. (#12499)	2026-02-16 20:09:24 -05:00
sample.py	Fix fp16 intermediates giving different results. (#13100)	2026-03-21 17:53:25 -04:00
sampler_helpers.py	Implement persistent thread pool for multi-GPU CFG splitting (#13329)	2026-04-08 05:39:07 -07:00
samplers.py	Refactor MultiGPU scheduler for readability and termination safety (#14001)	2026-05-19 21:23:56 -07:00
sd1_clip_config.json
sd1_clip.py	feat: Support Qwen3.5 text generation models (#12771)	2026-03-25 22:48:28 -04:00
sd.py	Merge master into worksplit-multigpu (#13546)	2026-04-23 19:20:14 -07:00
sdxl_clip.py
supported_models_base.py	Fix some custom nodes. (#11134)	2025-12-05 18:25:31 -05:00
supported_models.py	Merge master into worksplit-multigpu (#13546)	2026-04-23 19:20:14 -07:00
utils.py	Reduce tiled decode peak memory (#13050)	2026-03-19 13:29:34 -04:00
windows.py	Reduce RAM usage, fix VRAM OOMs, and fix Windows shared memory spilling with adaptive model loading (#11845)	2026-02-01 01:01:11 -05:00