wangbo/ComfyUI
1
0
Fork 0
mirror of https://github.com/comfyanonymous/ComfyUI.git synced 2026-02-08 20:42:32 +08:00
Code Issues Actions 9 Packages Projects Releases Wiki Activity

mp: big bump on the VBAR sizes

Browse Source 
Now that the model defined dtype is decoupled from the state_dict
dtypes we need to be able to handle worst case scenario casts between
the SD and VBAR.
This commit is contained in:
Rattus 2026-01-21 23:57:52 +10:00
parent 19c9219fe4
commit 8371708e09
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
comfy/model_patcher.py
View File

@ -1423,7 +1423,10 @@ class ModelPatcherDynamic(ModelPatcher):
return None return None
vbar = self.model.dynamic_vbars.get(self.load_device, None) vbar = self.model.dynamic_vbars.get(self.load_device, None)
if create and vbar is None: if create and vbar is None:
vbar = comfy_aimdo.model_vbar.ModelVBAR(self.model_size() * 1.2, self.load_device.index) # x10. We dont know what model defined type casts we have in the vbar, but virtual address
# space is pretty free. This will cover someone casting an entire model from FP4 to FP32
# with some left over.
vbar = comfy_aimdo.model_vbar.ModelVBAR(self.model_size() * 10, self.load_device.index)
self.model.dynamic_vbars[self.load_device] = vbar self.model.dynamic_vbars[self.load_device] = vbar
return vbar return vbar