comfyanonymous
9f291d75b3
AuraFlow model implementation.
2024-07-11 16:52:26 -04:00
comfyanonymous
f45157e3ac
Fix error message never being shown.
2024-07-11 11:46:51 -04:00
comfyanonymous
5e1fced639
Cleaner support for loading different diffusion model types.
2024-07-11 11:37:31 -04:00
comfyanonymous
ffe0bb0a33
Remove useless code.
2024-07-10 20:33:12 -04:00
comfyanonymous
391c1046cf
More flexibility with text encoder return values.
...
Text encoders can now return other values to the CONDITIONING than the cond
and pooled output.
2024-07-10 20:06:50 -04:00
comfyanonymous
e44fa5667f
Support returning text encoder attention masks.
2024-07-10 19:31:22 -04:00
Benjamin Berman
0b45fa8db1
Fix model downloader
2024-07-09 22:52:25 -07:00
Extraltodeus
f1a01c2c7e
Add sampler_pre_cfg_function ( #3979 )
...
* Update samplers.py
* Update model_patcher.py
2024-07-09 16:20:49 -04:00
doctorpangloss
3d67224937
Improve model downloading from Hugging Face Hub
2024-07-09 12:57:33 -07:00
comfyanonymous
ade7aa1b0c
Remove useless import.
2024-07-09 11:05:05 -04:00
comfyanonymous
faa57430b0
Controlnet union model basic implementation.
...
This is only the model code itself, it currently defaults to an empty
embedding [0] * 6 which seems to work better than treating it like a
regular controlnet.
TODO: Add nodes to select the image type.
2024-07-08 23:49:02 -04:00
doctorpangloss
da21da1d8c
The first image in the workflow should be outputted, not the last.
2024-07-08 10:21:45 -07:00
doctorpangloss
a1fee05e60
Improve configuration via files, including automatically updating configuration when configuration files change.
2024-07-08 10:01:17 -07:00
comfyanonymous
bb663bcd6c
Rename clip_t5base to t5base for stable audio text encoder.
2024-07-08 08:53:55 -04:00
comfyanonymous
2dc84d1444
Add a way to set the timestep multiplier in the flow sampling.
2024-07-06 04:06:03 -04:00
comfyanonymous
ff63893d10
Support other types of T5 models.
2024-07-06 02:42:53 -04:00
comfyanonymous
4040491149
Better T5xxl detection.
2024-07-06 00:53:33 -04:00
comfyanonymous
b8e58a9394
Cleanup T5 code a bit.
2024-07-06 00:36:49 -04:00
comfyanonymous
80c4590998
Allow specifying the padding token for the tokenizer.
2024-07-06 00:06:49 -04:00
comfyanonymous
ce649d61c0
Allow zeroing out of embeds with unused attention mask.
2024-07-05 23:48:17 -04:00
doctorpangloss
b6b97574dc
Handle CPU torch more gracefully
2024-07-05 10:47:06 -07:00
doctorpangloss
cf2eaedc5b
Fix tests
2024-07-05 10:37:28 -07:00
comfyanonymous
739b76630e
Remove useless code.
2024-07-04 15:14:13 -04:00
doctorpangloss
a13088ccec
Merge upstream
2024-07-04 11:58:55 -07:00
doctorpangloss
95d47276e9
Improve tests and distributed error notifications
...
- Tests now perform faster
- Tests will run on supported GPU platforms
- Configuration has known issues related to setting up a working
directory for an embedded client
- Introduce a Skeletonize node that solves many problems with Canny
- Improve behavior of exception reporting
2024-07-04 10:16:02 -07:00
comfyanonymous
d7484ef30c
Support loading checkpoints with the UNETLoader node.
2024-07-03 11:34:32 -04:00
comfyanonymous
537f35c7bc
Don't update dict if contiguous.
2024-07-02 20:21:51 -04:00
Alex "mcmonkey" Goodwin
3f46362d22
fix non-contiguous tensor saving (from channels-last) ( #3932 )
2024-07-02 20:16:33 -04:00
Chenlei Hu
9dd549e253
Add --no-custom-node cmd flag ( #3903 )
...
* Add --no-custom-node cmd flag
* nit
2024-07-01 17:54:03 -04:00
comfyanonymous
05e831697a
Switch to the real cfg++ method in the samplers.
...
The old _pp ones will be updated automatically to the regular ones with 2x
the cfg.
My fault for not checking what the "_pp" samplers actually did.
2024-06-29 11:59:48 -04:00
doctorpangloss
dbc2a4ba29
Disable this lint warning
2024-06-28 18:45:15 -07:00
doctorpangloss
2cad5ec0d6
LoRA test
2024-06-28 17:06:29 -07:00
comfyanonymous
264caca20e
ControlNetApplySD3 node can now be used to use SD3 controlnets.
2024-06-27 18:43:11 -04:00
comfyanonymous
f8f7568d03
Basic SD3 controlnet implementation.
...
Still missing the node to properly use it.
2024-06-27 18:43:11 -04:00
comfyanonymous
66aaa14001
Controlnet refactor.
2024-06-27 18:43:11 -04:00
comfyanonymous
8ceb5a02a3
Support saving stable audio checkpoint that can be loaded back.
2024-06-27 11:06:52 -04:00
comfyanonymous
4f9d2b057c
Remove print.
2024-06-27 02:54:15 -04:00
comfyanonymous
44947e7ad4
Add DEIS order 3 sampler.
...
Order 4 seems to give bad results.
2024-06-26 22:40:05 -04:00
comfyanonymous
69d710e40f
Implement my alternative take on CFG++ as the euler_pp sampler.
...
Add euler_ancestral_pp which is the ancestral version of euler with the
same modification.
2024-06-25 07:41:52 -04:00
comfyanonymous
73ca780019
Add SamplerEulerCFG++ node.
...
This node should match the DDIM implementation of CFG++ when "regular" is
selected.
"alternative" is a slightly different take on CFG++
2024-06-23 13:21:18 -04:00
comfyanonymous
2f360ae898
Support OneTrainer SD3 lora format.
2024-06-22 13:08:04 -04:00
comfyanonymous
4ef1479dcd
Multi dimension tiled scale function and tiled VAE audio encoding fallback.
2024-06-22 11:57:49 -04:00
comfyanonymous
1e2839f4d9
More proper tiled audio decoding.
2024-06-20 16:50:31 -04:00
doctorpangloss
a315ec1c0a
Assume JSON config files are text, utf-8 encoded
2024-06-20 10:17:04 -07:00
comfyanonymous
d5efde89b7
Add ipndm_v sampler, works best with the exponential scheduler.
2024-06-20 08:51:49 -04:00
doctorpangloss
faba95d94a
Suppress with # pylint: disable=assignment-from-none because these are legit
2024-06-19 20:47:35 -07:00
doctorpangloss
185ba7e990
Reformat model_base
2024-06-19 20:43:20 -07:00
comfyanonymous
028a583bef
Fix issue with full diffusers SD3 loras.
2024-06-19 22:32:04 -04:00
comfyanonymous
0d6a57938e
Support loading diffusers SD3 model format with UNETLoader node.
2024-06-19 22:21:18 -04:00
comfyanonymous
b08a9dd04b
Remove empty line.
2024-06-19 20:20:35 -04:00
Mario Klingemann
eee815ec99
Update sd1_clip.py ( #3684 )
...
Made token instance check more flexible so it also works with integers from numpy arrays or long tensors
2024-06-19 16:42:41 -04:00
doctorpangloss
facf68e7b9
These should not raise NotImplemented
2024-06-19 13:40:42 -07:00
doctorpangloss
92f435aba3
Fix progress updates
2024-06-19 13:40:28 -07:00
comfyanonymous
e11052afcf
Add ipndm sampler.
2024-06-19 16:32:30 -04:00
doctorpangloss
68f410b8da
Autogenerated code is too sensitive to small changes
2024-06-19 09:42:14 -07:00
comfyanonymous
3914d5a2ae
Support full SD3 loras.
2024-06-19 10:13:33 -04:00
doctorpangloss
6015c4132f
Fix more unreferenced variables
2024-06-18 21:24:10 -07:00
doctorpangloss
2aecff06ff
Fixing missing __init__.py and other errors that appear when using an IDE
2024-06-18 21:16:37 -07:00
doctorpangloss
45d553e970
When using quick_test_for_ci, raise import errors
2024-06-18 19:41:22 -07:00
comfyanonymous
a45df69570
Basic tiled decoding for audio VAE.
2024-06-17 22:48:23 -04:00
doctorpangloss
8cdc246450
Merge branch 'master' of github.com:comfyanonymous/ComfyUI
2024-06-17 16:19:48 -07:00
Janek Mann
b7c473d1ab
Fix lora keys for SimpleTuner ( #3759 )
2024-06-17 07:55:06 -04:00
Jacob Segal
9d624564fa
Merge branch 'master' into execution_model_inversion
2024-06-16 19:08:09 -07:00
Jacob Segal
8d17f3c7bf
Fix ui output for duplicated nodes
2024-06-16 18:39:24 -07:00
doctorpangloss
aab3b6c5a4
Remove unused k_diffusion utils code
2024-06-16 11:27:01 -07:00
comfyanonymous
6425252c4f
Use fp16 as the default vae dtype for the audio VAE.
2024-06-16 13:12:54 -04:00
comfyanonymous
8ddc151a4c
Squash depreciation warning on new pytorch.
2024-06-16 13:06:23 -04:00
comfyanonymous
ca9d300a80
Better estimation for memory usage during audio VAE encoding/decoding.
2024-06-16 11:47:32 -04:00
comfyanonymous
746a0410d4
Fix VAEEncode with taesd3.
2024-06-16 03:10:04 -04:00
comfyanonymous
04e8798c37
Improvements to the TAESD3 implementation.
2024-06-16 02:04:24 -04:00
Dr.Lt.Data
df7db0e027
support TAESD3 ( #3738 )
2024-06-16 02:03:53 -04:00
comfyanonymous
bb1969cab7
Initial support for the stable audio open model.
2024-06-15 12:14:56 -04:00
comfyanonymous
1281f933c1
Small optimization.
2024-06-15 02:44:38 -04:00
comfyanonymous
f2e844e054
Optimize some unneeded if conditions in the sampling code.
2024-06-15 02:26:19 -04:00
comfyanonymous
0ec513d877
Add a --force-channels-last to inference models in channel last mode.
2024-06-15 01:08:12 -04:00
Max Tretikov
878f10f143
Fix scheme.py errors
2024-06-14 16:47:34 -06:00
comfyanonymous
0e06b370db
Print key names for easier debugging.
2024-06-14 18:18:53 -04:00
Max Tretikov
cbe69364db
Lowercase T for torch.tensor
2024-06-14 15:58:59 -06:00
Max Tretikov
205b240a89
Add an exception if history API can't be reached
2024-06-14 14:47:54 -06:00
Max Tretikov
bd59bae606
Fix compile_core in comfy.ldm.modules.diffusionmodules.mmdit
2024-06-14 14:43:55 -06:00
Max Tretikov
891154b79e
Ensure ema is defined before operating on it
2024-06-14 14:37:50 -06:00
Max Tretikov
c364e42a11
Remove autoencoder legacy method
2024-06-14 14:34:57 -06:00
Max Tretikov
a248c4c141
Change query parameters to recommended usage of TypedDict
2024-06-14 14:33:11 -06:00
Max Tretikov
935f6c2061
Add pylint ignore for importlib.abc.Traversable
2024-06-14 14:20:07 -06:00
Max Tretikov
36326226f7
Change default value for clip_type to exception
2024-06-14 14:14:00 -06:00
Max Tretikov
54e6b82d2c
Add default value for clip_type in comfy.nodes.base_nodes
2024-06-14 14:12:45 -06:00
Max Tretikov
8b091f02de
Add xformer.ops imports
2024-06-14 14:09:46 -06:00
Max Tretikov
ee44e3b1d7
Fix errors in comfy.extra_samplers.uni_pc
2024-06-14 13:40:10 -06:00
Max Tretikov
9ad840e614
Fix import paths in comfy.cmd.main
2024-06-14 13:20:34 -06:00
Max Tretikov
d06c38d5b4
Fix logging string formatting in main_pre.py
2024-06-14 13:19:15 -06:00
Max Tretikov
ee9daa3a5c
Add NotImplementedError for LatentPreviewer.decode_latent_to_preview
2024-06-14 13:18:24 -06:00
Max Tretikov
9cf4f9830f
Coalesce directml_enabled and directml_device into one variable
2024-06-14 13:16:05 -06:00
Max Tretikov
5cd4ca9906
Fix function name dupes in comfy.cmd.server
2024-06-14 12:42:40 -06:00
Max Tretikov
3d1d67a2d7
Remove remaining classproperty decorators in comfy.api.schemas
2024-06-14 12:04:35 -06:00
Max Tretikov
122fe824ec
Recompose classproperty decorator and fix super calls on dynamic type in comfy.api.schemas.schema
2024-06-14 12:01:28 -06:00
Max Tretikov
6c53388619
Fix xformers import statements in comfy.ldm.modules.attention
2024-06-14 11:21:08 -06:00
Max Tretikov
74023da3a0
Fix several errors in comfy.vendor.appdirs
2024-06-14 11:17:03 -06:00
Max Tretikov
b273eb6146
Fix unsubscriptable errors in analytics.py
2024-06-14 11:06:26 -06:00
Max Tretikov
05f4c2a5bc
Fix no-member errors in comfy.ldm.modules.ema
2024-06-14 09:01:38 -06:00
Max Tretikov
f0812a88fe
Fix invalid-unary-operand-type in k_diffusion.sampling
2024-06-14 00:31:09 -06:00
Max Tretikov
a919272e3b
Fix errors in model_management.py
2024-06-14 00:17:47 -06:00
Max Tretikov
14da37cdf0
Fix possibly-used-before-assignment in samplers.py
2024-06-13 23:49:46 -06:00
Max Tretikov
a02c632aa8
Fix possibly-used-before-assignment in lora.py
2024-06-13 23:46:00 -06:00
Max Tretikov
5e89252ab6
Fix cv2 lint errors
2024-06-13 23:40:44 -06:00
Max Tretikov
f9c3779d4e
Ensure unet is defined
2024-06-13 23:25:36 -06:00
Max Tretikov
61b484d546
Fix lack of NotImplemented exceptions in model_base
2024-06-13 23:24:41 -06:00
Simon Lui
5eb98f0092
Exempt IPEX from non_blocking previews fixing segmentation faults. ( #3708 )
2024-06-13 18:51:14 -04:00
comfyanonymous
ac151ac169
Support SD3 diffusers lora.
2024-06-13 18:26:10 -04:00
Max Tretikov
2f12a8a790
Ensure patch_data is defined
2024-06-13 15:32:09 -06:00
Max Tretikov
d7f7d81b8a
Change tokens to tensor of type long
2024-06-13 15:25:15 -06:00
comfyanonymous
37a08a41b3
Support setting weight offsets in weight patcher.
2024-06-13 17:21:26 -04:00
Max Tretikov
63636c3355
Fix no-member of EPS inherited classes
2024-06-13 15:15:30 -06:00
Max Tretikov
c69d4cae0a
Fix all undefined variables
2024-06-13 14:49:00 -06:00
doctorpangloss
8be5134f4c
Fix remaining relative versus absolute namespace errors
2024-06-13 13:37:23 -07:00
doctorpangloss
f6388683e0
Fix issues with base_nodes
2024-06-13 13:16:25 -07:00
doctorpangloss
73a11c0dbb
Fix execution context interaction
2024-06-12 14:34:24 -07:00
doctorpangloss
cac6690481
Add known SD3 model files, merge branch 'master' of github.com:comfyanonymous/ComfyUI
2024-06-12 10:56:41 -07:00
comfyanonymous
605e64f6d3
Fix lowvram issue.
2024-06-12 10:39:33 -04:00
comfyanonymous
1ddf512fdc
Don't auto convert clip and vae weights to fp16 when saving checkpoint.
2024-06-12 01:07:58 -04:00
comfyanonymous
694e0b48e0
SD3 better memory usage estimation.
2024-06-12 00:49:00 -04:00
comfyanonymous
69c8d6d8a6
Single and dual clip loader nodes support SD3.
...
You can use the CLIPLoader to use the t5xxl only or the DualCLIPLoader to
use CLIP-L and CLIP-G only for sd3.
2024-06-11 23:27:39 -04:00
comfyanonymous
0e49211a11
Load the SD3 T5xxl model in the same dtype stored in the checkpoint.
2024-06-11 17:03:26 -04:00
comfyanonymous
5889b7ca0a
Support multiple text encoder configurations on SD3.
2024-06-11 13:14:43 -04:00
doctorpangloss
b8e4fd4528
Controlnet++ checkpoints
2024-06-11 08:45:56 -07:00
comfyanonymous
9424522ead
Reuse code.
2024-06-11 07:20:26 -04:00
Dango233
73ce178021
Remove redundancy in mmdit.py ( #3685 )
2024-06-11 06:30:25 -04:00
doctorpangloss
6789e9c71e
Add Reference Only ControlNet hack, add ControlNet++ models
2024-06-10 20:36:23 -07:00
doctorpangloss
e7682ced56
Better support for transformers t5
2024-06-10 20:22:17 -07:00
doctorpangloss
a5d828be77
Merge branch 'master' of github.com:comfyanonymous/ComfyUI
2024-06-10 13:21:36 -07:00
comfyanonymous
a82fae2375
Fix bug with cosxl edit model.
2024-06-10 16:00:03 -04:00
comfyanonymous
8c4a9befa7
SD3 Support.
2024-06-10 14:06:23 -04:00
doctorpangloss
d778277a68
Merge with upstream and fix tests
2024-06-10 10:01:08 -07:00
comfyanonymous
a5e6a632f9
Support sampling non 2D latents.
2024-06-10 01:31:09 -04:00
comfyanonymous
742d5720d1
Support zeroing out text embeddings with the attention mask.
2024-06-09 16:51:58 -04:00
comfyanonymous
6cd8ffc465
Reshape the empty latent image to the right amount of channels if needed.
2024-06-08 02:35:08 -04:00
doctorpangloss
7f300bcb7a
Multi-modal LLM support and ongoing improvements to language features.
2024-06-07 16:23:10 -07:00
comfyanonymous
56333d4850
Use the end token for the text encoder attention mask.
2024-06-07 03:05:23 -04:00
doctorpangloss
6575409461
Additional chat templates to ease the use of many models.
2024-06-06 20:51:05 -07:00
doctorpangloss
ebf2ef27c7
Improve LLM / language support
2024-06-06 14:57:52 -07:00
comfyanonymous
104fcea0c8
Add function to get the list of currently loaded models.
2024-06-05 23:25:16 -04:00
comfyanonymous
b1fd26fe9e
pytorch xpu should be flash or mem efficient attention?
2024-06-04 17:44:14 -04:00
doctorpangloss
3f559135c6
Merge branch 'master' of github.com:comfyanonymous/ComfyUI
2024-06-03 11:42:55 -07:00
comfyanonymous
809cc85a8e
Remove useless code.
2024-06-02 19:23:37 -04:00
comfyanonymous
b249862080
Add an annoying print to a function I want to remove.
2024-06-01 12:47:31 -04:00
doctorpangloss
5151d5b017
Include HyperSD checkpoints
2024-05-31 16:21:10 -07:00
doctorpangloss
cb557c960b
Merge branch 'master' of github.com:comfyanonymous/ComfyUI
2024-05-31 07:42:11 -07:00
doctorpangloss
3125366eda
Improve compatibility with comfyui-extra-models, improve API
2024-05-30 16:50:34 -07:00
comfyanonymous
bf3e334d46
Disable non_blocking when --deterministic or directml.
2024-05-30 11:07:38 -04:00
JettHu
b26da2245f
Fix UnetParams annotation typo ( #3589 )
2024-05-27 19:30:35 -04:00
comfyanonymous
0920e0e5fe
Remove some unused imports.
2024-05-27 19:08:27 -04:00
