276 Commits

Author	SHA1	Message	Date
comfyanonymous	5384849e5e	Fix k_diffusion math being off by a tiny bit during txt2img.	2023-06-19 15:28:54 -04:00
comfyanonymous	873b08bd0f	Add a way to set patches that modify the attn2 output. ... Change the transformer patches function format to be more future proof.	2023-06-18 22:58:22 -04:00
comfyanonymous	26bce56c3b	pop clip vision keys after loading them.	2023-06-18 21:21:17 -04:00
comfyanonymous	c1e1b00941	Not needed anymore.	2023-06-18 13:06:59 -04:00
comfyanonymous	78eabd0fd4	This is not needed anymore and causes issues with alphas_cumprod.	2023-06-18 03:18:25 -04:00
comfyanonymous	351d778487	Fix DDIM v-prediction.	2023-06-17 20:48:21 -04:00
comfyanonymous	a93a785f9e	Fix an issue when alphas_comprod are half floats.	2023-06-16 17:16:51 -04:00
comfyanonymous	d35c0ce6ec	All the unet weights should now be initialized with the right dtype.	2023-06-15 18:42:30 -04:00
comfyanonymous	282638b813	Add a --gpu-only argument to keep and run everything on the GPU. ... Make the CLIP model work on the GPU.	2023-06-15 15:38:52 -04:00
comfyanonymous	8e6cbe6270	Initialize more unet weights as the right dtype.	2023-06-15 15:00:10 -04:00
comfyanonymous	206af9a315	Initialize transformer unet block weights in right dtype at the start.	2023-06-15 14:29:26 -04:00
comfyanonymous	16c535a309	Properly disable weight initialization in clip models.	2023-06-14 20:13:08 -04:00
comfyanonymous	6bbd86a061	Disable default weight values in unet conv2d for faster loading.	2023-06-14 19:46:08 -04:00
comfyanonymous	46a1fd77f4	This isn't needed for inference.	2023-06-14 13:05:08 -04:00
comfyanonymous	54c3f45d58	Don't initialize CLIPVision weights to default values.	2023-06-14 12:57:02 -04:00
comfyanonymous	0a80429175	Set model to fp16 before loading the state dict to lower ram bump.	2023-06-14 12:48:02 -04:00
comfyanonymous	3e75be0a92	Don't initialize clip weights to default values.	2023-06-14 12:47:36 -04:00
comfyanonymous	14508d7a5b	Speed up model loading a bit. ... Default pytorch Linear initializes the weights which is useless and slow.	2023-06-14 12:09:41 -04:00
comfyanonymous	fd8fa51a6d	sampler_cfg_function now uses a dict for the argument. ... This means arguments can be added without issues.	2023-06-13 16:10:36 -04:00
comfyanonymous	e4e6a23fec	Turn on safe load for a few models.	2023-06-13 10:12:03 -04:00
comfyanonymous	27c98d1d24	Remove pytorch_lightning dependency.	2023-06-13 10:11:33 -04:00
comfyanonymous	807faa8edd	Remove useless code.	2023-06-13 02:40:58 -04:00
comfyanonymous	22cd647be0	Remove more useless files.	2023-06-13 02:22:19 -04:00
comfyanonymous	ce4e360edf	Cleanup: Remove a bunch of useless files.	2023-06-13 02:19:08 -04:00
comfyanonymous	a2bc14b56f	Split the batch in VAEEncode if there's not enough memory.	2023-06-12 00:21:50 -04:00
comfyanonymous	8ef4de36f4	Auto switch to tiled VAE encode if regular one runs out of memory.	2023-06-11 23:25:39 -04:00
comfyanonymous	b46c4e51ed	Refactor unCLIP noise augment out of samplers.py	2023-06-11 04:01:18 -04:00
comfyanonymous	1e0ad9564e	Simpler base model code.	2023-06-09 12:31:16 -04:00
comfyanonymous	cbf4192f8d	Fix bug when embedding gets ignored because of mismatched size.	2023-06-08 23:48:14 -04:00
comfyanonymous	6c6ef17bd4	Small refactor.	2023-06-06 13:23:01 -04:00
comfyanonymous	d421e5d610	Refactor previews into one command line argument. ... Clean up a few things.	2023-06-06 02:13:05 -04:00
space-nuko	2a03db6500	preview method autodetection	2023-06-05 18:59:10 -05:00
space-nuko	8b515aae12	Add latent2rgb preview	2023-06-05 18:39:56 -05:00
space-nuko	a3b400faa4	Make previews into cli option	2023-06-05 13:19:02 -05:00
space-nuko	a816ca9091	Preview sampled images with TAESD	2023-06-05 09:20:17 -05:00
comfyanonymous	442430dcef	Some comments to say what the vram state options mean.	2023-06-04 17:51:04 -04:00
comfyanonymous	e136e86a13	Cleanups and fixes for model_management.py ... Hopefully fix regression on MPS and CPU.	2023-06-03 11:05:37 -04:00
comfyanonymous	d7821166b2	Implement global average pooling for controlnet.	2023-06-03 01:49:03 -04:00
comfyanonymous	6b80950a41	Refactor and improve model_management code related to free memory.	2023-06-02 15:21:33 -04:00
space-nuko	7cb90ba509	More accurate total	2023-06-02 00:14:41 -05:00
space-nuko	22b707f1cf	System stats endpoint	2023-06-01 23:26:23 -05:00
comfyanonymous	f929d8df00	Tweak lowvram model memory so it's closer to what it was before.	2023-06-01 04:04:35 -04:00
comfyanonymous	f6f0a25226	Empty cache on mps.	2023-06-01 03:52:51 -04:00
comfyanonymous	fa734798f1	This is useless for inference.	2023-05-31 13:03:24 -04:00
comfyanonymous	4af4fe017b	Auto load model in lowvram if not enough memory.	2023-05-30 12:36:41 -04:00
comfyanonymous	ebf6e2c421	Add route to get safetensors metadata: ... /view_metadata/loras?filename=lora.safetensors	2023-05-29 02:48:50 -04:00
comfyanonymous	12e275ab18	Support VAEs in diffusers format.	2023-05-28 02:02:09 -04:00
comfyanonymous	c7572ef29d	Refactor diffusers model convert code to be able to reuse it.	2023-05-28 01:55:40 -04:00
comfyanonymous	3d8f70ac86	Remove einops.	2023-05-25 18:42:56 -04:00
comfyanonymous	ee30188247	Do operations in same order as the one it replaces.	2023-05-25 18:31:27 -04:00