Kohaku-Blueleaf
18ca987c92
Add general forward method for all modules.
2024-01-05 16:32:19 +08:00
Kohaku-Blueleaf
a978320334
Let fp8-related settings to invalidate cond_cache
2023-12-16 19:39:43 +08:00
Kohaku-Blueleaf
ea272152e0
Add FP8 settings into PNG info
2023-12-16 15:08:08 +08:00
Kohaku-Blueleaf
0fb34b57b8
Merge branch 'dev' into test-fp8
2023-12-14 16:54:45 +08:00
Kohaku-Blueleaf
3772a82a70
better naming and correct order for device.
2023-12-14 01:47:13 +08:00
Kohaku-Blueleaf
8fc67f3851
remove debug print
2023-12-14 01:44:49 +08:00
Kohaku-Blueleaf
265bc26c21
Use self.scale instead of custom finalize
2023-12-14 01:43:24 +08:00
Kohaku-Blueleaf
735c9e8059
Fix network_oft
2023-12-14 01:38:32 +08:00
Kohaku-Blueleaf
39ebd5684b
Merge remote-tracking branch 'origin/release_candidate' into test-fp8
2023-12-07 20:48:59 +08:00
Kohaku-Blueleaf
294ec5ac37
Merge branch 'dev' into test-fp8
2023-12-06 15:16:49 +08:00
Kohaku-Blueleaf
672dc4efa8
Fix forced reload
2023-12-06 15:16:10 +08:00
Kohaku-Blueleaf
f5f89780cc
Merge branch 'dev' into test-fp8
2023-12-04 16:47:41 +08:00
Kohaku-Blueleaf
9a15ae2a92
Merge branch 'dev' into test-fp8
2023-12-03 10:54:54 +08:00
Kohaku-Blueleaf
50a21cb09f
Ensure the cached weight will not be affected
2023-12-02 22:06:47 +08:00
Kohaku-Blueleaf
110485d5bb
Merge branch 'dev' into test-fp8
2023-12-02 17:00:09 +08:00
Kohaku-Blueleaf
3d341ebc7d
Merge branch 'dev' into test-fp8
2023-11-26 17:32:52 +08:00
Kohaku-Blueleaf
40ac134c55
Fix pre-fp8
2023-11-25 12:35:09 +08:00
Kohaku-Blueleaf
f5d719d1f1
Add forced reload for fp16 cache
2023-11-22 01:45:56 +08:00
Kohaku-Blueleaf
370a77f8e7
Option for using fp16 weight when apply lora
2023-11-21 19:59:34 +08:00
Kohaku-Blueleaf
b2e039d07b
Update webui-macos-env.sh
2023-11-20 14:05:32 +08:00
Kohaku-Blueleaf
043d2edcf6
Better naming
2023-11-19 15:56:31 +08:00
Kohaku-Blueleaf
f383af2729
update xformers/torch versions
2023-11-19 15:56:23 +08:00
Kohaku-Blueleaf
890181e1d4
Update the xformers/torch versions
2023-11-19 15:54:39 +08:00
Kohaku-Blueleaf
598da5cd49
Use options instead of cmd_args
2023-11-19 15:50:06 +08:00
Kohaku-Blueleaf
b60e1088db
Merge branch 'dev' into test-fp8
2023-11-19 15:24:57 +08:00
Kohaku-Blueleaf
cd12256575
Merge branch 'dev' into test-fp8
2023-11-16 21:53:13 +08:00
Kohaku-Blueleaf
c3facab495
Merge branch 'dev' into test-fp8
2023-11-04 12:56:58 +08:00
Kohaku-Blueleaf
d4d3134f6d
ManualCast for 10/16 series gpu
2023-10-28 15:24:26 +08:00
Kohaku-Blueleaf
0beb131c7f
change torch version
2023-10-25 20:07:37 +08:00
Kohaku-Blueleaf
dda067f64d
ignore mps for fp8
2023-10-25 19:53:22 +08:00
Kohaku-Blueleaf
bf5067f50c
Fix alphas cumprod
2023-10-25 12:54:28 +08:00
Kohaku-Blueleaf
4830b25136
Fix alphas_cumprod dtype
2023-10-25 11:53:37 +08:00
Kohaku-Blueleaf
1df6c8bfec
fp8 for TE
2023-10-25 11:36:43 +08:00
Kohaku-Blueleaf
9c1eba2af3
Fix lint
2023-10-24 02:11:27 +08:00
Kohaku-Blueleaf
eaa9f5162f
Add CPU fp8 support
...
Since norm layer need fp32, I only convert the linear operation layer(conv2d/linear)
And TE have some pytorch function not support bf16 amp in CPU. I add a condition to indicate if the autocast is for unet.
2023-10-24 01:49:05 +08:00
Kohaku-Blueleaf
5f9ddfa46f
Add sdxl only arg
2023-10-19 23:57:22 +08:00
Kohaku-Blueleaf
7c128bbdac
Add fp8 for sd unet
2023-10-19 13:56:17 +08:00
Kohaku-Blueleaf
891ccb767c
Fix lint
2023-10-10 15:07:25 +08:00
Kohaku-Blueleaf
81e94de318
Add warning when meet emb name conflicting
...
Choose standalone embedding (in /embeddings folder) first
2023-10-10 14:44:20 +08:00
Kohaku-Blueleaf
2282eb8dd5
Remove dev debug print
2023-10-10 12:11:00 +08:00
Kohaku-Blueleaf
3d8b1af6be
Support string_to_param nested dict
...
format:
bundle_emb.EMBNAME.string_to_param.KEYNAME
2023-10-10 12:09:33 +08:00
Kohaku-Blueleaf
2aa485b5af
add lora bundle system
2023-10-09 22:52:09 +08:00
Kohaku-Blueleaf
d9ddc5d4cd
Remove wrong scale
2023-08-16 11:21:12 +08:00
Kohaku-Blueleaf
aa57a89a21
full module with ex_bias
2023-08-15 23:41:46 +08:00
Kohaku-Blueleaf
f70ded8936
remove "if bias exist" check
2023-08-14 13:53:40 +08:00
Kohaku-Blueleaf
aa26f8eb40
Put frequently used sampler back
2023-08-14 13:50:53 +08:00
Kohaku-Blueleaf
e7c03ccdce
Merge branch 'dev' into extra-norm-module
2023-08-14 13:34:51 +08:00
Kohaku-Blueleaf
d9cc27cb29
Fix MHA updown err and support ex-bias for no-bias layer
2023-08-14 13:32:51 +08:00
Kohaku-Blueleaf
0ea61a74be
add res(dpmdd 2m sde heun) and reorder the sampler list
2023-08-14 11:46:36 +08:00
Kohaku-Blueleaf
5881dcb887
remove debug print
2023-08-13 02:36:02 +08:00
Kohaku-Blueleaf
a2b8305096
return None if no ex_bias
2023-08-13 02:35:04 +08:00
Kohaku-Blueleaf
bd4da4474b
Add extra norm module into built-in lora ext
...
refer to LyCORIS 1.9.0.dev6
add new option and module for training norm layer
(Which is reported to be good for style)
2023-08-13 02:27:39 +08:00
Kohaku-Blueleaf
b85ec2b9b6
Fix some merge mistakes
2023-08-05 13:14:00 +08:00
Kohaku-Blueleaf
d56a9cfe6a
Merge branch 'dev' into efficient-vae-methods
2023-08-05 13:12:37 +08:00
Kohaku-Blueleaf
a6b245e46f
dix
2023-08-05 12:49:35 +08:00
Kohaku-Blueleaf
d8371d0b3c
update info
2023-08-05 12:37:46 +08:00
Kohaku-Blueleaf
aa744cadc8
add infotext
2023-08-05 12:35:40 +08:00
Kohaku-Blueleaf
9ac2989edd
Merge branch 'dev' into efficient-vae-methods
2023-08-05 10:43:17 +08:00
Kohaku-Blueleaf
21000f13a1
replace get_first_stage_encoding
2023-08-04 18:23:14 +08:00
Kohaku-Blueleaf
073342c887
remove noneed scale
2023-08-04 17:55:52 +08:00
Kohaku-Blueleaf
6346d8eeaa
Revert "change all encode"
...
This reverts commit 094c416a80 .
2023-08-04 17:53:30 +08:00
Kohaku-Blueleaf
094c416a80
change all encode
2023-08-04 17:53:16 +08:00
Kohaku-Blueleaf
1f6bfdea80
move the modified decode into smapler_common
2023-08-04 14:38:52 +08:00
Kohaku-Blueleaf
70e66e81e5
Merge branch 'dev' into efficient-vae-methods
2023-08-04 14:38:16 +08:00
Kohaku-Blueleaf
c134a48016
Fix code style
2023-08-04 13:40:20 +08:00
Kohaku-Blueleaf
75336dfc84
add TAESD for i2i and t2i
2023-08-04 13:38:52 +08:00
Kohaku-Blueleaf and GitHub
3d31caf4a5
use "is not None" for Tensor
2023-07-18 10:45:42 +08:00
Kohaku-Blueleaf and GitHub
17e14ed2d9
Fix wrong key name in lokr module
2023-07-18 10:23:41 +08:00
Kohaku-Blueleaf
a69b71a37f
use Schedule instead of Sched
2023-05-24 20:40:37 +08:00
Kohaku-Blueleaf
4b88e24ebe
improvements
...
See:
https://github.com/AUTOMATIC1111/stable-diffusion-webui/pull/10649#issuecomment-1561047723
2023-05-24 20:35:58 +08:00
Kohaku-Blueleaf
1601fccebc
Use automatic instead of None/default
2023-05-24 00:18:09 +08:00
Kohaku-Blueleaf
27962ded4a
Fix ruff error
2023-05-23 23:50:19 +08:00
Kohaku-Blueleaf
72377b0251
Use type to determine if it is enable
2023-05-23 23:48:23 +08:00
Kohaku-Blueleaf
78aed1fa4a
Fix xyz
2023-05-23 11:47:32 +08:00
Kohaku-Blueleaf
70650f87a4
Use better way to impl
2023-05-23 11:34:51 +08:00
Kohaku-Blueleaf
1846ad36a3
Use settings instead of main interface
2023-05-23 10:58:57 +08:00
Kohaku-Blueleaf
ec1608308c
Merge branch 'custom-k-sched' of https://github.com/KohakuBlueleaf/stable-diffusion-webui into custom-k-sched
2023-05-23 09:55:31 +08:00
Kohaku-Blueleaf
89c44bbc15
Add hint for custom k_diffusion scheduler
2023-05-23 09:52:15 +08:00
38aaad654b
Better hint for user
...
Co-authored-by: catboxanon <122327233+catboxanon@users.noreply.github.com >
2023-05-23 09:38:30 +08:00
Kohaku-Blueleaf
403b304162
use sigma_max/min in model if sigma_max/min is 0
2023-05-23 00:29:38 +08:00
Kohaku-Blueleaf
65a87ccc9b
Add error information for recursion error
2023-05-23 00:09:49 +08:00
Kohaku-Blueleaf
302d95c726
Minor naming fixes
2023-05-22 23:43:06 +08:00
Kohaku-Blueleaf
4365c35bf9
Avoid loop import
2023-05-22 23:41:14 +08:00
Kohaku-Blueleaf
5dfb1f597b
remove not related code
2023-05-22 23:36:16 +08:00
Kohaku-Blueleaf
7dc9d9e27e
only add metadata when k_sched is actually been used
2023-05-22 23:34:16 +08:00
Kohaku-Blueleaf
7882f76da4
Replace karras by k_diffusion, fix gen info
2023-05-22 23:26:28 +08:00
Kohaku-Blueleaf
f821051443
Change karras to kdiffusion
2023-05-22 23:09:03 +08:00
Kohaku-Blueleaf
e6269cba7f
Add dropdown for scheduler type
2023-05-22 23:02:05 +08:00
Kohaku-Blueleaf
90ec557d60
remove debug print
2023-05-22 22:06:13 +08:00
Kohaku-Blueleaf
a104879869
Add custom karras scheduler
2023-05-22 21:52:46 +08:00