AngelBottomless and AUTOMATIC1111
7207e3bf49
remove duplicate keys and lowercase
2022-10-26 09:17:01 +03:00
AngelBottomless and AUTOMATIC1111
de096d0ce7
Weight initialization and More activation func
...
add weight init
add weight init option in create_hypernetwork
fstringify hypernet info
save weight initialization info for further debugging
fill bias with zero for He/Xavier
initialize LayerNorm with Normal
fix loading weight_init
2022-10-26 09:17:01 +03:00
AngelBottomless and AUTOMATIC1111
e9a410b535
check length for variance
2022-10-24 09:07:39 +03:00
AngelBottomless and AUTOMATIC1111
0d2e1dac40
convert deque -> list
...
I don't feel this being efficient
2022-10-24 09:07:39 +03:00
AngelBottomless and AUTOMATIC1111
348f89c8d4
statistics for pbar
2022-10-24 09:07:39 +03:00
AngelBottomless and AUTOMATIC1111
40b56c9289
cleanup some code
2022-10-24 09:07:39 +03:00
AngelBottomless and AUTOMATIC1111
b297cc3324
Hypernetworks - fix KeyError in statistics caching
...
Statistics logging has changed to {filename : list[losses]}, so it has to use loss_info[key].pop()
2022-10-24 09:07:39 +03:00
AngelBottomless and AUTOMATIC1111
48dbf99e84
Allow tracking real-time loss
...
Someone had 6000 images in their dataset, and it was shown as 0, which was confusing.
This will allow tracking real time dataset-average loss for registered objects.
2022-10-22 22:24:19 +03:00
AngelBottomless and AUTOMATIC1111
24694e5983
Update hypernetwork.py
2022-10-22 20:25:32 +03:00
aria1th
f89829ec3a
Revert "fix bugs and optimizations"
...
This reverts commit 108be15500
2022-10-21 01:37:11 +09:00
AngelBottomless and GitHub
108be15500
fix bugs and optimizations
2022-10-21 01:00:41 +09:00
AngelBottomless and GitHub
a71e021236
only linear
2022-10-20 23:48:52 +09:00
AngelBottomless and GitHub
d8acd34f66
generalized some functions and option for ignoring first layer
2022-10-20 23:43:03 +09:00
AngelBottomless and AUTOMATIC1111
703e6d9e4e
check NaN for hypernetwork tuning
2022-10-15 17:15:26 +03:00
