[WIP] Consistency models distillation examples - #3992

Closed

ayushtues wants to merge 80 commits into

huggingface:mainfrom

ayushtues:consistency-models-examples

Commits on May 15, 2023

initial commit
dg845
committed
799ab23

Commits on May 17, 2023

Improve consistency models sampling implementation.
dg845
committed
63b7f01

Commits on May 18, 2023

Add CMStochasticIterativeScheduler, which implements the multi-step sampler (stochastic_iterative_sampler) in the original code, and make further improvements to sampling.
dg845
committed
f2e53da

Commits on May 22, 2023

Merge branch 'main2' into consistency_unet
ayushmangal
committed
37e1895
Add Unet blocks for consistency models
ayushmangal
committed
7c1e81f
Add conversion script for Unet
ayushmangal
committed
3a151bd
Fix bug in new unet blocks
ayushmangal
committed
b6c5e15

Commits on May 23, 2023

Fix attention weight loading
ayushmangal
committed
4e93f09

Commits on May 25, 2023

Merge pull request #1 from ayushtues/consistency_unet
dg845
authored
d137d11

Commits on May 26, 2023

Make design improvements to ConsistencyModelPipeline and CMStochasticIterativeScheduler and add initial version of tests.
dg845
committed
9ae7669
make style
dg845
committed
54b287e
Add initial training script
ayushtues
committed
067a9ef

Commits on May 30, 2023

Make small random test UNet class conditional and set resnet_time_scale_shift to 'scale_shift' to better match consistency model checkpoints.
dg845
committed
5a27c2f
Add support for converting a test UNet and non-class-conditional UNets to the consistency models conversion script.
dg845
committed
f2783a8
make style
dg845
committed
ed53b85
Change num_class_embeds to 1000 to better match the original consistency models implementation.
dg845
committed
a505c6c
Add support for distillation in pipeline_consistency_models.py.
dg845
committed
a927a4a
Improve consistency model tests:
dg845
committed
b2e6424
make style
dg845
committed
c37e302
Improve ConsistencyModelPipeline:
dg845
committed
a0a164c
make style
dg845
committed
0d1de08
Improve ConsistencyModelPipeline:
dg845
committed
5f4f406
make style
dg845
committed
213b25d
Fix bug when randomly generating class labels for class-conditional generation.
dg845
committed
fbe34c3

Commits on Jun 1, 2023

Commits on Jun 2, 2023

Add expected slices for multistep sampling tests and make them pass.
dg845
committed
94c99ca
Work on consistency model fast tests:
dg845
committed
0773b27
make style
dg845
committed
6867a3a

Commits on Jun 4, 2023

Refactor conversion script to make it easier to add more model architectures to convert in the future.
dg845
committed
f0c85d3
Work on ConsistencyModelPipeline tests:
dg845
committed
6adb589
make style
dg845
committed
c213bf7
Remove the add_noise and add_noise_to_input methods from CMStochasticIterativeScheduler for now.
dg845
committed
3be6e08
Run python utils/check_copies.py --fix_and_overwrite
dg845
committed
660909f
Make fast tests from PipelineTesterMixin pass.
dg845
committed
ad5abdc
make style
dg845
committed
a1c11d3

Commits on Jun 5, 2023

Merge branch 'consistency-models-pipeline' into consistency-models-examples
ayushtues
committed
a15c168

Commits on Jun 7, 2023

Refactor consistency models pipeline and scheduler:
dg845
committed
2dc2fa3
make style
dg845
committed
7d3dbe3
Add docstrings and further refactor pipeline and scheduler.
dg845
committed
55f80ed
make style
dg845
committed
3234543

Commits on Jun 9, 2023

Add initial version of the consistency models documentation.
dg845
committed
dc4349c
Minor
ayushtues
committed
787e65a
Merge branch 'consistency-models-pipeline' into consistency-models-examples
ayushtues
committed
50136d0
Add training code
ayushtues
committed
6530b17
Fix bugs in training
ayushtues
committed
8f858cb
Remove some args, add target model
ayushtues
committed
e56b870

Commits on Jun 10, 2023

Commits on Jun 12, 2023

attention weight loading fix
ayushtues
committed
1488180

Commits on Jun 13, 2023

Convert current slow tests to use fp16 and flash attention.
dg845
committed
fd0a253
make style
dg845
committed
7c03ff6
Add slow tests for normal attention on cuda device.
dg845
committed
80d7745
make style
dg845
committed
0662f63
Fix attention weights loading
ayushtues
committed
cce04c0
Merge pull request #3 from ayushtues/fix-attention-loading
dg845
authored
c1ba8b9
Update consistency model fast tests for new test checkpoints with attention fix.
dg845
committed
62a49a2
make style
dg845
committed
58f12ca

Commits on Jun 15, 2023

Renaming ema model to target
ayushtues
committed
98e1381
Add some comments
ayushtues
committed
baefc87

Commits on Jun 16, 2023

apply suggestions
dg845
committed
071f850

Commits on Jun 17, 2023

Remove xformers, refactor ckpt resuming
ayushtues
committed
cd460ca

Commits on Jun 18, 2023

Commits on Jun 19, 2023

Add input scaling, disable gradients
ayushtues
committed
9a81642

Commits on Jun 29, 2023

apply suggestions from review
dg845
committed
2606d82
make style
dg845
committed
075351a
Merge branch 'consistency-models-pipeline' into consistency-models-examples
ayushtues
committed
0240407

Commits on Jul 7, 2023

Merge branch 'main_hf' into consistency-models-examples
ayushtues
committed
88356e6

Commits on Jul 10, 2023

Update training script to main, fix timesteps
ayushtues
committed
ea7d75f
Fix bug in timestep ordering
ayushtues
committed
a32b869

Commits on Jul 11, 2023

Add review suggestions
ayushtues
committed
8742e4e

Commits on Jul 12, 2023

Integrate accelerator better, change model upload
ayushtues
committed
943c88b

Commits on Jul 13, 2023

Fix checkpointing and add test
ayushtues
committed
6b58d81

Commits on Jul 19, 2023

Remove hardcoded configs, add DiffusionPipeline
ayushtues
committed
180b3e8