Install python 3.10
conda create -n transtmj python=3.10
conda activate transtmj
Install pytorch based on your cuda. suggest 2.5+
Install requirements.txt
pip install -r requirements.txt
Download the checkpoint from https://drive.google.com/drive/folders/1VH--WiX7jTraDrfwLaFFE93NEt38qqUm?usp=drive_link
Don't hesitate to get in touch with the corresponding author for demo evaluation data.
Put checkpoints under checkpoints/, like
checkpoints/epoch00250_step083500/...[subfolders]
Put data under data/, like data/eval
python Trans/main.py --config=configs/controlnet_eval.yamlresult will be in output/