Issues

• Log the timestamp with the loss in wandb

  yieldprotocol/mandrill#8 · Filter by author harshraj172 opened on Oct 19, 2023

• Push the model to hub after training

  yieldprotocol/mandrill#7 · Filter by author harshraj172 opened on Oct 19, 2023

• Add flashattention_v2

  yieldprotocol/mandrill#6 · Filter by author harshraj172 opened on Oct 19, 2023

• Add support for deepspeed

  yieldprotocol/mandrill#5 · Filter by author harshraj172 opened on Oct 19, 2023

• Check Llama generation configs, pad token

  yieldprotocol/mandrill#1 · Filter by author hjc-puro opened on Oct 7, 2023