Consolidate torch device backend dispatch - #14792

Consolidate torch device backend dispatch#14792

DN6 wants to merge 3 commits into

mainhuggingface/diffusers:mainfrom

device_dtype_routinghuggingface/diffusers:device_dtype_routingCopy head branch name to clipboard