pythonMultiGPU finetuning llama

python - Multi-GPU fine-tuning llama issue. RuntimeError: Expected all tensors to be on the same device, but found at least two
I am working on a llama fine-tuning task. When I train on a single GPU, the program runs fine.import o
admin9小时前
10