[BUG]: Unable to figure out how to pass env variables for each node

[Gautam-Rajeev]

Is there an existing issue for this bug?

• I have searched the existing issues

The bug has not been fixed in the latest main branch

• I have checked the latest main branch

Do you feel comfortable sharing a concise (minimal) script that reproduces the error? :)

Yes, I will share a minimal reproducible script.

🐛 Describe the bug

I am trying to carry out a multi node setup. I wanted ot understand how I can set a different NCCL_SOCKET_IFNAME for each node. I tried setting them in each node environment but that doesnt seem to be working, even tried setting them as overall OS environment vars but that didnt work either. Is there anyway to pass them for each node?

Environment

No response