vllm.distributed.device_communicators.nvlink_fabric
¶
Cross-node NVLink fabric detection via NVML.
Functions:
-
get_symmetric_memory_topology–Classify whether a CPU process group can safely rendezvous.
-
has_cross_node_nvlink–Return whether all ranks report the same valid NVLink fabric.
get_symmetric_memory_topology(group)
cached
¶
Classify whether a CPU process group can safely rendezvous.
Same-node symmetric-memory rendezvous can reject unsupported GPU connectivity synchronously. Cross-node rendezvous is safe to attempt only when every rank reports the same healthy NVLink fabric.
Source code in vllm/distributed/device_communicators/nvlink_fabric.py
has_cross_node_nvlink(group)
¶
Return whether all ranks report the same valid NVLink fabric.
Detection fails closed when fabric information is unavailable or incomplete. The caller is responsible for establishing that the group crosses nodes.