I have multiple computers connected over a VPN, each computer having one or more Nvidia GPUs. All computers run Linux. I'm wondering if it's possible to mount them over network such that they appear to be attached on a single machine.

For example, if I have a machine (say MA) with one GPU and another machine (say MB) with two GPUs. Running nvidia-smi on MA would list the one GPU and running it on MB would list two GPUs.

I want to mount MB's GPUs on MA as virtual GPUs such that running nvidia-smi on MA will now list three GPUs. Is this possible?

I realize this will have high latency. But in my case, that is not a concern.

  • As far as I know : The typical approaches and technical jargon to use the resources of multiple systems as if were a single resource may be single system image clusters , or grid computing - none of which are really for the faint of heart. – Bob Oct 7 '20 at 7:29

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.