Questions tagged [gpu]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
27 views

CloudStack and GPU support

Is there any document for GPU and VGPU support in cloudstack version 4.14 and later? For example how I find out CloudStack support Nvidia Quadro RTX series or not?
user avatar
0 votes
0 answers
133 views

GKE Node auto-provisioning not scaling up with limits defined

I want to use GKE node auto-provisioning to create a node-pool with GPU on demand (that is when I start a Job that needs GPU resources). Going with the GCP tutorial I've set up a cluster with enabled ...
user avatar
2 votes
1 answer
355 views

GPU Acceleration on a Windows Server without virtualization over RDP

I'm trying to find out if it's possible to run a Windows Server with one GPU which is shared between all RDP clients so that people could create a session on the server start some program with a UI ...
user avatar
0 votes
0 answers
8 views

accounting GPU compute time on HPC clusters

How do you account for GPU compute time on your HPC clusters ? I have a growing, and quite heterogeneous (SXM4 A100s, PCIe A100s, NVlinked V100s, PCIe V100s, T4s, AMD cards arriving soon etc...), GPU ...
user avatar
0 votes
0 answers
40 views

IBM LSF Suite for Enterprise 10.2.0.12 LIM Segmentation Fault

I upgraded from IBM LSF Suite for Enterprise 10.2.0.10 to version 10.2.0.12,and now, on only one of our GPU cluster servers (1 out of 8), I can't get the LIM service to stay running. It keeps crashing ...
user avatar
  • 1
0 votes
0 answers
15 views

Computer with 12+1 Thunderbolt 3 connected GPUs crashed when using eGPUs

We've set up an AMD Ryzen computer with Ubuntu 21.10, and plugged 6 Akitio Duo machines each with 2x NVIDIA 4GB cards via 2x Thunderbolt hubs, as well as a 13th card directly on the PCIe slot which is ...
user avatar
  • 101
2 votes
2 answers
492 views

GCP does not have enough resources available to fulfill the request for about a month

I've been trying to start my existing GCP VM that has an NVIDIA T4 GPU attached to it, for almost a month at this time. It has been working fine before but now I am constantly getting the error ...
user avatar
  • 121
0 votes
1 answer
48 views

GCP: Cannot create any VM with GPU -> No capacity

I subscribed to GCP and received the $300 credits. Then I upgraded my account to "paid account". Next, I increased the limit for multiple VM types with GPU, in multiple regions, and received ...
user avatar
0 votes
0 answers
15 views

Check utilization of AWS Inferentia chips

How can we check the utilization of AWS Inferentia chips? I.e I am using an AWS Inf1 instance to train my ML project and I want to know how much capacity I am using. Normally I use nvidia-smi with the ...
user avatar
  • 101
0 votes
1 answer
70 views

How to identify slot for faulty GPU card in server using UBUNTU OS commands?

I have a question. Is it possible to identify in which slot there is a broken GPU card using the UBUNTU operating system? We have a SuperMicro GPU server in which there are about 8 GPU cards for AI ...
user avatar
  • 1
1 vote
0 answers
658 views

Slurm srun cannot allocate ressources for GPUs - Invalid generic resource specification

I am able to launch a job on a GPU server the traditional way (using CPU and MEM as consumables): ~ srun -c 1 --mem 1M -w serverGpu1 hostname serverGpu1 but trying to use the GPUs will give an error: ...
user avatar
32 votes
7 answers
15k views

Does a server need a GPU?

Do I need a GPU on a text and console only server? No GPU as in no iGPU and dGPU. Im going to be using SSH, so I dont need a display out. Im using Linux, but the OS shouldn't affect the results
user avatar
  • 455
1 vote
1 answer
90 views

Why can't the GPUs communicate in a multi-GPU server?

This is a Dell PowerEdge r750xa server with 4 Nvidia A40 GPUs, intended for AI applications. While the GPUs work well individually, multi-GPU training jobs or indeed any multi-GPU computational ...
user avatar
  • 331
0 votes
0 answers
71 views

GCP - GPU staging time reduction

I have an application that requires the smallest boot-time/TTL possible with GPUs attached to a VM in GCP CE. To keep cost down, my infrastructure is dependent on starting and stopping instances as ...
user avatar
  • 1
2 votes
1 answer
274 views

Kubernetes: How can I get which pod schedule GPU?

I have three Nvidia GPUs in my cluster, and so many pods are running in my cluster. How can I find which one of these pods schedule GPU and how many GPUs they schedule? I use this link to enable the ...
user avatar
  • 33
-4 votes
1 answer
111 views

How to extend 1U / 2U servers with multiple 2 slot full height GPUs for sharing? [closed]

What are the possible options to extend a 1U / 2U server with a GPU? e.g. I am searching for a solution how to add a GTX 1650 into the server. The GPU is usually 2 slots width and therefore often not ...
user avatar
  • 277
0 votes
0 answers
103 views

Proxmox gpu passthrough seen on the wrong machine

I have a very unique issue that might have a simple answer but I can't really find it anywhere. I currently have two nodes on my rack running proxmox. One is an old gaming PC that doesn't have IOMMU ...
user avatar
3 votes
0 answers
165 views

What is the best metric for auto-scaling GPU instances for machine learning inference in the cloud?

We have an API in AWS with a GPU instance that does inference. We have an auto-scaler setup with the minimum and maximum number of instances, but aren’t sure which metric (GPU/CPU usage, RAM usage, ...
user avatar
0 votes
1 answer
747 views

Xorg not starting in GKE with GPU : (EE) no screens found(EE)

I am trying to run Xorg server that use GPU inside Google Kubernetes Engine I followed this guide (https://cloud.google.com/kubernetes-engine/docs/how-to/gpus#ubuntu) to setup a GKE cluster with ...
user avatar
0 votes
0 answers
115 views

Is there any software VGA dummy solution?

To cut long story short, I actually run Davinci Resolve on a Intel HD 4600 based server on Hetzner auction. And they all don't come with any remote KVM, or use any VGA dummy plug, for every server ...
user avatar
-1 votes
1 answer
319 views

Tesla K80 not showing up in HP DL580 G7

I have a HP Proliant DL580 G7 server with P65 BIOS update from 2015 (which I think is the latest BIOS). I installed the PCIe expansion board in it and installed 4 x Tesla K80 GPUs. Connected them to ...
user avatar
0 votes
0 answers
22 views

Server not starting, after adding graphisc card

First of all, I want to clarify, that I pretty new to server topics. My server runs on normal ubuntu. I bought a Nvidia Quadro k4000. I built it into the server and connected the PCIe Power cable. - ...
user avatar
1 vote
0 answers
139 views

Service Creation failed AWS ECS Service with elastic inference accelerator (EIA)

I am trying to create a service in my ECS cluster to run a task that uses elastic inference accelerator (EIA). However, when I try to create the service, I get the following error: I have read the ...
user avatar
0 votes
1 answer
46 views

[GCP]Why can't I see the GPU selection button on my VM instance?

I want to use GPU in Windows VM. However, the GPU selection button is not active when creating the instance. Currently, I applied for GPU(k-80) as a quota and got 1 allocation. Of course, I received ...
user avatar
1 vote
1 answer
740 views

Considerations using consumer class (high-end) GPU in server?

Motivation: First of all, even if I have some knowledge of computer science, software development and server Linux administration, I never looked into a server hardware and I am a total "newbie&...
user avatar
0 votes
1 answer
31 views

Configure a new kubernetes node automatically

I configured a Kubernetes cluster with GPU in AWS, and one of the steps is configuring the nodes to enable Nvidia runtime by default. So when I configured cluster auto scaler, the cluster scales up ...
user avatar
  • 11
0 votes
0 answers
172 views

Deep Learning - maximum GPUs a CPU can handle

The design for the deep learning server would be very similar to that of a mining rig, specifically using risers to stack as many GPU's onto the motherboard. The design is as follows: CPU: AMD EPYC ...
user avatar
1 vote
0 answers
52 views

Mounting virtual GPUs on different machines

I have multiple computers connected over a VPN, each computer having one or more Nvidia GPUs. All computers run Linux. I'm wondering if it's possible to mount them over network such that they appear ...
user avatar
0 votes
1 answer
276 views

How to increase Service name: GPU (ALL REGION) quota limit in Compute Engine?

I requested 2 times for GPU all region service quota from 0 to 1 but not got accepted so ,I want a way to increase this limit.
user avatar
  • 11
1 vote
0 answers
488 views

Make Headless Server Use Hardware Accelaration

I have a headless CentOS 8 Server with an AMD GPU. I want to use hardware acceleration but when I run OpenGL programs with xvfb-run (e.g glxinfo), the system reports I am using software rendering. How ...
user avatar
0 votes
1 answer
51 views

Create a kubernetes master on google cloud and add as nodes on-premise instances with gpu

Since we are working on ML engineering tasks we do have requirements of gpu instances. We do have couple of them on-premise and we need to organize our pipeline creating a kubernetes cluster. Since ...
user avatar
1 vote
1 answer
894 views

Misbehaving NVLINK with 2080 ti cards?

I am running into problems with nvlink'd RTX videocards, and I wonder if someone more experienced with this tech could kindly look at the output below and tell me if there is a problem? Using a pair ...
user avatar
  • 113
0 votes
0 answers
324 views

RTX 2070 + Fedora 31: nvidia_modeset error freezes computer just before login

I'm experimenting an error -which I'll describe next- with the following Linux system: Fedora 31 - kernel: 5.5.17-200.fc31.x86_64 GPU is ASUS RTX 2070 SUPER with drivers 440.82, also CUDA 10.1 and ...
user avatar
2 votes
1 answer
8k views

Use passthrough GPU in KVM/QEMMU and display in host OS in a window

I'm new to KVM/QEMMU. I have used virtual box to run Windows 10 in a virtual machine on my Arch host system (a laptop with both integrated and discrete GPUs). Being dissatisfied with the video ...
user avatar
  • 121
2 votes
3 answers
2k views

Why are GPUs accessible from docker containers running on Linux hosts, but not on Windows or MacOS hosts?

Recent versions of docker (or any version of nvidia-docker) allow direct(?) access to the host GPU from within docker containers, with full access to CUDA APIs. This is very convenient when deploying ...
user avatar
  • 219
0 votes
0 answers
78 views

GPU Passthrough on Xen Hypervisor

I have a Dell PowerEdge r710 running the Xen hypervisor and I want to get a decent graphics card for a virtual machine. I plan on doing GPU passthrough to dedicate the entire GPU to the virtual ...
user avatar
0 votes
1 answer
1k views

Compatible AMD GPU for the Dell PowerEdge r710 [closed]

I'm a complete noob when it comes to server virtualization and GPUs, so please bear with me. Are there any decent AMD GPUs that are easily compatible with the Dell PowerEdge r710? I'm looking for ...
user avatar
0 votes
1 answer
54 views

Resolved - Only 1 nodes out of 2 have registered on my node-pool if I have a GPU activated on my cluster

I have a managed k8S cluster with 1GPU (Tesla K80) activated in west1-b and west1-d (Each zone has this GPU model enabled, and my quota is ok). Each time that I create a node pool with 2 nodes only ...
user avatar
1 vote
1 answer
46 views

always available gpu servers

I need several GPU servers for rendering. Region doesn`t matter. Preemptible - I think it is ok for me. It is important that at any time I should be able to run a couple of instances with the GPU. ...
user avatar
0 votes
1 answer
55 views

I can't use a graphics card on my vm [duplicate]

I can't use a gpu on my vm and it says: Quota 'GPUS_ALL_REGIONS' exceeded. Limit: 0.0 globally all the time and I have premium so how do I fix this?
user avatar
1 vote
0 answers
69 views

How Do You Run GPU Task on Windows Server 2016 Remotely?

From my understanding, remotely executing GPU tasks is a little tricky because of the way sessions work on Windows. Session 0 does not have access to GPU drivers, and usually when you remotely execute ...
user avatar
1 vote
0 answers
105 views

DDA device out of resource(Error 12) in Hyper-V VM

We're 'borrowing' a server from an IDC that had two Tesla V100 on it. It runs Windows Server 2016. Since it has some impressive graphics capabilities, we were looking for ways to run graphic ...
user avatar
  • 11
2 votes
0 answers
2k views

Quota 'GPUS_ALL_REGIONS' exceeded. Limit: 0.0 globally [duplicate]

I am trying to create the VM instance with NVIDIA K80 GPUs in Asia-East1 so, I requested to increase the quota and team have adjusted the quota. However, when I am trying to create the VM instance by ...
user avatar
1 vote
1 answer
2k views

Unable to use gpu in azure windows server 2016

I am trying to run a GPU intensive application(Lumion) on the Azure cloud. Image used - Windows Server 2016. Hardware - NV6_Promo with 1xK80 GPU. Any application, when launched, run without using ...
user avatar