Questions tagged [gpu]
The gpu tag has no usage guidance.
60
questions
0
votes
0
answers
32
views
DirectX 12 is not supported on your system on VM with Nvidia L4
I have a virtual machine at google cloud with the Nvidia L4 GPU to run 3D applications. I installed the Nvidia drivers according to the documentation, but every time I run an application, it doesn't ...
0
votes
0
answers
25
views
Building server for research team
this is kind of a big task for me, I have an engineering background with computer science knowledge but I'm no expert in servers and networking.
I want to build a GPU-enabled computing platform that ...
- 1
0
votes
0
answers
16
views
Mount a remote GPU locally on Rocky Linux
I am doing some work on a server which has 1TB RAM, 100CPUs, and 1000TB storage. My work involves very large datasets.
One specific I am trying to run would benefit immensely from a GPU, it is ML ...
- 53
5
votes
1
answer
65
views
The GPU usage provided by nvidia-smi command is very different from GPU metrics from guest OS
I'm working on a project that can monitor virtual machines' vgpu usage.
The hypervisor is vCenter, we have nvidia A16 cards installed on vCenter hosts, and assigned a16 vGPU to a couple of windows VMs ...
- 51
1
vote
0
answers
59
views
Hyper-V GPU Passthrough with NVidia A100 no display
I am currently trying to get some NVidia A100 GPUs to work on our Hyper-V Hypervisor. I managed to setup the GPU Passthrough to a VM but the problem is I don't get a video display. I assume the ...
- 161
0
votes
0
answers
16
views
Will compute nodes with A100 80GB (2x on node1) and A100 40GB (2x on node2) work in Red Hat OpenShift cluster?
I think the answer should be yes, however these parts/cards are expensive, so would like to know from experts who have done this kind of things.
Will MIG be supported on this?
- 1
0
votes
0
answers
44
views
Interpretation of output of nvidia-smi and lspci | grep -i nvidia
I am very new to GPU servers. I submitted a slurm job and then checked "nvidia-smi". I got the following outputs.
This picture
Then, I ran "lspci | grep -i nvidia" where I got ...
0
votes
0
answers
38
views
AMD driver doesn't load after rebooting vm with GPU passthrough on virt manager
I'm having an issue with GPU passthrough, using virt manager on Debian 11. It's a very specific question, but i hope that someone can help me with this. I have an RX 5500XT GPU, and i passthrough it ...
0
votes
0
answers
39
views
How to size compute/gpu/storage/network for generative AI or LLM? [duplicate]
I would like to provision compute (servers), gpus (say 2 A100 80GB or H100), storage and network (may be 100GbE) to run OpenApaca 7B (https://huggingface.co/openlm-research/open_llama_7b) model.
How ...
- 1
0
votes
0
answers
1k
views
How do I fix amdgpu and amdgpu-dkms packages not installing?
I'm trying to install the amdgpu package and it throws a bunch of errors:
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following packages were ...
- 1
0
votes
1
answer
340
views
LM-Sensors - Intel Arc A750 + Dell R720 + Debian 11 (Kernel 6.2.2)
I have a Dell R720 at home running virtualized services under KVM. I have recently added an Intel ARC A750 which I've passed through a Debian 11 VM (with a Q35 machine model), where I have Jellyfin ...
0
votes
0
answers
276
views
How to monitor windows GPU in zabbix
I am using zabbix 6.0 and I wan to monitor the gpu usage and temperature and other things related to GPU of my windows host, How can I do that, I have windows 10 and agent installed
- 5
0
votes
1
answer
234
views
How do you disable hardware-accelerated GPU scheduling via the command line in Windows 10/11?
I need to disable, programmatically, hardware-accelerated GPU scheduling in Windows if it's enabled.
Searching, I was pointed at the HKLM\SYSTEM\CurrentControlSet\Control\GraphicsDrivers - HwSchMode ...
- 1,792
2
votes
1
answer
227
views
What socket(s) does the aux power for a GPU come from in a PowerEdge T550?
Server: Dell PowerEdge T550 Tower Server
PSU: Single, Hot Plug, Non-Redundant Power Supply (1+0), 1100W, Mixed Mode Titanium
GPU: NVIDIA A40
Photos: https://www.reddit.com/user/bigboyserver/comments/...
- 23
0
votes
1
answer
203
views
Dell PowerEdge R720XD - Fans Ramp Up When Video Card is Installed [closed]
I have a Dell PowerEdge R720XD with 2x Xeon E5-2640 v2 (16 cores total), 16 GB of RAM, and 2x 3 TB hard drives. I have Windows 10 running on the machine.
When I connect a video card to the system, the ...
0
votes
0
answers
73
views
how so I troubleshoot intermittent node/kubelt reboots on a GKE
I am running workloads on a spot GPU node pool & intermittently getting 'NodeNotReady' followed by a reboot/restart of the node (& loss of the the workload pod), however the node does not go ...
google-compute-engine
0
votes
0
answers
43
views
There is no dir "/sys/devices/pci0000:00/0000:00:02.0/mdev_supported_types" with 5.19.0-23-generic
I've an issue with 5.19.0-23-generic #24-Ubuntu SMP, — there is no /sys/devices/pci0000:00/0000:00:02.0/mdev_supported_types dir.
uname -a
Linux hp1 5.19.0-23-generic #24-Ubuntu SMP PREEMPT_DYNAMIC ...
0
votes
0
answers
30
views
T4 GPU slows down automatically after sometime with power usage limited
I had been using T4 GPU with 8 virtual CPUs and 30 GB RAM Virtual Machine for more than a month without any issues.
I have been running some deep learning training jobs on it.
But since yesterday, I ...
0
votes
0
answers
31
views
Setting ep an AI server for multiple users
In the University I work, we want to buy a workstation with one or two powerful GPUs. We want students to be able to use the workstation remotely. This is the main restriction. It would be nice if ...
- 1
1
vote
0
answers
156
views
Double-precision floating point performance on GPUs
I have an application which needs to run lots of double-precision floating point operations in parallel on small datasets. I've just started exploring the possibility of running these computations on ...
- 135
2
votes
1
answer
4k
views
Pod is stuck in PodInitializing status when an initContainer is OOMKilled
I have the following on-prem Kubernetes environment:
OS: Red Hat Enterprise Linux release 8.6 (Ootpa)
Kubernetes: 1.23.7 (single-node, build with kubeadm)
NVIDIA driver: 515.65.01
nvidia-container-...
- 363
0
votes
1
answer
352
views
Can each GPU be used on Kubernetes as dedicated to a specific Pod?
I have the following environment:
Pods: Pod0, Pod1 (launched as a k8s Job)
GPUs: GPU0, GPU1
GPU0 is dedicated to Pod0, and GPU1 is dedicated to Pod1.
There can be multiple Pod0s and Pod1s at the same ...
- 363
0
votes
0
answers
172
views
CloudStack and GPU support
Is there any document for GPU and VGPU support in cloudstack version 4.14 and later? For example how I find out CloudStack support Nvidia Quadro RTX series or not?
- 1
1
vote
0
answers
2k
views
GKE Node auto-provisioning not scaling up with limits defined
I want to use GKE node auto-provisioning to create a node-pool with GPU on demand (that is when I start a Job that needs GPU resources).
Going with the GCP tutorial I've set up a cluster with enabled ...
- 11
3
votes
1
answer
3k
views
GPU Acceleration on a Windows Server without virtualization over RDP
I'm trying to find out if it's possible to run a Windows Server with one GPU which is shared between all RDP clients so that people could
create a session on the server
start some program with a UI ...
- 131
2
votes
2
answers
6k
views
GCP does not have enough resources available to fulfill the request for about a month
I've been trying to start my existing GCP VM that has an NVIDIA T4 GPU attached to it, for almost a month at this time. It has been working fine before but now I am constantly getting the error ...
0
votes
1
answer
1k
views
GCP: Cannot create any VM with GPU -> No capacity
I subscribed to GCP and received the $300 credits. Then I upgraded my account to "paid account". Next, I increased the limit for multiple VM types with GPU, in multiple regions, and received ...
0
votes
1
answer
238
views
How to identify slot for faulty GPU card in server using UBUNTU OS commands?
I have a question. Is it possible to identify in which slot there is a broken GPU card using the UBUNTU operating system? We have a SuperMicro GPU server in which there are about 8 GPU cards for AI ...
- 1
2
votes
0
answers
4k
views
Slurm srun cannot allocate ressources for GPUs - Invalid generic resource specification
I am able to launch a job on a GPU server the traditional way (using CPU and MEM as consumables):
~ srun -c 1 --mem 1M -w serverGpu1 hostname
serverGpu1
but trying to use the GPUs will give an error:
...
- 121
33
votes
7
answers
22k
views
Does a server need a GPU?
Do I need a GPU on a text and console only server? No GPU as in no iGPU and dGPU. Im going to be using SSH, so I dont need a display out.
Im using Linux, but the OS shouldn't affect the results
- 495
1
vote
1
answer
256
views
Why can't the GPUs communicate in a multi-GPU server?
This is a Dell PowerEdge r750xa server with 4 Nvidia A40 GPUs, intended for AI applications. While the GPUs work well individually, multi-GPU training jobs or indeed any multi-GPU computational ...
- 341
4
votes
1
answer
2k
views
Kubernetes: How can I get which pod schedule GPU?
I have three Nvidia GPUs in my cluster, and so many pods are running in my cluster. How can I find which one of these pods schedule GPU and how many GPUs they schedule?
I use this link to enable the ...
- 153
-4
votes
1
answer
350
views
How to extend 1U / 2U servers with multiple 2 slot full height GPUs for sharing? [closed]
What are the possible options to extend a 1U / 2U server with a GPU?
e.g. I am searching for a solution how to add a GTX 1650 into the server. The GPU is usually 2 slots width and therefore often not ...
- 277
4
votes
1
answer
1k
views
What is the best metric for auto-scaling GPU instances for machine learning inference in the cloud?
We have an API in AWS with a GPU instance that does inference. We have an auto-scaler setup with the minimum and maximum number of instances, but aren’t sure which metric (GPU/CPU usage, RAM usage, ...
- 41
0
votes
1
answer
1k
views
Xorg not starting in GKE with GPU : (EE) no screens found(EE)
I am trying to run Xorg server that use GPU inside Google Kubernetes Engine
I followed this guide (https://cloud.google.com/kubernetes-engine/docs/how-to/gpus#ubuntu) to setup a
GKE cluster with ...
- 1
0
votes
0
answers
171
views
Is there any software VGA dummy solution?
To cut long story short, I actually run Davinci Resolve on a Intel HD 4600 based server on Hetzner auction. And they all don't come with any remote KVM, or use any VGA dummy plug, for every server ...
- 129
-1
votes
1
answer
489
views
Tesla K80 not showing up in HP DL580 G7
I have a HP Proliant DL580 G7 server with P65 BIOS update from 2015 (which I think is the latest BIOS).
I installed the PCIe expansion board in it and installed 4 x Tesla K80 GPUs. Connected them to ...
- 11
0
votes
0
answers
26
views
Server not starting, after adding graphisc card
First of all, I want to clarify, that I pretty new to server topics.
My server runs on normal ubuntu.
I bought a Nvidia Quadro k4000.
I built it into the server and connected the PCIe Power cable. - ...
- 1
1
vote
0
answers
348
views
Service Creation failed AWS ECS Service with elastic inference accelerator (EIA)
I am trying to create a service in my ECS cluster to run a task that uses elastic inference accelerator (EIA). However, when I try to create the service, I get the following error:
I have read the ...
- 113
0
votes
1
answer
89
views
[GCP]Why can't I see the GPU selection button on my VM instance?
I want to use GPU in Windows VM.
However, the GPU selection button is not active when creating the instance.
Currently, I applied for GPU(k-80) as a quota and got 1 allocation. Of course, I received ...
2
votes
1
answer
1k
views
Considerations using consumer class (high-end) GPU in server?
Motivation:
First of all, even if I have some knowledge of computer science, software development and server Linux administration, I never looked into a server hardware and I am a total "newbie&...
- 145
0
votes
1
answer
42
views
Configure a new kubernetes node automatically
I configured a Kubernetes cluster with GPU in AWS, and one of the steps is configuring the nodes to enable Nvidia runtime by default.
So when I configured cluster auto scaler, the cluster scales up ...
- 11
0
votes
0
answers
271
views
Deep Learning - maximum GPUs a CPU can handle
The design for the deep learning server would be very similar to that of a mining rig, specifically using risers to stack as many GPU's onto the motherboard. The design is as follows:
CPU: AMD EPYC ...
- 183
1
vote
0
answers
140
views
Mounting virtual GPUs on different machines
I have multiple computers connected over a VPN, each computer having one or more Nvidia GPUs. All computers run Linux. I'm wondering if it's possible to mount them over network such that they appear ...
- 113
0
votes
1
answer
441
views
How to increase Service name: GPU (ALL REGION) quota limit in Compute Engine?
I requested 2 times for GPU all region service quota from 0 to 1 but not got accepted so ,I want a way to increase this limit.
2
votes
0
answers
1k
views
Make Headless Server Use Hardware Accelaration
I have a headless CentOS 8 Server with an AMD GPU. I want to use hardware acceleration but when I run OpenGL programs with xvfb-run (e.g glxinfo), the system reports I am using software rendering. How ...
user548851
0
votes
1
answer
193
views
Create a kubernetes master on google cloud and add as nodes on-premise instances with gpu
Since we are working on ML engineering tasks we do have requirements of gpu instances.
We do have couple of them on-premise and we need to organize our pipeline creating a kubernetes cluster.
Since ...
1
vote
1
answer
1k
views
Misbehaving NVLINK with 2080 ti cards?
I am running into problems with nvlink'd RTX videocards, and I wonder if someone more experienced with this tech could kindly look at the output below and tell me if there is a problem?
Using a pair ...
- 113
0
votes
0
answers
393
views
RTX 2070 + Fedora 31: nvidia_modeset error freezes computer just before login
I'm experimenting an error -which I'll describe next- with the following Linux system:
Fedora 31 - kernel: 5.5.17-200.fc31.x86_64
GPU is ASUS RTX 2070 SUPER with drivers 440.82, also CUDA 10.1 and ...
- 101
4
votes
1
answer
10k
views
Use passthrough GPU in KVM/QEMMU and display in host OS in a window
I'm new to KVM/QEMMU.
I have used virtual box to run Windows 10 in a virtual machine on my Arch host system (a laptop with both integrated and discrete GPUs). Being dissatisfied with the video ...
- 141
Related Tags
linux × 13
nvidia × 11
kubernetes × 8
virtual-machines × 6
dell-poweredge × 5
virtualization × 5
windows × 5
networking × 3
passthrough × 3
linux-kernel × 3
autoscaling × 2
cluster × 2
docker × 2
hpc × 2
hyper-v × 2
intel × 2
hardware × 2
quota × 2
pci-express × 2
more related tags
Hot Network Questions
- Is it ethical to apply directly for a job after a recruiter declines to submit you for the role?
- Where should I stop in this intersection when turning left?
- Longest sequence of Egyptian fractions with n as denominator
- How can I convert a QR code from JPG to SVG with perfect clean squares?
- How can I move a new heavy boiler to the basement and the old one up and out?
- Hidden dots in the center
- What's the correct Unicode code point for the Apple IIe's "delete" symbol?
- Creating Mirror (RAID 1) on Windows 10 causes not enough disk space error
- What to do with a mathematical article rejected from a journal because the anonymous referee found a simpler proof?
- Delete default shadow's points in QGIS
- Seeking origin and original wording of a quotation attributed to Shakespeare
- How to Prevent World Lighting from Passing Through Objects in Blender?
- Why wasn't the fraud lawsuit against Trump thrown out?
- Can I change my 29x2.25 MTB tyres to a 29x2.35 tyre without changing anything else?
- Are freewheels compatible if they have the same number of sprockets and teeth?
- Perl: change in interpretation of shell symbols in system() invocation?
- Being asked to sign a release form after being terminated
- Where did the term cantrip originate?
- A Trivial Pursuit #14 (Entertainment 3/4): Integration by Parts
- Best design practice when one python method passes most of its arguments to another method
- All up front rental payments impacting taxes?
- What's the meaning of "Courtesy: [Name]" in an advertisement?
- Google Pixel 6 sceenshot function has been replaced by Google Assistant
- Python program to properly format North American phone numbers