Questions tagged [gpu]
The gpu tag has no usage guidance.
61
questions
0
votes
0
answers
61
views
+50
Can DGX or HGX H100 operate without NVIDIA AI Enterprise?
I have heard that NVIDIA DGX and HGX H100 clusters require activation from supported countries and an online connection to NVIDIA servers for managing the license for their enterprise software. ...
0
votes
0
answers
35
views
How to make nvidia.com/gpu available in a Kubernetes node?
when i describe node, there is no gpu resource, why?
Capacity:
cpu: 48
ephemeral-storage: 574137520Ki
hugepages-1Gi: 0
hugepages-2Mi: 0
memory: ...
1
vote
1
answer
59
views
What is the difference between Allocated GPUs and GPU quota in runAI?
What is the difference between Allocated GPUs and GPU quota in runAI?
- 1,254
0
votes
0
answers
92
views
Openstack Nova: PCI alias is not defined
I'm running Openstack Zed deployed with kolla-ansible 15.4.1. I'm facing a strange behavior:
I have a GPU on one of my compute node, and nova is configured to perform PCI passthrough. When I try to ...
0
votes
0
answers
116
views
CISCO UCSC-C220-M4S loud fan, power profile not respected
I recently purchased a used Cisco UCSC-C220-M4S at a reasonable price, which included a Tesla GPU. However, I discovered that the GPU model is not officially supported. Although it can still be ...
-1
votes
1
answer
135
views
Best GPU to get for encoding / decoding multiple video streams and files? [closed]
I need to encode / decode multiple videos (both live and pre-recorded video files) at the same time but I'm not sure which GPU to get. I'll be using ffmpeg for the video manipulation.
Ideally I'd like ...
- 340
0
votes
0
answers
204
views
openstack after passthrough RTX 3090 GPU - lspci says !!! Unknown header type 7f
First thanks if you read this all, cause its like a long story.
We have cloud infrastructure on Ubuntu 20.04 with Linux 5.4.0-155-generic x86_64 kernel and OpenStack as virtualization system with QEMU/...
- 1
1
vote
0
answers
2k
views
How can I enable OpenGL on Windows Server 2022?
I am trying to use an application requiring OpenGL > 2.1 on Windows Server.
I have read on multiple questions here about the challenges of getting OpenGL to work through a remote desktop session, ...
- 111
0
votes
0
answers
274
views
Openstack: Can't launch instances when GPU passtrough is enabled
I installed openstack using devstack in a single node configuration on Ubuntu 22.04 (Jammy) LTS. I followed the following tutorial to setup GPU passthrough on my openstack: https://superuser.openinfra....
0
votes
0
answers
180
views
Nvidia-smi missing GPU with SR-IOV disable in bios
I have a HPE serveur (DL385) with 3 Nvidia A100 in it. It is running ubuntu 22.04 with kernel version 6 (I have tried with the 5).
By default, it was in energy saving mode in the BIOS.
When I tried to ...
0
votes
0
answers
44
views
Building server for research team
this is kind of a big task for me, I have an engineering background with computer science knowledge but I'm no expert in servers and networking.
I want to build a GPU-enabled computing platform that ...
- 1
1
vote
0
answers
252
views
Mount a remote GPU locally on Rocky Linux
I am doing some work on a server which has 1TB RAM, 100CPUs, and 1000TB storage. My work involves very large datasets.
One specific I am trying to run would benefit immensely from a GPU, it is ML ...
- 63
5
votes
1
answer
440
views
The GPU usage provided by nvidia-smi command is very different from GPU metrics from guest OS
I'm working on a project that can monitor virtual machines' vgpu usage.
The hypervisor is vCenter, we have nvidia A16 cards installed on vCenter hosts, and assigned a16 vGPU to a couple of windows VMs ...
- 51
1
vote
0
answers
419
views
Hyper-V GPU Passthrough with NVidia A100 no display
I am currently trying to get some NVidia A100 GPUs to work on our Hyper-V Hypervisor. I managed to setup the GPU Passthrough to a VM but the problem is I don't get a video display. I assume the ...
- 81
0
votes
0
answers
41
views
How to size compute/gpu/storage/network for generative AI or LLM? [duplicate]
I would like to provision compute (servers), gpus (say 2 A100 80GB or H100), storage and network (may be 100GbE) to run OpenApaca 7B (https://huggingface.co/openlm-research/open_llama_7b) model.
How ...
- 1
0
votes
0
answers
3k
views
How do I fix amdgpu and amdgpu-dkms packages not installing?
I'm trying to install the amdgpu package and it throws a bunch of errors:
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following packages were ...
- 1
0
votes
1
answer
840
views
LM-Sensors - Intel Arc A750 + Dell R720 + Debian 11 (Kernel 6.2.2)
I have a Dell R720 at home running virtualized services under KVM. I have recently added an Intel ARC A750 which I've passed through a Debian 11 VM (with a Q35 machine model), where I have Jellyfin ...
0
votes
0
answers
677
views
How to monitor windows GPU in zabbix
I am using zabbix 6.0 and I wan to monitor the gpu usage and temperature and other things related to GPU of my windows host, How can I do that, I have windows 10 and agent installed
- 45
2
votes
1
answer
769
views
How do you disable hardware-accelerated GPU scheduling via the command line in Windows 10/11?
I need to disable, programmatically, hardware-accelerated GPU scheduling in Windows if it's enabled.
Searching, I was pointed at the HKLM\SYSTEM\CurrentControlSet\Control\GraphicsDrivers - HwSchMode ...
- 1,882
2
votes
1
answer
480
views
What socket(s) does the aux power for a GPU come from in a PowerEdge T550?
Server: Dell PowerEdge T550 Tower Server
PSU: Single, Hot Plug, Non-Redundant Power Supply (1+0), 1100W, Mixed Mode Titanium
GPU: NVIDIA A40
Photos: https://www.reddit.com/user/bigboyserver/comments/...
- 23
0
votes
1
answer
411
views
Dell PowerEdge R720XD - Fans Ramp Up When Video Card is Installed [closed]
I have a Dell PowerEdge R720XD with 2x Xeon E5-2640 v2 (16 cores total), 16 GB of RAM, and 2x 3 TB hard drives. I have Windows 10 running on the machine.
When I connect a video card to the system, the ...
2
votes
1
answer
8k
views
Pod is stuck in PodInitializing status when an initContainer is OOMKilled
I have the following on-prem Kubernetes environment:
OS: Red Hat Enterprise Linux release 8.6 (Ootpa)
Kubernetes: 1.23.7 (single-node, build with kubeadm)
NVIDIA driver: 515.65.01
nvidia-container-...
- 393
0
votes
1
answer
791
views
Can each GPU be used on Kubernetes as dedicated to a specific Pod?
I have the following environment:
Pods: Pod0, Pod1 (launched as a k8s Job)
GPUs: GPU0, GPU1
GPU0 is dedicated to Pod0, and GPU1 is dedicated to Pod1.
There can be multiple Pod0s and Pod1s at the same ...
- 393
0
votes
0
answers
240
views
CloudStack and GPU support
Is there any document for GPU and VGPU support in cloudstack version 4.14 and later? For example how I find out CloudStack support Nvidia Quadro RTX series or not?
- 1
1
vote
0
answers
2k
views
GKE Node auto-provisioning not scaling up with limits defined
I want to use GKE node auto-provisioning to create a node-pool with GPU on demand (that is when I start a Job that needs GPU resources).
Going with the GCP tutorial I've set up a cluster with enabled ...
- 11
4
votes
1
answer
5k
views
GPU Acceleration on a Windows Server without virtualization over RDP
I'm trying to find out if it's possible to run a Windows Server with one GPU which is shared between all RDP clients so that people could
create a session on the server
start some program with a UI ...
- 141
4
votes
2
answers
9k
views
GCP does not have enough resources available to fulfill the request for about a month
I've been trying to start my existing GCP VM that has an NVIDIA T4 GPU attached to it, for almost a month at this time. It has been working fine before but now I am constantly getting the error ...
google-cloud-platform
2
votes
1
answer
1k
views
GCP: Cannot create any VM with GPU -> No capacity
I subscribed to GCP and received the $300 credits. Then I upgraded my account to "paid account". Next, I increased the limit for multiple VM types with GPU, in multiple regions, and received ...
0
votes
1
answer
524
views
How to identify slot for faulty GPU card in server using UBUNTU OS commands?
I have a question. Is it possible to identify in which slot there is a broken GPU card using the UBUNTU operating system? We have a SuperMicro GPU server in which there are about 8 GPU cards for AI ...
- 1
2
votes
0
answers
5k
views
Slurm srun cannot allocate ressources for GPUs - Invalid generic resource specification
I am able to launch a job on a GPU server the traditional way (using CPU and MEM as consumables):
~ srun -c 1 --mem 1M -w serverGpu1 hostname
serverGpu1
but trying to use the GPUs will give an error:
...
- 121
33
votes
7
answers
28k
views
Does a server need a GPU?
Do I need a GPU on a text and console only server? No GPU as in no iGPU and dGPU. Im going to be using SSH, so I dont need a display out.
Im using Linux, but the OS shouldn't affect the results
- 517
1
vote
1
answer
378
views
Why can't the GPUs communicate in a multi-GPU server?
This is a Dell PowerEdge r750xa server with 4 Nvidia A40 GPUs, intended for AI applications. While the GPUs work well individually, multi-GPU training jobs or indeed any multi-GPU computational ...
- 351
5
votes
1
answer
3k
views
Kubernetes: How can I get which pod schedule GPU?
I have three Nvidia GPUs in my cluster, and so many pods are running in my cluster. How can I find which one of these pods schedule GPU and how many GPUs they schedule?
I use this link to enable the ...
- 163
-4
votes
1
answer
565
views
How to extend 1U / 2U servers with multiple 2 slot full height GPUs for sharing? [closed]
What are the possible options to extend a 1U / 2U server with a GPU?
e.g. I am searching for a solution how to add a GTX 1650 into the server. The GPU is usually 2 slots width and therefore often not ...
- 277
4
votes
1
answer
2k
views
What is the best metric for auto-scaling GPU instances for machine learning inference in the cloud?
We have an API in AWS with a GPU instance that does inference. We have an auto-scaler setup with the minimum and maximum number of instances, but aren’t sure which metric (GPU/CPU usage, RAM usage, ...
- 41
1
vote
1
answer
2k
views
Xorg not starting in GKE with GPU : (EE) no screens found(EE)
I am trying to run Xorg server that use GPU inside Google Kubernetes Engine
I followed this guide (https://cloud.google.com/kubernetes-engine/docs/how-to/gpus#ubuntu) to setup a
GKE cluster with ...
- 11
0
votes
0
answers
203
views
Is there any software VGA dummy solution?
To cut long story short, I actually run Davinci Resolve on a Intel HD 4600 based server on Hetzner auction. And they all don't come with any remote KVM, or use any VGA dummy plug, for every server ...
- 139
-1
votes
1
answer
587
views
Tesla K80 not showing up in HP DL580 G7
I have a HP Proliant DL580 G7 server with P65 BIOS update from 2015 (which I think is the latest BIOS).
I installed the PCIe expansion board in it and installed 4 x Tesla K80 GPUs. Connected them to ...
- 11
0
votes
0
answers
40
views
Server not starting, after adding graphisc card
First of all, I want to clarify, that I pretty new to server topics.
My server runs on normal ubuntu.
I bought a Nvidia Quadro k4000.
I built it into the server and connected the PCIe Power cable. - ...
- 1
1
vote
0
answers
423
views
Service Creation failed AWS ECS Service with elastic inference accelerator (EIA)
I am trying to create a service in my ECS cluster to run a task that uses elastic inference accelerator (EIA). However, when I try to create the service, I get the following error:
I have read the ...
- 113
0
votes
1
answer
128
views
[GCP]Why can't I see the GPU selection button on my VM instance?
I want to use GPU in Windows VM.
However, the GPU selection button is not active when creating the instance.
Currently, I applied for GPU(k-80) as a quota and got 1 allocation. Of course, I received ...
2
votes
1
answer
2k
views
Considerations using consumer class (high-end) GPU in server?
Motivation:
First of all, even if I have some knowledge of computer science, software development and server Linux administration, I never looked into a server hardware and I am a total "newbie&...
- 145
0
votes
1
answer
70
views
Configure a new kubernetes node automatically
I configured a Kubernetes cluster with GPU in AWS, and one of the steps is configuring the nodes to enable Nvidia runtime by default.
So when I configured cluster auto scaler, the cluster scales up ...
- 11
0
votes
0
answers
378
views
Deep Learning - maximum GPUs a CPU can handle
The design for the deep learning server would be very similar to that of a mining rig, specifically using risers to stack as many GPU's onto the motherboard. The design is as follows:
CPU: AMD EPYC ...
- 183
1
vote
0
answers
197
views
Mounting virtual GPUs on different machines
I have multiple computers connected over a VPN, each computer having one or more Nvidia GPUs. All computers run Linux. I'm wondering if it's possible to mount them over network such that they appear ...
- 113
0
votes
1
answer
512
views
How to increase Service name: GPU (ALL REGION) quota limit in Compute Engine?
I requested 2 times for GPU all region service quota from 0 to 1 but not got accepted so ,I want a way to increase this limit.
3
votes
0
answers
2k
views
Make Headless Server Use Hardware Accelaration
I have a headless CentOS 8 Server with an AMD GPU. I want to use hardware acceleration but when I run OpenGL programs with xvfb-run (e.g glxinfo), the system reports I am using software rendering. How ...
user548851
0
votes
1
answer
314
views
Create a kubernetes master on google cloud and add as nodes on-premise instances with gpu
Since we are working on ML engineering tasks we do have requirements of gpu instances.
We do have couple of them on-premise and we need to organize our pipeline creating a kubernetes cluster.
Since ...
1
vote
1
answer
2k
views
Misbehaving NVLINK with 2080 ti cards?
I am running into problems with nvlink'd RTX videocards, and I wonder if someone more experienced with this tech could kindly look at the output below and tell me if there is a problem?
Using a pair ...
anon
0
votes
0
answers
423
views
RTX 2070 + Fedora 31: nvidia_modeset error freezes computer just before login
I'm experimenting an error -which I'll describe next- with the following Linux system:
Fedora 31 - kernel: 5.5.17-200.fc31.x86_64
GPU is ASUS RTX 2070 SUPER with drivers 440.82, also CUDA 10.1 and ...
- 101
Related Tags
linux × 14
nvidia × 12
kubernetes × 8
windows × 6
dell-poweredge × 5
virtual-machines × 5
hardware × 4
passthrough × 4
virtualization × 4
networking × 3
openstack-nova × 3
docker × 3
autoscaling × 2
cluster × 2
fan × 2
hpc × 2
hyper-v × 2
openstack × 2
linux-kernel × 2
pci-express × 2
quota × 2
more related tags
Hot Network Questions
- How did NASA figure out when and where the Apollo capsule would touch down on the ocean?
- Sampling from tail of Normal distribution
- Whom did Jesus' followers accompany -- a soldier or a layman?
- Is it really a "space walk" (EVA proper) if you don't get your feet wet (in space)?
- security concerns of executing mariadb-dump with password over ssh
- Fast leap year check
- Looking for a short story on chess, maybe published in Playboy decades ago?
- If Act A repeals another Act B, and Act A is repealed, what happens to the Act B?
- Will "universal" SMPS work at any voltage in the range, even DC?
- History of the migration of ERA from AMS to AIMS in 2007
- getting weird shaping using curves on objects
- Why does counterattacking lead to a more drawish and less dynamic position than defending？
- How many engineers/scientists believed that human flight was imminent as of the late 19th/early 20th century?
- Who pays the cost of star alliance lounge usage for cross airline access?
- Concerns with newly installed floor tile
- Was Willy Wonka correct when he accused Charlie of stealing Fizzy Lifting Drinks?
- Is a thing just a class with only one member?
- siunitx dollar per hour broken going from SI to qty
- Mounting network afp volume from command line
- What unintended side effects may arise from making bards count as both arcane and divine spellcasters?
- How did people know that the war against the mimics was over?
- On the history of algae classification
- Why does Sfas Emes start his commentary on Parshat Noach by saying he doesn't know it? Is the translation faulty?
- mmrm R package : No optimizer led to a successful model fit