Questions tagged [numa]

Non-Uniform Memory Access is what it stands for. For x86 architectures this is the method used to handle memory architectures where each processor has local memory and accessing another processor's memory is appreciably more expensive.

Filter by
Sorted by
Tagged with
1
vote
0answers
41 views

DELL PowerEdge R740xd - NUMA - memory performance

I have two physical database servers (both Windows Server 2016): test server (5 years old): DELL PowerEdge R730xd, 1x Intel(R) Xeon(R) CPU E5-2637 v4 @ 3.50GHz (4C/8T), 192 GB RAM (12x 16GB PC4-...
2
votes
0answers
32 views

Consecutive CPU numbering on multi-socket NUMA Linux system

I've noticed that CPUs are numbered by Linux according to quite different schemes on different multi-socket NUMA systems. I mean the CPU numbers you use in kernel parameters such as isolcpus= or when ...
0
votes
1answer
261 views

how libvirt cputune config goes to qemu-kvm

I am porting xml libvirt config to qemu executable arguments. Simply I have .xml vm config from virsh edit vm-name and I want to run the same vm machine by executing qemu-system-x86_64 with special ...
0
votes
1answer
279 views

NUMA 1 not used on SQL Server 2008 R2 on Windows Server 2008 R2 on ESXi

We've got Microsoft SQL Server 2008 R2 running on Windows Server 2008 R2, virtualized on VMWare ESXi 6.7.0. The server has 2 CPU sockets with 22 cores each. The VM is allocated 8 sockets with 3 cores ...
0
votes
1answer
20 views

Incorrect # of Free Hugepages in `numastat`

$ numastat -vm Per-node system memory usage (in MBs): Node 0 Total --------------- --------------- MemTotal 32464.24 32464....
0
votes
0answers
39 views

How do I create NUMA nodes on Windows 2008

I have a VM with 8 logical processors. I want to set up different NUMA nodes to test some things, performance doesn't matter. How do I go about doing this or is there any documentation/instructions I ...
0
votes
1answer
267 views

Virtualbox performance on NUMA host (AMD Epyc)

At a small software development house, we virtualize our build servers (using VirtualBox) so that they can be easily backed up, snapshotted and the like. We've recently bought a new server using an ...
2
votes
0answers
16 views

Slurm - Does it maintain ccNUMA?

Does a SLURM cluster control, maintain or enforce Cache Coherence across the Nodes? Is it a configuration property, or does something like this not exist? I can't find anything inside the docs.
0
votes
0answers
94 views

Linux NFS server NUMA affinity - pool_mode

From the Linux kernel-parameters.txt I have seen that it is possible to change the NFS pool behaviour to have the nfsd threads bound to NUMA zones. The parameter in question is sunrpc.pool_mode and ...
1
vote
0answers
328 views

openstack shared PCI between numa with SR-IOV

I'm building SR-IOV supported compute node on HP 360g8 hardware and i have Qlogic interface card, my compute node has 32 core & 32GB memory. Problem: when i launch vm-1 (with flavor 16 vCPU core)...
1
vote
0answers
99 views

Bad performance on better hardware

I have postgresql streaming replication on 2 hosts and I've faced with the problem of different performance compared between two servers. It looks like all sql queries on one host are slower on 70-90% ...
1
vote
0answers
941 views

Memcpy bandwidth ~1.6x faster on 1 vs 2 socket Intel Scalable (Skylake)?

I'm in the process of porting a complex performance oriented application to run on a new dual socket machine. I encountered some performance anomalies while doing so and, after much experimentation, ...
30
votes
1answer
2k views

Unexpected and unexplained slow (and unusual) memory performance with Xeon Skylake SMP

We've been testing a server using 2x Xeon Gold 6154 CPUs with a Supermicro X11DPH-I motherboard, and 96GB RAM, and found some very strange performance issues surrounding memory when compared to ...
4
votes
0answers
221 views

Hyper-V 2016 DDA issue: a VM boot fails when a drive is connected to an opposite NUMA node

Brief description: the host is Windows Server 2016 Datacenter Build 14393 (UEFI) running Hyper-V role. SR-IOV and Intel VT are enabled. 4x Intel® Optane ™ SSD 900P 280GB PCIe NVMe 3.0 drives are ...
-1
votes
3answers
4k views

Hyper-V: Not enough memory to start VM although there are plenty left

I'm having this error on my server: "Not enough memory in the system to start the virtual machine. Ran out of memory (0x8007000E)" when starting an 8 GB VMs on a 12 GB RAM FREE server. Here is my set ...
0
votes
1answer
2k views

Does disabling “numa interleave” from bios cause memory page-out(when cpu-1 has no free memory left) to hdd on all dual-cpu systems?

For an example system of a dell dual 4114 silver with 24GB per CPU; how would it work if my application allocates 24 GB at once? Should I be concerned about write-life of my SSD because of pagefile ...
4
votes
2answers
2k views

NUMA CPU numbering in Linux

I have access to two NUMA servers. One of them is Dell R720 and has these CPUs: $ cat /proc/cpuinfo |grep Xeon|sort|uniq -c 24 model name : Intel(R) Xeon(R) CPU E5-2630L v2 @ 2.40GHz The other ...
5
votes
1answer
193 views

Server computational slowdown when RAM is used extensively

I have problem with server slowdowns in very specific scenario. The facts are: 1) I use computational application WRF (Weather Research and Forecast) 2) I use Dual Xeon E5-2620 v3 with 128GB RAM (...
1
vote
1answer
60 views

Opteron 6274 Cache Differs from Manufacturer's Specs in Windows Server 2016

I just upgraded a DL585 g7 server by replacing its Opteron 6172 CPUs with 4 Opteron 6274 CPUs. Every source I read says that the Opteron 6274s are supposed to have 8x2MB of L2 Cache and 16MB of L3 ...
2
votes
2answers
1k views

NUMA placement failed, performance might be affected

I'm running SuperMicro 6048R-E1CR36H Storageserver on Ubuntu Xenial 16.04.03 LTS and Xen Kernel: 4.4.0-97-generic Xen: xen-hypervisor-4.6-amd64:amd64/xenial-security 4.6.5-0ubuntu1.2 Problem: when ...
0
votes
1answer
2k views

Ryzen Threadripper CPU does not report multiple NUMA nodes [closed]

Just booted Arch Linux on a Ryzen Threadripper 1950X server that I built and use in my company. Please don't close this question. It is relevant for anyone using Linux on Threadripper and running NUMA-...
0
votes
1answer
1k views

Change the NUMA node where a PCIe device is attached

Modern servers using multiple physical CPU sockets have NUMA. PCIe devices are attached to one specific NUMA node as the PCIe controller is embedded in the physical CPU chip. Is it possible to change ...
1
vote
1answer
450 views

Is a machine with a single NUMA node, actually a regular (non-NUMA) system?

First, let's check I got the fundamentals right: As I understand it, NUMA systems are a (asymmetric) network of NUMA nodes, where a NUMA node is usually (but not always) a physical CPU package. In a ...
2
votes
0answers
83 views

find out NUMA locality of process RAM

I am doing an application benchmark with multiple instances of the same application. I found out that pinning their processes (with sched_setaffinity under Linux, with TaskManager under Windows) to ...
1
vote
1answer
692 views

ZFS on Linux and KVM: NUMA nodes for host

I am interested in using KVM images on zvols under ZFS on Linux, on a multi-socket system. I am wondering how I should pin NUMA nodes so as to maximize the benefits of ZFS ARC cache for all KVM images ...
2
votes
1answer
620 views

NUMA node interleaving doesn't work for MariaDB

Please help activating NUMA node interleaving for MariaDB. Using MariaDB 10.1.21 on CentOS Linux release 7.3.1611. Per instructions on https://mariadb.com/kb/en/mariadb/systemd/ added /etc/systemd/...
0
votes
0answers
213 views

CPU & Memory Reservation in vSphere & Numa concept

by googling/studying vSphere documentation I have found the possibility to use "Reservation" concept in vSphere. What it is not clear to me is : CPU and Memory reservations are configured separately ...
1
vote
0answers
65 views

Writing a Numa load balancer

I originally asked this question on StackOverflow, but as there came no answers, and this question is more about how to configure a server, this question might be more suited on ServerFault. I have ...
0
votes
1answer
245 views

What is NUMA node limit in modern Windows OS

What is the highest number of NUMA nodes in Windows 10 / Server 2012? In Windows 7, it was documented that OS supports only up to 4 NUMA nodes1 but with modern systems supporting 320 logical ...
2
votes
2answers
105 views

Is NUMA always completely NUMA or are there also hybrid systems?

I am working on a high-end server application where performance is critical. Given that servers are often employ NUMA-architectures, the server application also uses NUMA-aware memory allocation ...
-1
votes
2answers
1k views

Hyper-V NUMA setting

My machine is running on Window 2012 R2, with 48 Logical processors and 240GB RAM. I have create a VM with 48 processors and 230GB ram. I am double about the NUMA nodes I should create and memory ...
9
votes
1answer
173 views

How would I know if I should be disabling virtual NUMA on VMs running older applications?

From VMware's docs: Virtual NUMA topology is available to hardware version 8 virtual machines and is enabled by default when the number of virtual CPUs is greater than eight. You can also ...
6
votes
1answer
1k views

DL380 Gen9 which processor and what impact on NUMA

We are about to build a new server and I was wondering what would the impact on NUMA with the options available. The system will be built using a Proliant DL380 Gen9 8SFF which has 2 sockets, and 12 ...
0
votes
1answer
196 views

HyperV memory per NUMA node

I have some issue with memory allocation on my Hyper-V 2012 R2 server. Server has 16GB of RAM, with 2 x 12 core CPUs. When I run Get-VMHostNumaNode, I am getting following results: NodeId ...
0
votes
1answer
76 views

NUMA processor definition

NUMA, non-uniform memory access designates a symetric multi-processing system where processors are grouped into nodes, with each group sharing some level of memory, so that memory access on same node ...
3
votes
0answers
885 views

Kernel parameter isolcpus seems to have no effect on Ubuntu Server with NUMA

I use the isolcpus kernel parameter to restrict the CPUs the Linux scheduler should use to place processes. cat /proc/cmdline BOOT_IMAGE=/boot/vmlinuz-4.2.0-18-generic.efi.signed root=UUID=78e5b46f-...
1
vote
1answer
136 views

NUMA_NODE for 10GbE device

My server reports numa_node=-1 for all ethernet devices. I am interested in high speed UDP capture (all jumbo packets). I am running Debian Wheezy (kernel 3.2.68-1+deb7u2). I am told that one needs ...
3
votes
0answers
609 views

Move process across NUMA system

I am running many multi-threaded processes on a larger NUMA system with dozens of sockets. The memory access across different nodes is very slow, so I restrict each process to one socket and let it ...
1
vote
1answer
968 views

Incorrect CPU count on HP XL230a Gen9

we have an issue with our HP XL230a Gen9 blades where some of the applications are only seeing half of the CPU. On the task manager we see all 56 cores but application are only seeing half of them. We ...
1
vote
0answers
357 views

NUMA - all CPU's bound to node 0

I am running Dell PE 815 servers with two 16-core Opteron's, with four memory modules on each, OS - RHEL6, when I've started optimizing it for NUMA operation, found, that all cores are shown as bound ...
0
votes
1answer
2k views

HP Server ProLiant DL360 Gen9 vs IBM System x3850 X5 ==> Numa Processor group usage

The same C# executable programmed to run on every nodes have those different behavior: HP: Run on one node only (one processorGroup) (any one of the 2). Problem: it suppose to run on every nodes. ...
1
vote
0answers
423 views

NUMA enabled but can't detect node

I have a Centos 6.4 (kernel 2.6.32) machine with 2x Intel X5670 (Westmere) in a SuperMicro X8DTG-D motherboard with 2.0a BIOS version. BIOS Settings for ACPI are: ACPI Aware O/S: Enabled APCI Version ...
1
vote
1answer
1k views

How to activate NUMA in HP Proliant DL580 G5 Server?

Currently I am working on a task regarding one server with NUMA. The OS running on the server is Ubuntu 14.04.1 LTS. The server has 4 nodes of 16 cpus: Intel(R) Xeon(R) CPU X7350 @ 2.93GHz, i.e. each ...
4
votes
1answer
6k views

Set default numa policy to “interleave” system wide

I know it is possible to set the numa mode to "interleave" (see NB below) for a specific process using numactrl --interleave, but I'd like to know if it is possible to make this the system wide ...
1
vote
1answer
585 views

Linux interrupt affinity

We have a HP DL980 running SuSE Linux Enterprise Server 11 sp2. The machine hosts a PCIe digital IO card which is used to send a clock signal to sychronise with other machines. If we do a top, one ...
4
votes
0answers
1k views

IIS Performance NUMA

I have been struggling with an IIS issue and can't seem to find any answers. Basically here is the setup. I have a Dell Server with 4 processors 10 cores each with hyper-threading enabled. Giving ...
1
vote
2answers
3k views

VMWare NUMA Node Boundary Configuration

I have been trying to find out what the best VM configuration would be for our SQL Server 2012 on VMware 5.1 would be. The VM host(s) has 2 sockets with 4 cores running hyper threading (total of 16 ...
41
votes
1answer
54k views

Is there still a use for irqbalance on modern hardware?

This question has been asked before, but I believe that the world has changed enough for it to be asked again. Does irqbalance have any use on today’s systems where we have NUMA-capable CPUs with ...
1
vote
1answer
3k views

Is NUMA Enabled? [duplicate]

Possible Duplicate: HP DL360p with Intel E5-2630 NUMA Capable? i have an brand new HP DL380p Gen 8 with Windows server 2008R2 Enterprise Edition and i want to check if numa is enabled and how can ...
1
vote
1answer
4k views

Check whether node interleaving is enabled on Dell R710 + Windows?

Is there a way to check whether node interleaving is enabled from within Windows on a Dell R710? omreport chassis biossetup doesn't appear to print any NUMA-related settings on the server I'm looking ...