Posts

Showing posts from November, 2013

NUMA mode with pci mapping

[root@islpfdkvm12 ~]# dmesg | grep -i numa NUMA: Allocated memnodemap from a000 - a140 NUMA: Using 31 for the hash shift. pci_bus 0000:00: on NUMA node 0 (pxm 0) pci_bus 0000:80: on NUMA node 1 (pxm 1)

pci details with CPU mapping

[root@islpfdkvm12 ~]# lspci | grep -i ether 06:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01) 06:00.1 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01) 06:00.2 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01) 06:00.3 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01) 1b:00.0 Ethernet controller: Intel Corporation 82580 Gigabit Network Connection (rev 01) 1b:00.1 Ethernet controller: Intel Corporation 82580 Gigabit Network Connection (rev 01) 1b:00.2 Ethernet controller: Intel Corporation 82580 Gigabit Network Connection (rev 01) 1b:00.3 Ethernet controller: Intel Corporation 82580 Gigabit Network Connection (rev 01) [root@islpfdkvm12 ~]# cat /sys/devices/pci0000\: pci0000:00/ pci0000:80/ [root@islpfdkvm12 ~]# cat /sys/devices/pci0000\:00/ 0000:00:00.0/ 0000:00:02.2/ 0000:00:04.0/ 0000:00:04.3/ 0000:00:04.6/ 0000:00:05.2/ 0000:00:1c.0/ 0000:00:1e.0/ 000

Command to check CPU details

[root@islpfdkvm12 ~]# lscpu Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 32 On-line CPU(s) list: 0-31 Thread(s) per core: 2 Core(s) per socket: 8 Socket(s): 2 NUMA node(s): 2 Vendor ID: GenuineIntel CPU family: 6 Model: 45 Stepping: 7 CPU MHz: 1200.000 BogoMIPS: 5399.21 Virtualization: VT-x L1d cache: 32K L1i cache: 32K L2 cache: 256K L3 cache: 20480K NUMA node0 CPU(s): 0-7,16-23 NUMA node1 CPU(s): 8-15,24-31

NUMA commands

Image
numactl --hardware available: 2 nodes (0-1) node 0 cpus: 0 1 2 3 4 5 6 7 16 17 18 19 20 21 22 23 node 0 size: 131045 MB node 0 free: 34018 MB node 1 cpus: 8 9 10 11 12 13 14 15 24 25 26 27 28 29 30 31 node 1 size: 131072 MB node 1 free: 15748 MB node distances: node 0 1 0: 10 11 1: 11 10 [root@islpfdkvm12 ~]# free -mt total used free shared buffers cached Mem: 258451 208978 49472 0 309 141901 -/+ buffers/cache: 66768 191682 Swap: 9999 458 9541 Total: 268451 209436 59014 [root@islpfdkvm12 ~]# numastat node0 node1 numa_hit 155199455 157169588 numa_miss 18363861 35640093 numa_foreign 35640093 18363861 interleave_hit 57466 57452 local_node 155198395 157104460 other_node 18364921 35705221 [root@islpfdkvm12