Posts

NUMA mode with pci mapping

[root@islpfdkvm12 ~]# dmesg | grep -i numa NUMA: Allocated memnodemap from a000 - a140 NUMA: Using 31 for the hash shift. pci_bus 0000:00: on NUMA node 0 (pxm 0) pci_bus 0000:80: on NUMA node 1 (pxm 1)

pci details with CPU mapping

[root@islpfdkvm12 ~]# lspci | grep -i ether 06:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01) 06:00.1 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01) 06:00.2 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01) 06:00.3 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01) 1b:00.0 Ethernet controller: Intel Corporation 82580 Gigabit Network Connection (rev 01) 1b:00.1 Ethernet controller: Intel Corporation 82580 Gigabit Network Connection (rev 01) 1b:00.2 Ethernet controller: Intel Corporation 82580 Gigabit Network Connection (rev 01) 1b:00.3 Ethernet controller: Intel Corporation 82580 Gigabit Network Connection (rev 01) [root@islpfdkvm12 ~]# cat /sys/devices/pci0000\: pci0000:00/ pci0000:80/ [root@islpfdkvm12 ~]# cat /sys/devices/pci0000\:00/ 0000:00:00.0/ 0000:00:02.2/ 0000:00:04.0/ 0000:00:04.3/ 0000:00:04.6/ 0000:00:05.2/ 0000:00:1c.0/ 0000:00:1e.0/ 000...

Command to check CPU details

[root@islpfdkvm12 ~]# lscpu Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 32 On-line CPU(s) list: 0-31 Thread(s) per core: 2 Core(s) per socket: 8 Socket(s): 2 NUMA node(s): 2 Vendor ID: GenuineIntel CPU family: 6 Model: 45 Stepping: 7 CPU MHz: 1200.000 BogoMIPS: 5399.21 Virtualization: VT-x L1d cache: 32K L1i cache: 32K L2 cache: 256K L3 cache: 20480K NUMA node0 CPU(s): 0-7,16-23 NUMA node1 CPU(s): 8-15,24-31

NUMA commands

Image
numactl --hardware available: 2 nodes (0-1) node 0 cpus: 0 1 2 3 4 5 6 7 16 17 18 19 20 21 22 23 node 0 size: 131045 MB node 0 free: 34018 MB node 1 cpus: 8 9 10 11 12 13 14 15 24 25 26 27 28 29 30 31 node 1 size: 131072 MB node 1 free: 15748 MB node distances: node 0 1 0: 10 11 1: 11 10 [root@islpfdkvm12 ~]# free -mt total used free shared buffers cached Mem: 258451 208978 49472 0 309 141901 -/+ buffers/cache: 66768 191682 Swap: 9999 458 9541 Total: 268451 209436 59014 [root@islpfdkvm12 ~]# numastat node0 node1 numa_hit 155199455 157169588 numa_miss 18363861 35640093 numa_foreign 35640093 18363861 interleave_hit 57466 57452 local_node 155198395 157104460 other_node 18364921 35705221 [root@islpfdkvm12...

Linux Tools

Image

Processor types & locations

Processor types & locations [root@intels3e3601 node1]# cat /proc/cpuinfo processor : 0 <logical cpu #> physical id : 0 <socket #> siblings : 16 <logical cpus per socket> core id : 0 <core # in socket> cpu cores : 8 <physical cores per socket> # cat /sys/devices/system/node/node*/cpulist node0: 03 node1: 47 # cat /proc/cpuinfo |grep -i "processor\|processor id\|core\|sibling" processor       : 0 siblings        : 8 core id         : 0 cpu cores       : 4 processor       : 1 siblings        : 8 core id         : 1 cpu cores       : 4 processor       : 2 siblings        : 8 core id         : 2 cpu cores       : 4 processor       : 3 siblings        : 8 core id        ...

LVM volume path missed ...recovered vg volume path

[root@gfscluster1 ~]# ls -l /dev/vgvol/lv_brick1 ls: cannot access /dev/vgvol/lv_brick1: No such file or directory #lvdiskplay --- Logical volume --- LV Path /dev/vgvol/lv_brick1 LV Name lv_brick1 VG Name vgvol LV UUID xdWayg-cZMy-CsFG-KZR1-y1Ox-Ntgi-FMpET1 LV Write Access read/write LV Creation host, time gfscluster1, 2013-07-26 17:27:54 -0400 LV Status suspended # open 0 LV Size 65.00 GiB Current LE 16639 Segments 2 Allocation inherit Read ahead sectors auto - currently set to 256 Block device 253:3 Answer: [root@gfscluster1 lvm]# vgscan --mknode The link /dev/vgvol/lv_brick1 should had been created by udev but it was not found. Falling back to direct link creation. [root@gfscluster1 lvm]# ls -l /dev/vg vga_arbiter vgvol/ [root@gfscluster1 lvm]# ls -l /dev/vgvol/lv_brick1 lrwxrwxrw...