Backport AMD IBS raw-sample decoding and perf tooling updates to velinux v6.6

[mohanasv2]

Backport AMD IBS raw-sample decoding and perf tooling updates to velinux v6.6

Patch List:

1. perf/x86/amd/uncore: Use Node ID to identify DF and UMC domains
2. perf doc: Add AMD IBS usage document
3. perf amd ibs: Sync arch/x86/include/asm/amd-ibs.h header with the kernel
4. perf amd ibs: Add Load Latency bits in raw dump
5. perf amd ibs: Incorporate Zen5 DTLB and PageSize information
6. perf test: Add AMD IBS sw filter test
7. perf test: AMD IBS swfilt skip kernel tests if paranoia is >1
8. perf tool ibs: Sync AMD IBS header file
9. perf test ibs: Skip privilege test on Zen6 and newer platforms
10. perf amd ibs: Suppress bogus TlbRefillLat and DCPhysAd on Zen4+
11. perf amd ibs: Make Fetch status bits dependent on PhyAddrValid for newer platforms
12. perf amd ibs: Decode Remote-Socket flag in IBS OP raw dump
13. perf amd ibs: Decode Streaming-store flag in IBS OP raw dump
14. perf doc: Document new IBS capabilities in man page
15. perf vendor events amd: Update Zen 6 core events

Patch Series Overview:
• AMD IBS (Instruction-Based Sampling) is the hardware sampling facility on AMD processors. It tags individual fetch and load/store operations and reports detailed information about each one, such as cache and TLB behaviour, data source, page size and memory latency.
• The velinux 6.6 kernel already supports the newer IBS features exposed by recent AMD core generations. The perf tool in this tree does not, so that information cannot be requested from the hardware or read back from a recording.
• This series adds the missing tool-side support. perf can now filter by load latency, and can decode the newer DTLB and page-size fields, the remote-socket flag and the streaming-store flag. Fields that the hardware marks invalid are no longer printed as if they were real measurements. The series also adds an IBS selftest, an AMD IBS man page, and fixes in the core event tables where multiple FP stall events shared the same unit mask and could not be distinguished.
Key Bug Fixes:
• On newer cores, raw dumps printed TlbRefillLat and IbsDCPhysAd even when the address was invalid; these were meaningless values and are now suppressed.
• Fetch status bits were printed as zeros when PhyAddrValid was clear; those fields are now suppressed when invalid.
• Several FP non-squelched read-stall events on a newer core generation shared the same unit mask, so they could not be told apart; their unit masks have been corrected.
• Missing PMCx00C and PMCx00D unit masks have been added, and PMCx00A descriptions fixed.
• Uncore DF and UMC PMUs used Package ID, which is wrong on first-generation and multi-IOD parts; they now use Node ID.
• The swfilt test failed instead of skipping when perf_event_paranoid was above 1; it now skips appropriately.
• The swfilt test ran a privilege subtest that does not apply to the newest core generations; that subtest is now gated on hardware support.
Feature Additions:
• Decode the remote-socket flag (RmtSocket) in the IBS OP raw dump.
• Decode the streaming-store flag (StrmSt) in the IBS OP raw dump.
• Decode load-latency fields LdLatThrsh and LdLatEn.
• Decode the newer DTLB and DcPageSize information.
• Add a new AMD IBS software filtering selftest.
• Add a new perf-amd-ibs man page, plus documentation for ldlat, dtlb_pgsize, rmtsocket, strmst and fetchlat.
Logic and Consistency Improvements:
• Two header syncs keep the tool copy of the IBS register layout in step with the kernel.
• Decoding is gated on hardware validity bits and CPU family/model instead of being unconditional.
• Test skips are decided at runtime from paranoia level and hardware support.

Testing:

1. IBS PMU capabilities

  $ sudo  grep . /sys/bus/event_source/devices/ibs_op/caps/*
  /sys/bus/event_source/devices/ibs_op/caps/dtlb_pgsize:1
  /sys/bus/event_source/devices/ibs_op/caps/ldlat:1
  /sys/bus/event_source/devices/ibs_op/caps/rmtsocket:1
  /sys/bus/event_source/devices/ibs_op/caps/strmst:1
  /sys/bus/event_source/devices/ibs_op/caps/zen4_ibs_extensions:1

2. IBS selftests

  $ sudo perf test "AMD IBS"
   69: AMD IBS via core pmu                       : Ok
   71: AMD IBS software filtering                 : Ok

3. IBS OP raw dump decoding

  $ sudo perf record -e ibs_op/cnt_ctl=1,ldlat=128/ -c 100000 -a --raw-samples \
      -o ibs2.data -- sleep 2
  [ perf record: Woken up 1 times to write data ]
  [ perf record: Captured and wrote 1.260 MB ibs2.data (7 samples) ]

  $sudo  perf report -i ibs2.data -D          (backported)
  ibs_op_ctl:	8000032f000e186a MaxCnt    100000 L3MissOnly 0 En 1 Val 1 CntCtl 1=uOps CurCnt       815 LdLatThrsh  0 LdLatEn 1
  IbsOpRip:	<kernel-addr>
  ibs_op_data:	0000000001fa0002 CompToRetCtr     2 TagToRetCtr   506 BrnRet 0  RipInvalid 0 BrnFuse 0 Microcode 0
  ibs_op_data2:	0000000000000003 RmtSocket 0 StrmSt 0 RmtNode 0 DataSrc 3=DRAM
  ibs_op_data3:	000001d614d700a1 LdOp 1 StOp 0 DcL1TlbMiss 0 DcL2TlbMiss 0 DcPageSize   1G DcMiss 1 DcMisAcc 0 DcWcMemAcc 0 DcUcMemAcc 0 DcLockedOp 0 DcMissNoMabAlloc 1 DcLinAddrValid 1 DcPhyAddrValid 1 L2Miss 1 SwPf 0 OpMemWidth  4 bytes OpDcMissOpenMemReqs  5 DcMissLat   470 TlbRefillLat     0
  IbsDCLinAd:	<kernel-addr>
  IbsDCPhysAd:	<phys-addr>

  $ sudo  perf-base report -i ibs2.data -D     (baseline, same file)
  ibs_op_ctl:	8000032f000e186a MaxCnt    100000 L3MissOnly 0 En 1 Val 1 CntCtl 1=uOps CurCnt       815
  IbsOpRip:	<kernel-addr>
  ibs_op_data:	0000000001fa0002 CompToRetCtr     2 TagToRetCtr   506 BrnRet 0  RipInvalid 0 BrnFuse 0 Microcode 0
  ibs_op_data2:	0000000000000003 RmtNode 0 DataSrc 3=DRAM
  ibs_op_data3:	000001d614d700a1 LdOp 1 StOp 0 DcL1TlbMiss 0 DcL2TlbMiss 0 DcL1TlbHit2M 0 DcL1TlbHit1G 1 DcL2TlbHit2M 0 DcMiss 1 DcMisAcc 0 DcWcMemAcc 0 DcUcMemAcc 0 DcLockedOp 0 DcMissNoMabAlloc 1 DcLinAddrValid 1 DcPhyAddrValid 1 DcL2TlbHit1G 0 L2Miss 1 SwPf 0 OpMemWidth  4 bytes OpDcMissOpenMemReqs  5 DcMissLat   470 TlbRefillLat     0
  IbsDCLinAd:	<kernel-addr>
  IbsDCPhysAd:	<phys-addr>

  field occurrences across the whole dump:
    LdLatThrsh    baseline=0      backported=7
    LdLatEn       baseline=0      backported=7
    RmtSocket     baseline=0      backported=7
    StrmSt        baseline=0      backported=7
    DcPageSize    baseline=0      backported=7
    DcL1TlbHit2M  baseline=7      backported=0

4. IBS FETCH raw dump decoding

  $ sudo perf record -e ibs_fetch// -c 100000 -a --raw-samples \
      -o ibsfetch.data -- sleep 1
  [ perf record: Woken up 1 times to write data ]
  [ perf record: Captured and wrote 1.275 MB ibsfetch.data (237 samples) ]

  $ sudo perf-base report -i ibsfetch.data -D    (baseline, PhyAddrValid 0 sample)
  ibs_fetch_ctl:	00230000186a186a MaxCnt  100000 Cnt  100000 Lat     0 En 1 Val 1 Comp 0 IcMiss 0 PhyAddrValid 0 L1TlbMiss 0 L2TlbMiss 0 RandEn 0 L3MissOnly 0 FetchOcMiss 0 FetchL3Miss 0

  $sudo perf report -i ibsfetch.data -D         (backported, same sample)
  ibs_fetch_ctl:	00230000186a186a MaxCnt  100000 Cnt  100000 En 1 Val 1 Comp 0 PhyAddrValid 0 RandEn 0 L3MissOnly 0

5. Load latency sweep

  for l in 128 256 512 1024 2048; do
  perf record -e ibs_op/cnt_ctl=1,ldlat=$l/ -c 1000 -a --raw-samples \
      -o l.data -- sleep 4
     perf report -i l.data -D
   done

  ldlat  128 ->  LdLatThrsh  0 LdLatEn 1   (252338 samples)
  ldlat  256 ->  LdLatThrsh  1 LdLatEn 1   (64348 samples)
  ldlat  512 ->  LdLatThrsh  3 LdLatEn 1   (6360 samples)
  ldlat 1024 ->  LdLatThrsh  7 LdLatEn 1   (1442 samples)
  ldlat 2048 ->  LdLatThrsh 15 LdLatEn 1   (76 samples)

6. Remote-socket flag

  $sudo  perf record -e ibs_op/cnt_ctl=1/ -c 50000 --raw-samples -- \
      numactl --cpunodebind=0 --membind=<remote-node> \
      ibs-workload chase 512 40000000        (remote socket)
      RmtSocket 1:    1882
      RmtSocket 0:    73076
      DataSrc 3=DRAM: 1883

  $sudo perf record -e ibs_op/cnt_ctl=1/ -c 50000 --raw-samples -- \
      numactl --cpunodebind=0 --membind=<local-node> \
      ibs-workload chase 512 40000000        (control, same socket)
      RmtSocket 1:    1
      RmtSocket 0:    43487
      DataSrc 3=DRAM: 1199

7. Streaming-store flag

  $sudo  perf record -e ibs_op/cnt_ctl=1/ -c 50000 --raw-samples -- \
      ibs-workload nts                       (MOVNTI non-temporal stores)
      StrmSt 1:       6437
      StrmSt 0:       22742

  $sudo perf record -e ibs_op/cnt_ctl=1/ -c 50000 --raw-samples -- \
      ibs-workload chase                     (control, load only)
      StrmSt 1:       0
      StrmSt 0:       42767

  bit-level audit over every distinct ibs_op_data2 value seen above:
      distinct values: 14   RmtSocket(bit9) violations: 0   StrmSt(bit8) violations: 0

8. Core event table fix

  $sudo perf-base stat -e fp_nsq_read_stalls.fp_prf,fp_nsq_read_stalls.k_prf,\
      fp_nsq_read_stalls.fp_sq -- ibs-workload chase 256 20000000   (pre-fix table)
   Performance counter stats for 'ibs-workload chase 256 20000000':
               1,513      fp_nsq_read_stalls.fp_prf
               1,513      fp_nsq_read_stalls.k_prf
               1,513      fp_nsq_read_stalls.fp_sq
         2.223209762 seconds time elapsed

  $sudo perf stat -e fp_nsq_read_stalls.fp_prf,fp_nsq_read_stalls.k_prf,\
      fp_nsq_read_stalls.fp_sq -- ibs-workload chase 256 20000000   (post-fix table)
   Performance counter stats for 'ibs-workload chase 256 20000000':
                   0      fp_nsq_read_stalls.fp_prf
                   0      fp_nsq_read_stalls.k_prf
               1,110      fp_nsq_read_stalls.fp_sq
         2.216135300 seconds time elapsed