No output dir

[Dyadya-Sasha]

Hello everyone!

Created a test.yaml

cluster:
  user: "root"
  head: "cbt-head"
  clients: "client"
  osds: ["ceph1","ceph2","ceph3","ceph4"]
  mons:
    ceph1:
      ceph1: "192.168.122.211:3300"
    ceph2:
      ceph2: "192.168.122.201:3300"
    ceph3:
      ceph3: "192.168.122.244:3300"
  osds_per_node: 1
  iterations: 3
  use_existing: True
  clusterid: "793500f0-7e9a-11f0-b299-81453d2c0fc9"
  tmp_dir: "/tmp/cbt"
  ceph.conf: "/etc/ceph/ceph.conf"
    #  conf_file: "/etc/ceph/ceph.conf"
  pool_profiles:
    erasure:
      pg_size: 32
      pgp_size: 32
      replication: "erasure"
      erasure_profiles: "default"
benchmarks:
  radosbench:
    op_size: [ 4194304 ]
    write_only: True
    time: 120
    concurrent_ops: [ 128 ]
    concurrent_procs: 1
    use_existing: True
    pool_profile: "erasure"
    pool_per_proc: False
    target_pool: "test"
    readmode: "write"
      #    osd_ra: [131072]

in the end of the test it says

18:46:13 - DEBUG    - cbt      - CheckedPopen continue_if_error=False, shell=False args=pdsh -S -f 5 -R ssh -w root@ceph1,root@client,root@ceph4,root@ceph3,root@ceph2 sudo chown -R root.root /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000128/write/*
18:46:14 - DEBUG    - cbt      - CheckedPopen continue_if_error=False, shell=False args=rpdcp -f 10 -R ssh -w root@ceph1,root@client,root@ceph4,root@ceph3,root@ceph2 -r /tmp/cbt/00000000/Radosbench/osd_ra-00000000/op_size-04194304/concurrent_ops-00000128/write/* /root/cbt1/cbt/output/results/00000000/id-9813bfa7/write
18:46:14 - INFO     - cbt      - Convert results to json format.
18:46:14 - INFO     - cbt      - Results dir: /root/cbt1/cbt/output/results/00000001/id-80a4be27
18:46:14 - INFO     - cbt      - Results dir: /root/cbt1/cbt/output/results/00000002/id-b4a7cd2

but there are no 000001 and 000002 dirs

root@cbt-head:~/cbt1/cbt# ls /root/cbt1/cbt/output/results
00000000  cbt_config.yaml

and the second question is - how to post-process results??

I run python3 fio_common_output_wrapper.py --archive=/root/cbt/output/results/00000000/ and nothing happens. Visualization dir appears but empty

root@cbt-head:~/cbt1/cbt/tools# ll /root/cbt1/cbt/output/results/00000000/visualisation/
total 8
drwxr-xr-x 2 root root 4096 Aug 21 18:48 ./
drwxr-xr-x 4 root root 4096 Aug 21 18:48 ../

what do I do wrong?

thank you in advance for the help!

[wttgt]

Hi, I ran into the same problem. Have you managed to solve it? I found a few explanations with the help of AI tools, but I'm not sure if they're correct. The first one is that the issue with not being able to use common_output_wrapper to convert formats might be because the code can only check the first character of the json_out log suffix, but what it generates includes the client's IP, which makes it unable to match.