I am testing a version of the cms-physics-lfv backpack that accesses data over XRootD rather than downloading locally. Some issues with XRootd that are handleable when launching this code from the command line prove fatal in the notebook case. For context, this notebook uses coffea with a TaskVineExecutor.
Server Busy
When reading thousands of files, often the XRootD connection will fail with the error No servers are available to read the file.
Missing Data
In some cases, the target data file exists but is empty. In coffea with TaskVine this produces an error like WARNING: task id 4 item pre_3 failed: output missing.
The high rate of messages from these warnings/errors can overflow the notebook and crash the kernel if one tries to expand the cell.
I am testing a version of the cms-physics-lfv backpack that accesses data over XRootD rather than downloading locally. Some issues with XRootd that are handleable when launching this code from the command line prove fatal in the notebook case. For context, this notebook uses coffea with a TaskVineExecutor.
Server Busy
When reading thousands of files, often the XRootD connection will fail with the error
No servers are available to read the file.Missing Data
In some cases, the target data file exists but is empty. In coffea with TaskVine this produces an error like
WARNING: task id 4 item pre_3 failed: output missing.The high rate of messages from these warnings/errors can overflow the notebook and crash the kernel if one tries to expand the cell.