Skip to content

Capture node usage metadata in Biosense Platform #26

Description

@emjavan

Current parameter file requests half the available nodes, so we'd like to capture:

  • how many nodes were used
  • how long the total job took
  • what time of day the job began
  • total MC simulations run
  • volume of ED count data used
  1. The above information should be written to a separate metadata dir for all jurisdictions, so we can compile a summary report on compute power and time expectations. Parallel or future R packages are likely best for this.
  2. cronR for macOS/Linux will also produce a script-name.log file of the script run in that dir. We should move these .log files with date they were created to the metadata dir as well
  3. taskscheduleR for Windows doesn't create log file so it may be best to always capture stderr and stdout for even jobs not scheduled

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions