Bite-Timing Prediction for Robot-Assisted Feeding in a Social Dining Setting

Code & data organization

• data
  [reflects the Box “data” folder;
  not pushed to GitHub;
  to keep consistency between our setups;
  this will be published to Harvard Dataverse ]
  • bag
  • annotation
  • questionnaires
  • documentation-pictures
  • bag-extraction-scripts [to extract raw data from bag to the “raw” subfolder]
  • README.md [needs to be updated!]
  • raw [raw data extracted from bag files]
    • audio
    • video
    • depth
    • …
  • processed [data pre-processed from raw data]
    • visual-features
      • openpose
      • openface
      • resnet
      • rt-gene
      • i3d
      • …
    • audio-features
      • binary-speaking
      • sound-direction
      • mfcc
      • logfb
      • log-mel
      • …
    • timing-features
      • last-lifted-times
      • last-to-mouth-times
      • …
• src
  • preprocessing
    [feature extraction scripts to obtain data in data/processed from data/raw]
  • analysis [data analysis, statistics, visualizations]
  • dataset [dataset loader script; load variations of modalities]
  • models [all ML-related]
    • model1
    • model2
    • …