Issues

• Tests for new model

  qcri/LLMeBench#298 · Filter by author MaramHasanain opened on May 16, 2024
  

• Issue with OSACT4SubtaskB dataset loading

  qcri/LLMeBench#294 · Filter by author AridHasan opened on May 13, 2024

• Locally saved model

  qcri/LLMeBench#251 · Filter by author Muhammad-Elmallah opened on Dec 21, 2023
  1

• Extended experiment configuration backup

  enhancement
  qcri/LLMeBench#212 · Filter by author MaramHasanain opened on Sep 11, 2023
  

• Defining a large dataset with several splits under it

  enhancement
  qcri/LLMeBench#199 · Filter by author MaramHasanain opened on Sep 4, 2023
  1

  

• Allow framework to accept list of assets to run

  enhancement
  qcri/LLMeBench#192 · Filter by author MaramHasanain opened on Aug 31, 2023
  

• NewsCategorization BLOOM assets post-processing

  qcri/LLMeBench#160 · Filter by author fdalvi opened on Aug 9, 2023

• Location and NameInfo BLOOMz assets

  qcri/LLMeBench#159 · Filter by author fdalvi opened on Aug 9, 2023

• automate the collection of experiment results

  enhancement
  qcri/LLMeBench#145 · Filter by author bsabri opened on Jun 25, 2023
  

• BLOOM assets that seem to output the same class

  qcri/LLMeBench#113 · Filter by author fdalvi opened on Jun 20, 2023

• max_tries should be a runtime argument

  enhancement
  qcri/LLMeBench#112 · Filter by author fdalvi opened on Jun 20, 2023
  

• STS task improvements

  qcri/LLMeBench#110 · Filter by author fdalvi opened on Jun 20, 2023

• FactualityCOVID19 Fewshot postprocessor always results in "no"

  qcri/LLMeBench#107 · Filter by author fdalvi opened on Jun 19, 2023
  

• Checkworthiness Few shot processing

  qcri/LLMeBench#105 · Filter by author fdalvi opened on Jun 19, 2023
  

• Parsing NER task

  qcri/LLMeBench#61 · Filter by author fdalvi opened on Jun 14, 2023
  1

• Better post processing parsing in QADI_ChatGPT_ZeroShot

  qcri/LLMeBench#59 · Filter by author fdalvi opened on Jun 14, 2023
  

• Keep track of inference time

  enhancement
  qcri/LLMeBench#53 · Filter by author MaramHasanain opened on Jun 13, 2023
  

• Some generic way to get Random baseline

  qcri/LLMeBench#49 · Filter by author fdalvi opened on Jun 13, 2023
  

• Extracting information from Content warning failures

  qcri/LLMeBench#48 · Filter by author fdalvi opened on Jun 13, 2023

• Cache is used across models

  bug
  qcri/LLMeBench#12 · Filter by author fdalvi opened on Jun 5, 2023