Issues

• Fix leaderboard webpage

  CLARIN-PL/embeddings#300 · Filter by author ktagowski opened on Sep 20, 2023

• Prepare converter from squad to beir

  CLARIN-PL/embeddings#294 · Filter by author laugustyniak opened on Aug 9, 2023
  1

  

• Add Inference Pipelines

  CLARIN-PL/embeddings#279 · Filter by author ktagowski opened on Jan 24, 2023

• Add default dataset info and dataset version if train subset is missing in HuggingFaceDataModule

  CLARIN-PL/embeddings#268 · Filter by author ktagowski opened on Sep 6, 2022
  

• Add mlflow logging

  CLARIN-PL/embeddings#260 · Filter by author laugustyniak opened on Aug 19, 2022
  

• Export HF models to ONNX format

  CLARIN-PL/embeddings#240 · Filter by author laugustyniak opened on May 13, 2022
  

• Prepare keyword extraction dataset

  CLARIN-PL/embeddings#211 · Filter by author ktagowski opened on Feb 10, 2022

• Refactor HPS pipeline

  CLARIN-PL/embeddings#209 · Filter by author djaniak opened on Feb 9, 2022 · [Milestone 4] Stable release
  1

• Implement caching for HPS

  enhancementtask
  CLARIN-PL/embeddings#208 · Filter by author djaniak opened on Feb 9, 2022 · [Milestone 2] First version of Polish NLP Benchmark

• Add example how to modify ConfigSpace parameters for hps

  documentation
  CLARIN-PL/embeddings#197 · Filter by author ktagowski opened on Feb 2, 2022 · [Milestone 2] First version of Polish NLP Benchmark

• Add keyword extraction task to library

  task
  CLARIN-PL/embeddings#196 · Filter by author ktagowski opened on Feb 2, 2022 · [Milestone 3] Extend leaderboard with more tasks and datasets

• Create hyperparameters configs for pipelines and adapt pipelines to use configs

  enhancement
  CLARIN-PL/embeddings#195 · Filter by author ktagowski opened on Feb 2, 2022 · [Milestone 4] Stable release
  

• Add option to configure catching exceptions and pbar in optuna based pipelines

  task
  CLARIN-PL/embeddings#189 · Filter by author ktagowski opened on Jan 27, 2022 · [Milestone 2] First version of Polish NLP Benchmark
  

• Add callback for lighting pipeline that traces best epoch

  model
  CLARIN-PL/embeddings#188 · Filter by author ktagowski opened on Jan 27, 2022 · [Milestone 2] First version of Polish NLP Benchmark
  

• Configure optional dependencies in pip

  enhancement
  CLARIN-PL/embeddings#183 · Filter by author ktagowski opened on Jan 21, 2022 · [Milestone 4] Stable release

• Shorten library imports

  enhancement
  CLARIN-PL/embeddings#181 · Filter by author ktagowski opened on Jan 21, 2022 · [Milestone 4] Stable release

• Add EarlyStopping callback for HPS

  enhancementmodel
  CLARIN-PL/embeddings#174 · Filter by author ktagowski opened on Jan 12, 2022 · [Milestone 2] First version of Polish NLP Benchmark
  

• Static embedding naming

  bug
  CLARIN-PL/embeddings#166 · Filter by author asawczyn opened on Jan 11, 2022 · [Milestone 2] First version of Polish NLP Benchmark

• Prepare benchmark submission evaluator

  benchmark dashboard
  CLARIN-PL/embeddings#163 · Filter by author ktagowski opened on Jan 10, 2022 · [Milestone 2] First version of Polish NLP Benchmark
  

• Add data cartography and cleanlab visualisations for trained models in our pipelines

  benchmark dashboarddatasetdocumentationhelp wantedwork in progress
  CLARIN-PL/embeddings#156 · Filter by author laugustyniak opened on Jan 6, 2022

• Add tiny transformer embedding model for testing instead of fully trained one

  good first issuemodel
  CLARIN-PL/embeddings#150 · Filter by author ktagowski opened on Dec 30, 2021 · [Milestone 4] Stable release

• Add dummy dataset for testing instead of subsampling scheme

  datasetgood first issue
  CLARIN-PL/embeddings#149 · Filter by author ktagowski opened on Dec 30, 2021 · [Milestone 4] Stable release

• Prepare instruction and example how to train and submit trained model to HF

  documentationenhancementgood first issue
  CLARIN-PL/embeddings#147 · Filter by author laugustyniak opened on Dec 29, 2021 · [Milestone 3] Extend leaderboard with more tasks and datasets

• Create example pipeline for static embeddings 

  good first issue
  CLARIN-PL/embeddings#146 · Filter by author laugustyniak opened on Dec 29, 2021 · [Milestone 3] Extend leaderboard with more tasks and datasets
  2

  

• Add tutorial on how to add a fine-tunable model for example Q&A

  good first issue
  CLARIN-PL/embeddings#145 · Filter by author laugustyniak opened on Dec 29, 2021 · [Milestone 3] Extend leaderboard with more tasks and datasets