Skip to content
View SulRash's full-sized avatar
35 followers · 26 following

Achievements

Achievement: Pair ExtraordinaireAchievement: YOLOAchievement: Pull Sharkx2Achievement: Quickdraw

Achievements

Achievement: Pair ExtraordinaireAchievement: YOLOAchievement: Pull Sharkx2Achievement: Quickdraw

Block or report SulRash

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
SulRash/README.md

Homepage

Pretraining language models :)

Pinned Loading

  1. AdaMLLab/tokenbeast AdaMLLab/tokenbeast Public

    Rust variant of tokenmonster with python hooks and bindings included

    Rust 2

  2. KellerJordan/modded-nanogpt KellerJordan/modded-nanogpt Public

    NanoGPT (124M) in 90 seconds

    Python 5.5k 825

  3. deepspeedai/Megatron-DeepSpeed deepspeedai/Megatron-DeepSpeed Public

    Forked from NVIDIA/Megatron-LM

    Ongoing research training transformer language models at scale, including: BERT & GPT-2

    Python 2.3k 367

  4. AnshulSood11/Engagement-Level-Prediction AnshulSood11/Engagement-Level-Prediction Public

    Engagement Intensity Prediction in Real TIme

    C++ 17 8

  5. EasyRogue-2 EasyRogue-2 Public

    EasyRogue reincarnated better!

    Python 1

  6. huggingface-text-data-analyzer huggingface-text-data-analyzer Public

    Analyzes text datasets from huggingface for training LLMs!

    Python 8