Move megatron conversion script and add rope arguments - #24

Open

loubnabnl wants to merge 5 commits into

sc2-ablationsfrom

conevrt-megatron-rope

Commits on Nov 13, 2023

add model
loubnabnl
committed
5ad0742
Update src/transformers/models/gpt_bigcode/convert_megatron_checkpoint.py

loubnabnl
and
RaymondLi0
authored
b2d84f5
import math
loubnabnl
committed
c144d9e
apply raymond's suggestion/megatron's rope
loubnabnl
committed
1c243ba
add antother example to the test
loubnabnl
committed
fd0fbef