Code for the preprint https://arxiv.org/abs/2503.01819
-
Make executable using
chmod +x install.sh -
./install.sh -
conda env create -f environment.yaml -n FoR -
Activate conda env using
conda activate FoR -
Install some dependencies
pip install tensorboard -
Setup HF credentials using
huggingface-cli login --token <TOKEN> -
Run script using
nohup python3 main.pyornohup python3 prontoqa_train.py -
If facing rope scaling error
pip install -U transformers -
For evaluation change the variables
do_train=Falseanddo_test=Truein the scripts.