Page History

If the following error appears when launching axolotl.cli.train: Error while finding module specification for 'axolotl.cli.train' (ModuleNotFoundError: No module named 'axolotl')

Run the following additional commands within the RunPod instance:
{{$ pip3 install -e '.[deepspeed]'}}
{{$ pip uninstall flash_attn}}

This is a workaround for a temporary problem that was encountered and should be resolved shortly, if not already.

If you want to inference the base model you can run the command without specifying a lora_model_dir. This will work for any base model. Aurora and Starcoder examples below:

• $ accelerate launch -m axolotl.cli.inference examples/aurora/experiment1.yml --gradio # this will inference aurora 
• $ accelerate launch -m axolotl.cli.inference examples/starcoder/lora.yml --gradio # this will inference starcoder