Versions Compared

Old Version 12

changes.mady.by.user Jason Stillerman

Saved on

compared with

New Version Current

changes.mady.by.user Matt Blumberg

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Note

If the following error appears when launching axolotl.cli.train: Error while finding module specification for 'axolotl.cli.train' (ModuleNotFoundError: No module named 'axolotl')

Run the following additional commands within the RunPod instance:
$ pip3 install -e '.[deepspeed]'
$ pip uninstall flash_attn

This is a workaround for a temporary problem that was encountered and should be resolved shortly, if not already.

...

This command will show a link with a gradio.live URL, which provides an interface to the model for testing inference. This is likely not sufficient for chatbook integration, but is robust enough to demonstrate functionality of the new expert.


Note: If you want to inference the using an alternative base model you can run the command without specifying a lora_model_dir. This will work for any base model. Aurora and Starcoder examples below:

...