The "Fine tune an LLM with Axolotl on RunPod" tutorial should mention uploading public key first
The tutorial is very useful, but would be even more so if it mentioned that to "connect to it over secure SSH", you have to provide your SSH public key beforehand so the created image will have it for you to make the first connection. That would help it further to be a self-contained article for this use case
Fine tune an LLM with Axolotl on RunPod | RunPod Documentation
Learn how to fine-tune large language models with Axolotl on RunPod, a streamlined workflow for configuring and training AI models with GPU resources, and explore examples for LLaMA2, Gemma, LLaMA3, and Jamba.
0 Replies