erstfeld
MModular
•Created by LunaTheEquinoctialCat on 10/1/2023 in #questions
how to make an ai
QLoRA quantizes the larger models making them significantly easier to run / use, but not for training, though im not sure how this translates to finetuning
8 replies
MModular
•Created by LunaTheEquinoctialCat on 10/1/2023 in #questions
how to make an ai
i havent done it myself, so im not too much of use but go on youtube and figure out how to load very small pretrained models first, then use QLoRA to load in larger models
8 replies
MModular
•Created by LunaTheEquinoctialCat on 10/1/2023 in #questions
how to make an ai
@LunaTheEquinoctialCat as in make / train your own custom model or use a pretrained one ?
8 replies