𝓕𝓻𝓲𝓮𝓷𝓭𝓵𝔂 💖 𝓣𝔂𝓻𝓮𝓼𝓮 Posts

𝓕𝓻𝓲𝓮𝓷𝓭𝓵𝔂 💖 𝓣𝔂𝓻𝓮𝓼𝓮

•Created by 𝓕𝓻𝓲𝓮𝓷𝓭𝓵𝔂 💖 𝓣𝔂𝓻𝓮𝓼𝓮 on 2/21/2024 in #⚡｜serverless

I'm using SDXL serverless endpoint and sometimes I get an error.

error message is this:

RuntimeError: expected scalar type Float but found Half, Stack Trace: <traceback object at 0x7f779ace2a00>

RuntimeError: expected scalar type Float but found Half, Stack Trace: <traceback object at 0x7f779ace2a00>

4 replies

•Created by 𝓕𝓻𝓲𝓮𝓷𝓭𝓵𝔂 💖 𝓣𝔂𝓻𝓮𝓼𝓮 on 2/13/2024 in #⛅｜pods

How can I deploy Mixtral using Ollama as service?

Hi everyone! I want deploy mixtral 7x8b model using ollama on runpod, but I can't install it as service using runpod desktop template. Plz help me!

4 replies