Michael Retchin
Michael Retchin
RRailway
Created by Michael Retchin on 10/17/2023 in #✋|help
Help deploying ChromaDB in production?
well then, I very much appreciate all your uncompensated labor. I hope you get some joy out of it.
23 replies
RRailway
Created by Michael Retchin on 10/17/2023 in #✋|help
Help deploying ChromaDB in production?
https://github.com/chroma-core/chroma/issues/1204 It was this. Client-server mismatch. I had to load a new docker image. The one-click deploy Chroma docker image that you have is 0.4.5. Latest version is 0.4.15. I'd suggest changing it from a hardcoded version to the dockerhub chromadb, which is just chromadb/chroma. So that other people don't fall into this same issue.
23 replies
RRailway
Created by Michael Retchin on 10/17/2023 in #✋|help
Help deploying ChromaDB in production?
thanks again for superhuman response time
23 replies
RRailway
Created by Michael Retchin on 10/17/2023 in #✋|help
Help deploying ChromaDB in production?
(not my actual password)
23 replies
RRailway
Created by Michael Retchin on 10/17/2023 in #✋|help
Help deploying ChromaDB in production?
Okay, I spoke too soon.
import chromadb
from chromadb import Settings

client = chromadb.HttpClient(
host='chroma-production-myspecialurl.up.railway.app',
port='443',
ssl=True,
settings=Settings(allow_reset=True, anonymized_telemetry=False),
headers={'authorization': 'PASS'}
)

from chromadb.utils import embedding_functions

embedding_fn = embedding_functions.SentenceTransformerEmbeddingFunction(
model_name='BAAI/bge-base-zh-v1.5'
)

collection = client.get_or_create_collection(
"demo",
embedding_function=embedding_fn
)
import chromadb
from chromadb import Settings

client = chromadb.HttpClient(
host='chroma-production-myspecialurl.up.railway.app',
port='443',
ssl=True,
settings=Settings(allow_reset=True, anonymized_telemetry=False),
headers={'authorization': 'PASS'}
)

from chromadb.utils import embedding_functions

embedding_fn = embedding_functions.SentenceTransformerEmbeddingFunction(
model_name='BAAI/bge-base-zh-v1.5'
)

collection = client.get_or_create_collection(
"demo",
embedding_function=embedding_fn
)
This all works fine, and I'm able to do things like collection.count() But when I try to add docs, it throws a 404.
collection.add(
documents=documents[:10],
metadatas=metadata[:10],
ids=ids[:10],
)
collection.add(
documents=documents[:10],
metadatas=metadata[:10],
ids=ids[:10],
)
Result:
HTTPError: 404 Client Error: Not Found for url: https://chroma-production-9aba.up.railway.app:443/api/v1/pre-flight-checks

...

Exception: {"detail":"Not Found"}
HTTPError: 404 Client Error: Not Found for url: https://chroma-production-9aba.up.railway.app:443/api/v1/pre-flight-checks

...

Exception: {"detail":"Not Found"}
23 replies
RRailway
Created by Michael Retchin on 10/17/2023 in #✋|help
Help deploying ChromaDB in production?
It works!
23 replies
RRailway
Created by Michael Retchin on 10/17/2023 in #✋|help
Help deploying ChromaDB in production?
incredibly helpful
23 replies
RRailway
Created by Michael Retchin on 10/17/2023 in #✋|help
Help deploying ChromaDB in production?
thank you!
23 replies