Vectorize feedback

Hey there! Vectorize has been out a month now. We'd love your feedback if you have some that you haven't shared yet. What's good, what's bad, what could be better, we take it all.

JeromeOP•11/10/23, 2:42 PM

If you answer, please do in this thread MeowHeartCloudflare

zegevlier•11/10/23, 2:51 PM

I've only used it for https://superspeare.cloudflare.community, but we didn't have any problems with it during that project. I really liked how easy it was to make an index compatible with the models on workers AI. The only issue we encountered was that you couldn't get the metadata without also fetching the vectors, but I believe this has since been added.

JeromeOP•11/10/23, 3:08 PM

@zegevlier very nice tool

https://superspeare.cloudflare.community/?query=awesome

AndrewMayne•11/11/23, 3:11 AM

The biggest blocker for me is not being able to sort and filter vectors by metadata.

stukennedy•11/11/23, 8:09 PM

does it run locally in development? or only on a deployed worker?

Old Man Maker•11/12/23, 3:47 AM

The key here is scale with simplicity. I love that we dont have to think about replication strategies and it all just works. I think that should actually be the biggest part of the message you sent out to folks. Super impressed thus far - congrats team!

Sstukennedy does it run locally in development? or only on a deployed worker?

huw•11/12/23, 11:25 AM

No local dev yet

huw•11/12/23, 11:26 AM

My biggest piece of feedback would be for CF to launch all new features in a way that calls out to remote services in local dev (like how preview KVs work). I don’t wanna have to switch to remote dev or hook up my own services just to adopt a new feature.

dook•11/13/23, 3:16 AM

Would love to be able to try it out for our use case but the current TopK limit is way too small

huw•11/13/23, 4:48 AM

I’d also like pagination on the top K query—if a result in the top K isn’t suitable, it would nice to be able to fetch the K+1st result without computing the original K

AAndrewMayne The biggest blocker for me is not being able to sort and filter vectors by metad...

JeromeOP•11/13/23, 2:23 PM

We're working on it

Sstukennedy does it run locally in development? or only on a deployed worker?

JeromeOP•11/13/23, 2:24 PM

it does not run locally (no simulator); it uses edge preview for wrangler dev

Ddook Would love to be able to try it out for our use case but the current TopK limit ...

JeromeOP•11/13/23, 2:26 PM

@dook.dook what value of topK limit would fit your use case?

huw•11/13/23, 9:52 PM

Oh and one more—just easier ways to manage vectors in bulk, things like a endpoint with similar filtering to the query endpoint

JJerome @dook.dook what value of topK limit would fit your use case?

dook•11/13/23, 10:11 PM

We're using it for semantic search so ideally as high as possible in prod. I think our max results top out at like ~300 at the moment. But for testing like 50 - 100 would be great. Cheers!