Is there a way to dynamically add Vectorize bindings programatically?

18 Replies

YotaOP•5mo ago

ah i found it https://developers.cloudflare.com/vectorize/best-practices/create-indexes/ Hmmm, but these don't seem to be enough number for my use-case Indexes per account 50,000 (Workers Paid)

Unknown User•5mo ago

Message Not Public

EndiM•5mo ago

This issue is happening from : 2024-10-25T14:36:55.873Z whatever improvement was made on this date, caused this to break. Triggering it from binding or api, even tho the call return succees true, it actually does nothing on the index. No delete, no insert, no upset

yevgen•5mo ago

Nothing should have caused such issues, let me check with the team, it could be delayed as most of the team is in US time zone.

EndiM•5mo ago

Thanks for getting back! Okay thank you.

yevgen•5mo ago

📢 Vectorize update: 2024-10-30: Vectorize has local mode support in Wrangler @3.84.0 https://github.com/cloudflare/workers-sdk/releases/tag/wrangler%403.84.0

GitHub

Release [email protected] · cloudflare/workers-sdk

Minor Changes #6999 0111edb Thanks @garvit-gupta! - docs: Vectorize GA Announcement Banner #6916 a33a133 Thanks @garrettgu10! - Local development now supports Vectorize bindings #7004 15ef013...

Samko•5mo ago

api idea - It would be great to have method for get/delete (all)vectors by namespace mainly delete use-case would be very helpful - in my case I have namespace for every "project" and I would like an easy way to clean-up.

ac•5mo ago

I am noticing a large number of AiError: 3001: Unknown internal error s when doing some Vectorize queries. Is there any way to get more insight into what these are? I have no clue if it's not finding a vector by ID, if I'm getting rate limited, or if it's something I can't control

thousandmiles•4mo ago

I've been browsing through messages in the past and documentations on vectorize, looks like now it's a great time to jump in, considering the beta release of workflow as well. though my concern is full RAG pipeline still needs a long way to go, so I'd prefer develop locally using llamaindex+chromadb(or equivalent)+litellm(embedding, inference, rerank, whisper, etc) first, before switching to cloudflare edge side completely, which I do need at a certain point because the product I am building requires global coverage. may I ask guy who already had previous experiences here, that, is this a viable plan, or anything I should keep in mind for choosing tech stack or develop or doing gitops? thanks a million!

Rubi•4mo ago

Hi, is Cloudflare Vectorize now support $in metadata filter ?

Unknown User•4mo ago

Message Not Public

yevgen•4mo ago

📢 Vectorize update: Added support for $in and $nin metadata filters https://developers.cloudflare.com/vectorize/platform/changelog/

Cloudflare Docs

Changelog | Vectorize

Unknown User•4mo ago

Message Not Public

CedricHadjian•4mo ago

How can I see what vectors I have in my index? I checked the commands I could run, and none mentioned showing the vectors I got in my index. I want to be able to delete and test stuff before I run the actual thing. Any guidance would be appreciated.

Unknown User•4mo ago

Message Not Public

momegas•4mo ago

Hello, Quick question, I get really slow response times in Vectorise. Like seconds of response time. My code is very simple, so nothing else should be slowing it down. I am in Greece btw, so not sure if that plays a role. I get the same speeds when deploying the worker.

  }),
  async (c) => {
    const text = "XXX";
    const e = await embedText(c, text);
    const r = await c.env.VECTORIZE.query(e, {
      topK: 5,
      returnValues: false,
      returnMetadata: "none",
    });

    return c.json({ matches: r.matches });
  }
);

  }),
  async (c) => {
    const text = "XXX";
    const e = await embedText(c, text);
    const r = await c.env.VECTORIZE.query(e, {
      topK: 5,
      returnValues: false,
      returnMetadata: "none",
    });

    return c.json({ matches: r.matches });
  }
);

Isaac McFadyen•4mo ago

@Kingsley Michael I removed your message as this is the channel for #vectorize, please use #off-topic for anything unrelated to Cloudflare products

odysseus•4mo ago

The limits page says that there's a maximum of 5,000,000 vectors per index, but I'm getting a 4002 error when attempting to upsert past 240,000. any idea why or things I should change? EDIT: RESOLVED, I was using V1 instead of V2

Gaming

Programming

Is there a way to dynamically add Vectorize bindings programatically?

Did you find this page helpful?