Is there a way to dynamically add Vectorize bindings programatically?

18 Replies

YotaOP•3mo ago

ah i found it https://developers.cloudflare.com/vectorize/best-practices/create-indexes/ Hmmm, but these don't seem to be enough number for my use-case Indexes per account 50,000 (Workers Paid)

Unknown User•3mo ago

Message Not Public

EndiM•3mo ago

This issue is happening from : 2024-10-25T14:36:55.873Z whatever improvement was made on this date, caused this to break. Triggering it from binding or api, even tho the call return succees true, it actually does nothing on the index. No delete, no insert, no upset

yevgen•3mo ago

Nothing should have caused such issues, let me check with the team, it could be delayed as most of the team is in US time zone.

EndiM•3mo ago

Thanks for getting back! Okay thank you.

yevgen•3mo ago

📢 Vectorize update: 2024-10-30: Vectorize has local mode support in Wrangler @3.84.0 https://github.com/cloudflare/workers-sdk/releases/tag/wrangler%403.84.0

GitHub

Release [email protected] · cloudflare/workers-sdk

Minor Changes #6999 0111edb Thanks @garvit-gupta! - docs: Vectorize GA Announcement Banner #6916 a33a133 Thanks @garrettgu10! - Local development now supports Vectorize bindings #7004 15ef013...

Unknown User•3mo ago

Message Not Public

ac•3mo ago

I am noticing a large number of AiError: 3001: Unknown internal error s when doing some Vectorize queries. Is there any way to get more insight into what these are? I have no clue if it's not finding a vector by ID, if I'm getting rate limited, or if it's something I can't control

thousandmiles•3mo ago

I've been browsing through messages in the past and documentations on vectorize, looks like now it's a great time to jump in, considering the beta release of workflow as well. though my concern is full RAG pipeline still needs a long way to go, so I'd prefer develop locally using llamaindex+chromadb(or equivalent)+litellm(embedding, inference, rerank, whisper, etc) first, before switching to cloudflare edge side completely, which I do need at a certain point because the product I am building requires global coverage. may I ask guy who already had previous experiences here, that, is this a viable plan, or anything I should keep in mind for choosing tech stack or develop or doing gitops? thanks a million!

Rubi•3mo ago

Hi, is Cloudflare Vectorize now support $in metadata filter ?

Unknown User•3mo ago

Message Not Public

yevgen•3mo ago

📢 Vectorize update: Added support for $in and $nin metadata filters https://developers.cloudflare.com/vectorize/platform/changelog/

Cloudflare Docs

Changelog | Vectorize

Unknown User•3mo ago

Message Not Public

CedricHadjian•3mo ago

How can I see what vectors I have in my index? I checked the commands I could run, and none mentioned showing the vectors I got in my index. I want to be able to delete and test stuff before I run the actual thing. Any guidance would be appreciated.

Unknown User•3mo ago

Message Not Public

momegas•2mo ago

Hello, Quick question, I get really slow response times in Vectorise. Like seconds of response time. My code is very simple, so nothing else should be slowing it down. I am in Greece btw, so not sure if that plays a role. I get the same speeds when deploying the worker.

  }),
  async (c) => {
    const text = "XXX";
    const e = await embedText(c, text);
    const r = await c.env.VECTORIZE.query(e, {
      topK: 5,
      returnValues: false,
      returnMetadata: "none",
    });

    return c.json({ matches: r.matches });
  }
);

  }),
  async (c) => {
    const text = "XXX";
    const e = await embedText(c, text);
    const r = await c.env.VECTORIZE.query(e, {
      topK: 5,
      returnValues: false,
      returnMetadata: "none",
    });

    return c.json({ matches: r.matches });
  }
);

Isaac McFadyen•2mo ago

@Kingsley Michael I removed your message as this is the channel for #vectorize, please use #off-topic for anything unrelated to Cloudflare products

odysseus•2mo ago

The limits page says that there's a maximum of 5,000,000 vectors per index, but I'm getting a 4002 error when attempting to upsert past 240,000. any idea why or things I should change? EDIT: RESOLVED, I was using V1 instead of V2

Gaming

Programming

Is there a way to dynamically add Vectorize bindings programatically?

Did you find this page helpful?