Reggie
TTCTheo's Typesafe Cult
•Created by Reggie on 11/12/2024 in #questions
NextJS (on vercel) or TanStack start for performing a lot of requests (in a simple manner)
Hi y'all, I got the following scenario and am debating using NextJS (on vercel) or Tanstack start.
This is more of a demo/MVP use app, which needs to do the following: Having a table up to 1000 rows, it needs to execute an external call (to an LLM) for each row. Then, as each request (or every 5 requests) is done, show the result for each row in the table under a new column. The user should be able to interact with the UI in the meantime in a decent manner.
My worry is: If I use nextjs on Vercel and those requests on the server side would I run into pretty large bills? In that case am I better just using TanStack Start and do those requests on the client side in batches?
I expect at most around 100k requests done per day to the LLM.
I know I could also do the requests on the client side in Next as well, but that feels like working against it somehow 😅
2 replies