niroknox Comments - Answer Overflow

and i am actually doing a project with one of their competitors but they dont have serverless and runpod's sdk is easy simple and they are ahead of the game.

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

I LOVE runpod.

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

i am still new to this, i aim to learn every tiny bit of this - it's the only way to empower and use the most out of it. serverless is brilliant! allows a business to grow 🙂 normal 4090 on the cloud is like 2k monthly.

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

yeah thats good since a generation can get stuck and charge me an arm and a leg: )

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

yes, can not set that.. unless i hack into their core system and find that parameter hahah

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

exactlly. i wonder if the flashboot reset time can be adjusted, i recall seeing something

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

well, logically it is but it could be a VLAN.. u never know with these things.. i am originally a TCP networks and routing engineer, been around many datacenters..

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

am i missing something?

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

i only use 1 model each time. and total only have 2. the issue is even if i dont unload it, the container when it moves to idle its still there but after 2 minutes or so, the containers refresh or something.. not sure how it works exactly but i noticed if i queue loads of jobs it works faster as it does not unload but if i wait 5 minutes between each request, the container worker 'forgets' and needs to reload

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

YEah, so this will be great for later, this way they will be reserved for me too i can grab all the H100 i need over time

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

i think since the datacenter is most likely an outsourced one, we can't trust it's a real LAN.. 1GB speed etc.. so even though its local, there is 2-3 min to transfer the file each time, seems like overkill

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

not many people on the app yet.

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

seems good in terms of performance but might not be smart to do at the start as my demand is still very low

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

So i need to ensure it is faster. also do you know what does the 'always active' option is on serverless? is that like a pod? always on, always charging?

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

yeah people already complaining that sometimes its 20 sceonds and sometimes 4 minutes 🙂

56 replies

RRunPod

•Created by niroknox on 1/3/2025 in #⚡｜serverless

Recommended DC and Container Size Limits/Costs

Sure, I will try and report back 🙂 and it will be the first time I am useful to others on a discord channel haha 🙂

56 replies

Gaming

Programming