lil_xiang

PostsComments

RRunPod

•Created by lil_xiang on 8/27/2024 in #⛅｜pods

Does the pod hardware differ a lot in US?

cool，thank！ i'll create one

20 replies

RRunPod

•Created by lil_xiang on 8/27/2024 in #⛅｜pods

Does the pod hardware differ a lot in US?

where to create ticket?

20 replies

RRunPod

•Created by lil_xiang on 8/27/2024 in #⛅｜pods

Does the pod hardware differ a lot in US?

yes, have another problem, but still don't know root cause, i see some memory benchamrk difference on slow and fast pod in US

20 replies

RRunPod

•Created by lil_xiang on 8/27/2024 in #⛅｜pods

Does the pod hardware differ a lot in US?

but now the point is we see inference performance difference in different pods in US,

20 replies

RRunPod

•Created by lil_xiang on 8/27/2024 in #⛅｜pods

Does the pod hardware differ a lot in US?

i'm not using network volume, i just create pod from runpod cli and pass in arg "US"

20 replies

RRunPod

•Created by lil_xiang on 8/27/2024 in #⛅｜pods

Does the pod hardware differ a lot in US?

Hi runpod, we really need your help, it's severely affecting our inference performance

20 replies

RRunPod

•Created by lil_xiang on 8/27/2024 in #⛅｜pods

Does the pod hardware differ a lot in US?

is it possible that the busy cpu on host instance (maybe from other containers in the same instance), causes high memory contention and thus slow down the memory speed

20 replies

RRunPod

•Created by lil_xiang on 8/27/2024 in #⛅｜pods

Does the pod hardware differ a lot in US?

maybe the difference is because the host VM cpu usage, i thinks the memory benchmark results proved the performance difference of my programs on two pods

20 replies

RRunPod

•Created by lil_xiang on 8/27/2024 in #⛅｜pods

Does the pod hardware differ a lot in US?

the load average and user time shows big differences, when they have same processes environments (infernece program stopped)

20 replies

RRunPod

•Created by lil_xiang on 8/27/2024 in #⛅｜pods

Does the pod hardware differ a lot in US?

20 replies

RRunPod

•Created by lil_xiang on 8/27/2024 in #⛅｜pods

Does the pod hardware differ a lot in US?

20 replies

RRunPod

•Created by lil_xiang on 8/27/2024 in #⛅｜pods

Does the pod hardware differ a lot in US?

20 replies

RRunPod

•Created by lil_xiang on 8/20/2024 in #⛅｜pods

Secret now showing up in the pod `env` output

ah, i see, got you!

11 replies

RRunPod

•Created by lil_xiang on 8/20/2024 in #⛅｜pods

Secret now showing up in the pod `env` output

btw, isn't exporting secret envs a default behavior for public template?

11 replies

RRunPod

•Created by lil_xiang on 8/20/2024 in #⛅｜pods

Secret now showing up in the pod `env` output

thanks

11 replies

RRunPod

•Created by lil_xiang on 8/20/2024 in #⛅｜pods

Secret now showing up in the pod `env` output

ah, i see, i'll try it

11 replies

RRunPod

•Created by lil_xiang on 8/20/2024 in #⛅｜pods

Secret now showing up in the pod `env` output

ssh connection, I just run env command to show the env vars

11 replies

RRunPod

•Created by lil_xiang on 8/19/2024 in #⛅｜pods

Does runpod provides environments isolation?

ok, thanks, maybe we'll just use two accounts, for env isolations, cuz we are using runpod cli tools to manage those pods, one api key with write permission can operates both envs if they are in the same account

7 replies

RRunPod

•Created by lil_xiang on 8/12/2024 in #⛅｜pods

pod with custom template have no tcp ports exposed

i see, so i can't just use CMD ["/bin/bash'] for my container? btw, i'm looking at this https://github.com/runpod/containers , do I have to install nginx and openssh-server in my image?

8 replies

RRunPod

•Created by lil_xiang on 8/12/2024 in #⛅｜pods

pod with custom template have no tcp ports exposed

or do i have to expose ports like 22, 3001 when building docker image?

8 replies