Asad Cognify
Asad Cognify
RRunPod
Created by Asad Cognify on 7/25/2024 in #⛅|pods
CA-MTL-1 region has GPU loaded at 87%
No description
15 replies
RRunPod
Created by Asad Cognify on 7/25/2024 in #⛅|pods
CA-MTL-1 region has GPU loaded at 87%
The UI sometimes shows 24% somtimes 87% but 100% utilization
15 replies
RRunPod
Created by Asad Cognify on 7/25/2024 in #⛅|pods
CA-MTL-1 region has GPU loaded at 87%
It was previously, but now its not - on the nvidia-smi command
15 replies
RRunPod
Created by Asad Cognify on 7/11/2024 in #⛅|pods
How to get Public IP and set symmetrical port mapping on Pod via Python SDK
But there is currently no way for me to get the port (even if symetrical) through the runpod python library?
40 replies
RRunPod
Created by Asad Cognify on 7/11/2024 in #⛅|pods
How to get Public IP and set symmetrical port mapping on Pod via Python SDK
But if I want to use the port and IP programatically, how can I do that?
40 replies
RRunPod
Created by Asad Cognify on 7/11/2024 in #⛅|pods
How to get Public IP and set symmetrical port mapping on Pod via Python SDK
Okay if I got this correct then, Then I create the pod like this
pod = runpod.create_pod(
name=bot_name,
image_name="runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04",
gpu_count=1,
gpu_type_id='NVIDIA A40',
network_volume_id="8y",
volume_mount_path="/workspace",
ports= "8888/http,22/tcp,70002/tcp",
env={
"PUBLIC_KEY": "ssh-ed25519 ",
"JUPYTER_PASSWORD": "h7xw7gxh407nxshza6f3",
},
support_public_ip=True,
docker_args="/workspace/start_finetune.sh",
container_disk_in_gb=20
)
pod = runpod.create_pod(
name=bot_name,
image_name="runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04",
gpu_count=1,
gpu_type_id='NVIDIA A40',
network_volume_id="8y",
volume_mount_path="/workspace",
ports= "8888/http,22/tcp,70002/tcp",
env={
"PUBLIC_KEY": "ssh-ed25519 ",
"JUPYTER_PASSWORD": "h7xw7gxh407nxshza6f3",
},
support_public_ip=True,
docker_args="/workspace/start_finetune.sh",
container_disk_in_gb=20
)
Then I ssh into the pod and
printenv | grep -i RUNPOD_TCP_PORT_70002
printenv | grep -i RUNPOD_TCP_PORT_70002
This will give me the mapping
40 replies
RRunPod
Created by Asad Cognify on 7/11/2024 in #⛅|pods
How to get Public IP and set symmetrical port mapping on Pod via Python SDK
Via python using runpod library
40 replies
RRunPod
Created by Asad Cognify on 7/11/2024 in #⛅|pods
How to get Public IP and set symmetrical port mapping on Pod via Python SDK
I created a new pod I want to know its public ip I exposed port 5000 in ports parameter, but the mapping is asymetrical, how can I make it symetrical to 5000
40 replies
RRunPod
Created by Asad Cognify on 7/11/2024 in #⛅|pods
How to get Public IP and set symmetrical port mapping on Pod via Python SDK
Okay
40 replies
RRunPod
Created by Asad Cognify on 7/11/2024 in #⛅|pods
How to get Public IP and set symmetrical port mapping on Pod via Python SDK
I created them like this
pod = runpod.create_pod(
name=bot_name,
image_name="runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04",
gpu_count=1,
gpu_type_id='NVIDIA A40',
network_volume_id="8y",
volume_mount_path="/workspace",
ports= "8888/http,22/tcp,70001/tcp",
env={
"PUBLIC_KEY": "ssh-ed25519 ",
"JUPYTER_PASSWORD": "h7xw7gxh407nxshza6f3",
"RUNPOD_PUBLIC_IP": "10.2.25.69",
"RUNPOD_TCP_PORT_70001": 5000
},
support_public_ip=True,
docker_args="/workspace/start_finetune.sh",
container_disk_in_gb=20
)
pod = runpod.create_pod(
name=bot_name,
image_name="runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04",
gpu_count=1,
gpu_type_id='NVIDIA A40',
network_volume_id="8y",
volume_mount_path="/workspace",
ports= "8888/http,22/tcp,70001/tcp",
env={
"PUBLIC_KEY": "ssh-ed25519 ",
"JUPYTER_PASSWORD": "h7xw7gxh407nxshza6f3",
"RUNPOD_PUBLIC_IP": "10.2.25.69",
"RUNPOD_TCP_PORT_70001": 5000
},
support_public_ip=True,
docker_args="/workspace/start_finetune.sh",
container_disk_in_gb=20
)
40 replies
RRunPod
Created by Asad Cognify on 7/11/2024 in #⛅|pods
How to get Public IP and set symmetrical port mapping on Pod via Python SDK
40 replies
RRunPod
Created by Asad Cognify on 7/11/2024 in #⛅|pods
How to get Public IP and set symmetrical port mapping on Pod via Python SDK
Yeah But I passed that env variable myself. The actual assigned publib ip is something else
40 replies
RRunPod
Created by Asad Cognify on 7/11/2024 in #⛅|pods
How to get Public IP and set symmetrical port mapping on Pod via Python SDK
When I create a pod I dont see it in the printed variable
{'id': 'dfg', 'desiredStatus': 'RUNNING', 'imageName': 'runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04', 'env': ['PUBLIC_KEY=ssh-ed25519 m', 'JUPYTER_PASSWORD=h7xw7gxh407nxshza6f3', 'RUNPOD_PUBLIC_IP=10.2.25.69', 'RUNPOD_TCP_PORT_70000=5000'], 'machineId': 'gp8l45q218uu', 'machine': {'podHostId': '85f0xhj08uxndo-644112f0'}}
{'id': 'dfg', 'desiredStatus': 'RUNNING', 'imageName': 'runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04', 'env': ['PUBLIC_KEY=ssh-ed25519 m', 'JUPYTER_PASSWORD=h7xw7gxh407nxshza6f3', 'RUNPOD_PUBLIC_IP=10.2.25.69', 'RUNPOD_TCP_PORT_70000=5000'], 'machineId': 'gp8l45q218uu', 'machine': {'podHostId': '85f0xhj08uxndo-644112f0'}}
40 replies
RRunPod
Created by Asad Cognify on 7/11/2024 in #⛅|pods
How to get Public IP and set symmetrical port mapping on Pod via Python SDK
How do I get these? What is the command in python? Port number more than 70000
40 replies
RRunPod
Created by Asad Cognify on 6/28/2024 in #⛅|pods
How to auto start jupyter notebook with python create pod
Okay, will do that
51 replies
RRunPod
Created by Asad Cognify on 6/28/2024 in #⛅|pods
How to auto start jupyter notebook with python create pod
Yes. There was start_ssh as a boolean but no start_jupyter
51 replies
RRunPod
Created by Asad Cognify on 6/28/2024 in #⛅|pods
How to auto start jupyter notebook with python create pod
Done. It is working now
51 replies
RRunPod
Created by Asad Cognify on 6/28/2024 in #⛅|pods
How to auto start jupyter notebook with python create pod
How to get the password?
51 replies
RRunPod
Created by Asad Cognify on 6/28/2024 in #⛅|pods
How to auto start jupyter notebook with python create pod
Is there an issue with
if [[ $JUPYTER_PASSWORD ]]; then
echo "Starting Jupyter Lab..."
if [[ $JUPYTER_PASSWORD ]]; then
echo "Starting Jupyter Lab..."
I cannot see "Starting Jupyter Lab..." in the logs
51 replies
RRunPod
Created by Asad Cognify on 6/28/2024 in #⛅|pods
How to auto start jupyter notebook with python create pod
No description
51 replies