Asad Cognify Posts - Answer Overflow

Asad Cognify

•Created by Asad Cognify on 7/25/2024 in #⛅｜pods-clusters

CA-MTL-1 region has GPU loaded at 87%

I created a pod in the CA-MTL-1 region with A40 GPU. The pod started with GPU 100% utilization and 87% GPU memory in use. I tried it multiple times, but same result.

15 replies

RRunPod

•Created by Asad Cognify on 7/11/2024 in #⛅｜pods-clusters

How to get Public IP and set symmetrical port mapping on Pod via Python SDK

40 replies

RRunPod

•Created by Asad Cognify on 6/28/2024 in #⛅｜pods-clusters

How to auto start jupyter notebook with python create pod

As the title asks

51 replies

RRunPod

•Created by Asad Cognify on 6/28/2024 in #⛅｜pods-clusters

How to add start command via python

3 replies

RRunPod

•Created by Asad Cognify on 6/14/2024 in #⛅｜pods-clusters

Run multiple finetuning on same GPU POD

I am using - image: runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04 - GPU: 1 x A40 While running qlora finetuning with 4 bit quantization the GPU uses approx 12 GB GPU Memory out of 48 GB, how can I run multiple finetunings simultaneously (in parallel) on the same POD GPU?

12 replies

RRunPod

•Created by Asad Cognify on 6/14/2024 in #⛅｜pods-clusters

Can I download audit logs?

Is there a way to fetch or download audit logs?

6 replies

RRunPod

•Created by Asad Cognify on 6/12/2024 in #⛅｜pods-clusters

Unable to create template or pod with python sdk version 1.6.2

import runpod
import os


runpod.api_key = os.getenv("RUNPOD_API_KEY")

try:
    # Creating a new template with a specified name and Docker image
    new_template = runpod.create_template(name="test", image_name="runpod/base:0.1.0")
    
    # Output the created template details
    print(new_template)

except Exception as err:
    # Handling potential errors during template creation
    print(err)
    # print(err.query)

import runpod
import os


runpod.api_key = os.getenv("RUNPOD_API_KEY")

try:
    # Creating a new template with a specified name and Docker image
    new_template = runpod.create_template(name="test", image_name="runpod/base:0.1.0")
    
    # Output the created template details
    print(new_template)

except Exception as err:
    # Handling potential errors during template creation
    print(err)
    # print(err.query)

Error Output:

$ python runpod.py 
partially initialized module 'runpod' has no attribute 'create_template' (most likely due to a circular import)
module 'runpod' has no attribute 'create_template'

$ python runpod.py 
partially initialized module 'runpod' has no attribute 'create_template' (most likely due to a circular import)
module 'runpod' has no attribute 'create_template'

11 replies

RRunPod

•Created by Asad Cognify on 5/28/2024 in #⛅｜pods-clusters

Start the pod with a custom command after the pod finishes startup

How can add I command that the pod will execute after it has finished starting up? I tried using

bash -c 'apt update;DEBIAN_FRONTEND=noninteractive apt-get install openssh-server -y;mkdir -p ~/.ssh;cd $_;chmod 700 ~/.ssh;echo "$PUBLIC_KEY" >> authorized_keys;chmod 700 authorized_keys;service ssh start;sleep infinity'

bash -c 'apt update;DEBIAN_FRONTEND=noninteractive apt-get install openssh-server -y;mkdir -p ~/.ssh;cd $_;chmod 700 ~/.ssh;echo "$PUBLIC_KEY" >> authorized_keys;chmod 700 authorized_keys;service ssh start;sleep infinity'

And replaced sleep infinity with apt install nano -y

bash -c 'apt update;DEBIAN_FRONTEND=noninteractive apt-get install openssh-server -y;mkdir -p ~/.ssh;cd $_;chmod 700 ~/.ssh;echo "$PUBLIC_KEY" >> authorized_keys;chmod 700 authorized_keys;service ssh start;apt install nano -y'

bash -c 'apt update;DEBIAN_FRONTEND=noninteractive apt-get install openssh-server -y;mkdir -p ~/.ssh;cd $_;chmod 700 ~/.ssh;echo "$PUBLIC_KEY" >> authorized_keys;chmod 700 authorized_keys;service ssh start;apt install nano -y'

The container starts but I am unable to access it using ssh or the web terminal.

29 replies

RRunPod

•Created by Asad Cognify on 5/28/2024 in #⛅｜pods-clusters

How to start a pod using command line runpodctl or python sdk

20 replies

RRunPod

•Created by Asad Cognify on 5/27/2024 in #⛅｜pods-clusters

Billing for separate users or pods

Hi is there any way to track usage (in terms of cost) for pods (for example based on ID) or better if there is a way to see how much each of my team user has cost?

70 replies

Gaming

Programming