xsjiang
xsjiang
RRunPod
Created by xsjiang on 3/13/2024 in #⚡|serverless
Inconsistent performance of local runpods and production runpods
No description
5 replies
RRunPod
Created by xsjiang on 3/13/2024 in #⚡|serverless
Inconsistent performance of local runpods and production runpods
This is my test params
5 replies
RRunPod
Created by xsjiang on 3/13/2024 in #⚡|serverless
Inconsistent performance of local runpods and production runpods
This is the log runpod display
5 replies
RRunPod
Created by xsjiang on 1/19/2024 in #⚡|serverless
Why is the GPU not full?
Thank you
7 replies
RRunPod
Created by xsjiang on 1/19/2024 in #⚡|serverless
Why is the GPU not full?
What does throttling mean?
7 replies
RRunPod
Created by xsjiang on 1/19/2024 in #⚡|serverless
Why is the GPU not full?
No description
7 replies
RRunPod
Created by xsjiang on 1/16/2024 in #⚡|serverless
ComfyUI ValueError: not allowed to raise maximum limit
Ok, thanks
5 replies
RRunPod
Created by xsjiang on 1/16/2024 in #⚡|serverless
ComfyUI ValueError: not allowed to raise maximum limit
error log
5 replies
RRunPod
Created by xsjiang on 1/12/2024 in #⚡|serverless
Serverless doesn't work properly when docker image is committed
Thanks, I'll try to build the full image using Dockerfile first
22 replies
RRunPod
Created by xsjiang on 1/12/2024 in #⚡|serverless
Serverless doesn't work properly when docker image is committed
sudo docker build -t myimage:1.0 --platform linux/amd64 .
sudo docker run --runtime=nvidia -it --name mycontainer myimage:1.0 /bin/bash
sudo docker commit mycontainer myimage:1.1
sudo docker build -t myimage:1.0 --platform linux/amd64 .
sudo docker run --runtime=nvidia -it --name mycontainer myimage:1.0 /bin/bash
sudo docker commit mycontainer myimage:1.1
myimage1.0 work but myimage1.1 not work
22 replies
RRunPod
Created by xsjiang on 1/12/2024 in #⚡|serverless
Serverless doesn't work properly when docker image is committed
You can make a base image, then after running that image locally, you can use docker commit to make a new image to submit to runpod, which should be fine.
22 replies
RRunPod
Created by xsjiang on 1/12/2024 in #⚡|serverless
Serverless doesn't work properly when docker image is committed
Images built using docker build are fine for runpod, but images made using docker commit are not.
22 replies
RRunPod
Created by xsjiang on 1/12/2024 in #⚡|serverless
Serverless doesn't work properly when docker image is committed
# Use Nvidia CUDA base image
FROM nvidia/cuda:11.8.0-cudnn8-runtime-ubuntu22.04 as base

# Prevents prompts from packages asking for user input during installation
ENV DEBIAN_FRONTEND=noninteractive
# Prefer binary wheels over source distributions for faster pip installations
ENV PIP_PREFER_BINARY=1
# Ensures output from python is printed immediately to the terminal without buffering
ENV PYTHONUNBUFFERED=1

# Install Python, git and other necessary tools
RUN apt-get update && apt-get install -y \
python3.10 \
python3-pip \
git \
wget \
libgl-dev \
python3-opencv \
libglib2.0-0

# Clean up to reduce image size
RUN apt-get autoremove -y && apt-get clean -y && rm -rf /var/lib/apt/lists/*

# Copy comfyui root dir
# ADD ComfyUI /comfyui
# ADD extra_model_paths.yaml /comfyui/

# Install ComfyUI dependencies
RUN pip3 install --no-cache-dir torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121 -i https://pypi.tuna.tsinghua.edu.cn/simple \
&& pip3 install -U xformers -i https://pypi.tuna.tsinghua.edu.cn/simple


# Install runpod
RUN pip3 install runpod requests -i https://pypi.tuna.tsinghua.edu.cn/simple

# Go back to the root
WORKDIR /

# Add the start and the handler
ADD src/start.sh src/rp_handler.py test_input.json ./
RUN chmod +x /start.sh

# Start the container
CMD /start.sh
# Use Nvidia CUDA base image
FROM nvidia/cuda:11.8.0-cudnn8-runtime-ubuntu22.04 as base

# Prevents prompts from packages asking for user input during installation
ENV DEBIAN_FRONTEND=noninteractive
# Prefer binary wheels over source distributions for faster pip installations
ENV PIP_PREFER_BINARY=1
# Ensures output from python is printed immediately to the terminal without buffering
ENV PYTHONUNBUFFERED=1

# Install Python, git and other necessary tools
RUN apt-get update && apt-get install -y \
python3.10 \
python3-pip \
git \
wget \
libgl-dev \
python3-opencv \
libglib2.0-0

# Clean up to reduce image size
RUN apt-get autoremove -y && apt-get clean -y && rm -rf /var/lib/apt/lists/*

# Copy comfyui root dir
# ADD ComfyUI /comfyui
# ADD extra_model_paths.yaml /comfyui/

# Install ComfyUI dependencies
RUN pip3 install --no-cache-dir torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu121 -i https://pypi.tuna.tsinghua.edu.cn/simple \
&& pip3 install -U xformers -i https://pypi.tuna.tsinghua.edu.cn/simple


# Install runpod
RUN pip3 install runpod requests -i https://pypi.tuna.tsinghua.edu.cn/simple

# Go back to the root
WORKDIR /

# Add the start and the handler
ADD src/start.sh src/rp_handler.py test_input.json ./
RUN chmod +x /start.sh

# Start the container
CMD /start.sh
22 replies
RRunPod
Created by xsjiang on 1/12/2024 in #⚡|serverless
Serverless doesn't work properly when docker image is committed
start.sh python3 -u rp_handler.py
22 replies
RRunPod
Created by xsjiang on 1/12/2024 in #⚡|serverless
Serverless doesn't work properly when docker image is committed
CMD start.sh
22 replies