pg2571 Posts - Answer Overflow

pg2571

•Created by pg2571 on 11/16/2024 in #⚡｜serverless

Not able to connect to the local test API server

I am running the container on an EC2 instance. I keep getting errors like:

Error handling request
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/aiohttp/web_protocol.py", line 433, in _handle_request
    resp = await request_handler(request)
  File "/usr/local/lib/python3.10/dist-packages/aiohttp/web_app.py", line 473, in _handle
    match_info = await self._router.resolve(request)
  File "/usr/local/lib/python3.10/dist-packages/aiohttp/web_urldispatcher.py", line 1010, in resolve
    match_dict, allowed = await resource.resolve(request)
  File "/usr/local/lib/python3.10/dist-packages/aiohttp/web_urldispatcher.py", line 755, in resolve
    not request.url.raw_path.startswith(self._prefix2)
  File "aiohttp/_helpers.pyx", line 26, in aiohttp._helpers.reify.__get__
  File "/usr/local/lib/python3.10/dist-packages/aiohttp/web_request.py", line 437, in url
    url = URL.build(scheme=self.scheme, host=self.host)
  File "/usr/local/lib/python3.10/dist-packages/yarl/_url.py", line 388, in build
    _host = _encode_host(host, validate_host=True)
  File "/usr/local/lib/python3.10/dist-packages/yarl/_url.py", line 1482, in _encode_host
    raise ValueError(
ValueError: Host '172.18.0.1:8188' cannot contain ':' (at position 10)

Error handling request
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/aiohttp/web_protocol.py", line 433, in _handle_request
    resp = await request_handler(request)
  File "/usr/local/lib/python3.10/dist-packages/aiohttp/web_app.py", line 473, in _handle
    match_info = await self._router.resolve(request)
  File "/usr/local/lib/python3.10/dist-packages/aiohttp/web_urldispatcher.py", line 1010, in resolve
    match_dict, allowed = await resource.resolve(request)
  File "/usr/local/lib/python3.10/dist-packages/aiohttp/web_urldispatcher.py", line 755, in resolve
    not request.url.raw_path.startswith(self._prefix2)
  File "aiohttp/_helpers.pyx", line 26, in aiohttp._helpers.reify.__get__
  File "/usr/local/lib/python3.10/dist-packages/aiohttp/web_request.py", line 437, in url
    url = URL.build(scheme=self.scheme, host=self.host)
  File "/usr/local/lib/python3.10/dist-packages/yarl/_url.py", line 388, in build
    _host = _encode_host(host, validate_host=True)
  File "/usr/local/lib/python3.10/dist-packages/yarl/_url.py", line 1482, in _encode_host
    raise ValueError(
ValueError: Host '172.18.0.1:8188' cannot contain ':' (at position 10)

I've hit it as localhost, 0.0.0.0, 127.0.0.1. I've tried from inside the container too. It still throws this error....

4 replies

RRunPod

•Created by pg2571 on 11/16/2024 in #⚡｜serverless

Network volume vs baking in model into docker

I want to run a serverless worker that can get called anywhere from once per hour to 300-400/hour. I want to optimize for cold starts when the occasional request comes in. it runs SDXL, a checkpoint, a few controlnets, etc. About 15-20GB in total. Am I better off using a network volume or putting the images directly into the docker image? For the initial pod setup on the first request, does it download the entire docker image each time? And thats gonna be slower than reading the network volume? I saw this earlier: https://www.answeroverflow.com/m/1194344244563943604

3 replies

Gaming

Programming