iNF3Rnus
iNF3Rnus
RRunPod
Created by iNF3Rnus on 3/1/2024 in #⚡|serverless
What port do requests get sent on?
I want to do something a little custom, I don't want to use the serverless package, I want to use my own code, i.e. a flask app running on gunicorn for my container... I need to have a flexible container that's decoupled from RunPod. Is this possible? (Presumably it is?) I'd imagine I'd need to specify the endpoints for /run, /runsync, in my flask app etc. right? And then for the port mapping between the host and the container, how is that handled? Do I define the env var RUNPOD_REALTIME_PORT in the template and then the host then uses that for the hosts port, which is then the internal port used by the gunicorn server?
Final Q, then how is shutdown handled? Does a response code equate to the host then shutting down the container? Much appreciated, this service is absolutely sick nasty
7 replies