R
RunPod6mo ago
ethan

Strange unix and/or user perms issue with command in dockerfile/replacement command

I have a bash script in my pod which, as part of its last command, executes mpirun with some target process. When running this command using bash <script> as the dockerfile's entrypoint, or using runpod's replacement command, the following issue occurs:
2024-06-04T00:27:41.763661289Z Per request, Open MPI attempted to set a system resource
2024-06-04T00:27:41.763672184Z limit to a given value:
2024-06-04T00:27:41.763682241Z
2024-06-04T00:27:41.763690901Z Resource: openfiles
2024-06-04T00:27:41.763700120Z Limit: max
2024-06-04T00:27:41.763708781Z
2024-06-04T00:27:41.763718000Z The system has refused to allow this operation. This is likely
2024-06-04T00:27:41.763726660Z due to a permission limitation, or specifying an unsupported
2024-06-04T00:27:41.763735320Z value. Please check the system or remove the request and try
2024-06-04T00:27:41.763744539Z again.
2024-06-04T00:27:41.763753200Z --------------------------------------------------------------------------
2024-06-04T00:27:41.763766609Z
2024-06-04T00:27:41.763784489Z Failed initializing opal: -43
2024-06-04T00:27:41.763661289Z Per request, Open MPI attempted to set a system resource
2024-06-04T00:27:41.763672184Z limit to a given value:
2024-06-04T00:27:41.763682241Z
2024-06-04T00:27:41.763690901Z Resource: openfiles
2024-06-04T00:27:41.763700120Z Limit: max
2024-06-04T00:27:41.763708781Z
2024-06-04T00:27:41.763718000Z The system has refused to allow this operation. This is likely
2024-06-04T00:27:41.763726660Z due to a permission limitation, or specifying an unsupported
2024-06-04T00:27:41.763735320Z value. Please check the system or remove the request and try
2024-06-04T00:27:41.763744539Z again.
2024-06-04T00:27:41.763753200Z --------------------------------------------------------------------------
2024-06-04T00:27:41.763766609Z
2024-06-04T00:27:41.763784489Z Failed initializing opal: -43
However, if I simply enter the container and run the exact same script (same command, bash <script>), it runs without issue. In both cases, I am acting as the root user
17 Replies
nerdylive
nerdylive6mo ago
Hmm i think its not possible to modify this inside a container, needs the host to make those change Maybe try other pods like on the community cloud or make a support ticket to ask about that
Madiator2011 (Work)
btw if you use entrypoint it can be overriden by start command
nerdylive
nerdylive6mo ago
What is start command? is it the CMD
ethan
ethanOP6mo ago
Do you just not read the descriptions of problems? "However, if I simply enter the container and run the exact same script (same command, bash <script>), it runs without issue"
nerdylive
nerdylive6mo ago
Oh i didnt see that srry
ethan
ethanOP6mo ago
Broken either using start command or Dockerfile cmd line
Madiator2011 (Work)
@ethan so from what I see the app tries to edit Open File Limit and that cant be edited unless you have provilaged docker container with cant be done in case of RunPod
nerdylive
nerdylive6mo ago
But he said it can be done with ssh on the pod It's not normal isn't it
Madiator2011 (Work)
remove entrypoint and run script instead
nerdylive
nerdylive6mo ago
hmm how does that work? how to call the script then
Madiator2011 (Work)
ENTRYPOINT in dockerfile prevents using custom start command from runpod ui
The ENTRYPOINT instruction works very similarly to CMD in that it is used to specify the command executed when the container is started. However, where it differs is that ENTRYPOINT doesn't allow you to override the command.
The ENTRYPOINT instruction works very similarly to CMD in that it is used to specify the command executed when the container is started. However, where it differs is that ENTRYPOINT doesn't allow you to override the command.
nerdylive
nerdylive6mo ago
Oh so you were saying to run the script from custom start command from the ui?
Madiator2011 (Work)
If docker has entrypoint anything to override startup comman is ignored
nerdylive
nerdylive6mo ago
yeah i get that
Madiator2011 (Work)
so basically if docker has entrypoint pointing to run script and user tries to change startup command from runpod ui it would be ignored and still run entrypoint
nerdylive
nerdylive6mo ago
ahh ok CMD
Madiator2011 (Work)
@ethan so you want to use CMD instead of entrypoint and see if it fixes error
Want results from more Discord servers?
Add your server