Hashset
RRunPod
•Created by Hashset on 3/6/2024 in #⚡|serverless
Text-generation-inference on serverless endpoints
Thank you Alpay, yes I've found my answers in the documentation) sorry, I should've read it till the end)
13 replies
RRunPod
•Created by Hashset on 3/6/2024 in #⚡|serverless
Text-generation-inference on serverless endpoints
2024-03-06T11:04:57.237074977Z
2024-03-06T11:04:57.237196083Z ==========
2024-03-06T11:04:57.237225766Z == CUDA ==
2024-03-06T11:04:57.237320751Z ==========
2024-03-06T11:04:57.239764246Z
2024-03-06T11:04:57.239767808Z CUDA Version 12.1.0
2024-03-06T11:04:57.240376901Z
2024-03-06T11:04:57.240384025Z Container image Copyright (c) 2016-2023, NVIDIA CORPORATION & AFFILIATES. All rights reserved.
2024-03-06T11:04:57.240869637Z
2024-03-06T11:04:57.240873199Z This container image and its contents are governed by the NVIDIA Deep Learning Container License.
2024-03-06T11:04:57.240876761Z By pulling and using the container, you accept the terms and conditions of this license:
2024-03-06T11:04:57.240879135Z https://developer.nvidia.com/ngc/nvidia-deep-learning-container-license
2024-03-06T11:04:57.240883884Z
2024-03-06T11:04:57.240886259Z A copy of this license is made available in this container at /NGC-DL-CONTAINER-LICENSE for your convenience.
2024-03-06T11:04:57.249862363Z
2024-03-06T11:04:57.249875424Z **
2024-03-06T11:04:57.249882548Z DEPRECATION NOTICE!
2024-03-06T11:04:57.249979908Z **
2024-03-06T11:04:57.250003654Z THIS IMAGE IS DEPRECATED and is scheduled for DELETION.
2024-03-06T11:04:57.250009591Z https://gitlab.com/nvidia/container-images/cuda/blob/master/doc/support-policy.md
2024-03-06T11:04:57.250039273Z
13 replies
RRunPod
•Created by Hashset on 3/6/2024 in #⚡|serverless
Text-generation-inference on serverless endpoints
13 replies
RRunPod
•Created by Hashset on 3/6/2024 in #⚡|serverless
Text-generation-inference on serverless endpoints
13 replies
RRunPod
•Created by Hashset on 3/6/2024 in #⚡|serverless
Text-generation-inference on serverless endpoints
For now, everything works well! I managed to deploy llama-2-7b, but I have few more questions:
13 replies
RRunPod
•Created by Hashset on 3/6/2024 in #⚡|serverless
Text-generation-inference on serverless endpoints
13 replies