bggai Comments - Answer Overflow

bggai

•Created by bggai on 7/27/2024 in #⚡｜serverless

Help Reducing Cold Start

Sure but If I'm using storage frm the container or cache, this will be accumulated so at some point I'd have to reset the worker right? To avoid any complications

13 replies

RRunPod

•Created by bggai on 7/27/2024 in #⚡｜serverless

Help Reducing Cold Start

@yhlong00000 if I hav ana ctive worker should I implement logics to turn off and on this workers to not accumulate container storage or cache right?

13 replies

RRunPod

•Created by ArtyomKosakyan on 7/1/2024 in #⚡｜serverless

Connection timeout to host https://api.runpod.ai/v2

@ArtyomKosakyan Habing the same problem stopped working out of nowhere.

28 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

either thanks a lot, I'll be testing async logics next week, If i manage to mix it correctly I'll be posting results here so other people can benefit, thanks

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

@Madiator2011 hope you can work con support skills, basically the first 50 messages were lost and the problem was visible, you just did not ask any helpful question but just asume, hope you can work on that

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

@Justin Merrell thanks a lot for the help and listening

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

4 endpoints were corrected with using sync methods, I had to sacrifice 1 functino that combined async logics and could not be replaced as easily, now the testing makes sense with the resutls obtained by ssh, still thinking why it didnt work with async, eveything was going smooth in a normal gpu with that code

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

I'll try sync mode, will be posting updates here

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

are you saying I shoudl try 100% sync and maybe i'll work? shouldnt we see an error from asyncio?

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

it was previously handled like that and after we upload using async as well

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

@Justin Merrell

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

this is the code:

async def async_transcribe_wfiles(
        audio_file, 
        filename: str, 
        file_path:str,
        ):
    # Create timestamp
    ic(type(audio_file))
    loop = asyncio.get_event_loop()

    segments, info = await loop.run_in_executor(None, lambda: whisper_model.transcribe(audio_file, beam_size=5))
    segments = await loop.run_in_executor(None, lambda: list(segments))
    ic(segments)
    # Create directory
    #os.makedirs(f'/tmp/{org_id}/{session}', exist_ok=True)
    work_dir = f'{file_path.split(f"/{filename}")[0]}'
    ic(work_dir)
    os.makedirs(work_dir, exist_ok=True)

async def async_transcribe_wfiles(
        audio_file, 
        filename: str, 
        file_path:str,
        ):
    # Create timestamp
    ic(type(audio_file))
    loop = asyncio.get_event_loop()

    segments, info = await loop.run_in_executor(None, lambda: whisper_model.transcribe(audio_file, beam_size=5))
    segments = await loop.run_in_executor(None, lambda: list(segments))
    ic(segments)
    # Create directory
    #os.makedirs(f'/tmp/{org_id}/{session}', exist_ok=True)
    work_dir = f'{file_path.split(f"/{filename}")[0]}'
    ic(work_dir)
    os.makedirs(work_dir, exist_ok=True)

an async version of running the faster wshiper medium model, previosly cached in the dockerfile

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

@Justin Merrell

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

this image

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

number 3, transcription never seems to start

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

@Justin Merrell

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

I cannot put more prints, as ther is no middle step, these prints were designed to debug the system but are no quite helpful now in the worker

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

1. Init -> ic| device: 'cuda', compute: 'float16' 2. Download file frm AWS S3 in bytes form, at the end we should see: ic| type(audio_file): <class '_io.BytesIO'> 3. Transcription, when it starts we should see:

transcribe.py       :263  2024-02-04 22:58:26,199 Processing audio with duration 02:36:32.192
transcribe.py       :317  2024-02-04 22:58:40,144 Detected language 'es' with probability 0.98

transcribe.py       :263  2024-02-04 22:58:26,199 Processing audio with duration 02:36:32.192
transcribe.py       :317  2024-02-04 22:58:40,144 Detected language 'es' with probability 0.98

4. After finishing transcription, segment should print: ic| segments: [Segment(id=1, seek=2428,... 5. After segments a work_dir print should appear: ic| work_dir: 'dev/tmp/test_files' since we are saving the file there 6. A final message after saving the file should appear:

ic| f'{filename}_{info.language}_segments.json': '🚚🎓 1) Environments PEPE-20240131_140530-Meeting Recording_es_segments.json'

I'm using icecream printing library that is the ic

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

I have print statements, I'll write each content should appear

84 replies

RRunPod

•Created by bggai on 2/4/2024 in #⚡｜serverless

Worker hangs for really long time, performance is not close to what it should be

i just canceled the request that was retrying

84 replies

Gaming

Programming