RunPod•9mo ago

What is N95 in serverless metrics?

I finally understand the percentiles (P70, P90, P98) for serverless metrics, but I don't understand what N95 is. Can someone please explain what it is, how its calculated and what the significance of it is?

Solution:

from what i can see yes

Jump to solution

4 Replies

haris•9mo ago

@Zeke is this something you're able to help with?

kaj•9mo ago

if you're talking about requests, it's the 95th percentile i'm not sure why its n95 and not p95

ashleykOP•9mo ago

Yeah its the requests from the metrics API:

f'https://api.runpod.ai/v2/{endpoint_id}/metrics/request_ts_v1?interval={interval}'

f'https://api.runpod.ai/v2/{endpoint_id}/metrics/request_ts_v1?interval={interval}'

So just a bug in the naming, and it should be p95 like the others and not n95 ?

{
    "dt_max": 4906,
    "dt_min": 25,
    "dt_total": 620991,
    "dt_n95": 4770,
    "dt_p70": 878,
    "dt_p90": 4726,
    "dt_p98": 4839,
    "et_max": 274553,
    "et_min": 22845,
    "et_total": 15540930,
    "et_n95": 70251,
    "et_p70": 52485,
    "et_p90": 62738,
    "et_p98": 83618,
    "retried": 0,
    "requests": 366,
    "completed_requests": 366,
    "failed_requests": 0,
    "time": "2024-03-11 00:00:00"
}

{
    "dt_max": 4906,
    "dt_min": 25,
    "dt_total": 620991,
    "dt_n95": 4770,
    "dt_p70": 878,
    "dt_p90": 4726,
    "dt_p98": 4839,
    "et_max": 274553,
    "et_min": 22845,
    "et_total": 15540930,
    "et_n95": 70251,
    "et_p70": 52485,
    "et_p90": 62738,
    "et_p98": 83618,
    "retried": 0,
    "requests": 366,
    "completed_requests": 366,
    "failed_requests": 0,
    "time": "2024-03-11 00:00:00"
}

Is that correct @Zeke ? I am trying to calculate average costs per request.

Solution

kaj•9mo ago

from what i can see yes

Gaming

Programming

What is N95 in serverless metrics?