M
Modular7mo ago
Red

Benchmark Analysis

I would like to dump out individual times it took to run my function from a report, so i can graph it and do some analysis myself, but i can only access a list of batches via report.runsand their means. If i increase the min/max benchmarking time it never goes above 5 batches being ran, which is not a lot of data to do any analysis on. The benchmarking package also seems to be still closed-source, so it is difficult to hack it in myself. Are there any plans to add more configurability/visibility to this/any hacks i can use, apart from writing my own benchmarking function? Thanks
3 Replies
sora
sora7mo ago
There is a print_full method one the report object
sora
sora7mo ago
benchmark | Modular Docs
Implements the benchmark module for runtime benchmarking.
Red
RedOP7mo ago
this only iterates over the batches (of N iterations) and prints out their info, so it wouldnt help me here
Want results from more Discord servers?
Add your server