tonystratum
MModular
•Created by tonystratum on 7/23/2024 in #questions
max engine leaking?
Apple M2 Max 96G
Was trying to run a text2text onnx model, but ram usage just keeps rising (see video).
I am using https://github.com/bloomberg/memray as a profiler. Seems like it is the engine specifically
4 replies