tonystratum
tonystratum
MModular
Created by tonystratum on 7/23/2024 in #questions
max engine leaking?
Apple M2 Max 96G Was trying to run a text2text onnx model, but ram usage just keeps rising (see video). I am using https://github.com/bloomberg/memray as a profiler. Seems like it is the engine specifically
4 replies