Not entirely, even if I do it at the start (and not when loading level for example), the next GC cycle may happen in 20 secends, so 20 seconds after starting the game the player will get a dip
I feel time performance is not as important as memory performance, I fear Garbage Collector stepping in to free those arrays and dipping one frame.
But I guess it will happen only once anyway