Yeah, thought it might be for Nuke specific viewer processes.
An alternative solution would be to split the baked Quicktime into smaller frame ranges, then combine at the end with ffmpeg -concat. We could maybe specify a frame range size when the splitting start to happen.
Have you noticed when its starts to slow down and how many frames that is?