Happens on my iPad Pro in the latest 12.4 betas, I can only bypass it by slowing down as I’ve zoomed in, a quick gesture snaps back and is ignored, but a quick gesture followed by waiting a second seems to preserve the zooming in. It happens most often on this site, for me, probably because I’m trying to zoom in to click tiny links, even on an iPad Pro.