Maybe it's a thing on old code? The idea is usually to manipulate the object that you picked it. I know that I can use object manipulator + near interaction grabbable but is a bit pain to adjust this code.
One thing about the old code that I removed is that part:
InputManager.Instance.OverrideFocusedObject = gameObject;
eventData.Use();
It was under OnGestureStarted, maybe is it the cause the code not functioning properly?