Using SetTransform instead of TargetPosition + a larger margin seems to make the item syncing near-perfect.
+ split character networking logic into a separate file, characters drop items at the position of their collider instead of hands