It is just that their perception of the length of the pole and the barn are changing because of the effect of Lorentz contraction but it will simply depend on the fact that whether the pole fits or not into the barn when both of them are observed in a common frame of reference.