It will be fine.
I am one of those opposed to filing the filter with oil after a change. If the oil has drained long enough, the pump will be full of air. If the filter, which is at the discharge of the pump, is filled with fluid, it will actually present a resistance that will prolong the time it takes to completely fill the pump cavity and build pressure.
A dry filter presents no opposition, and it fills within seconds. If your vehicle has a gage, you can actually see the pressure builds more quickly after starting with an empty filter.