Any time the filter is on the inlet side of the fuel pump. It will never stay full. Doesn't matter what it is on. Lawnmower, tractor, car etc. The filter acts like an expansion tank and the air space is filled with gas vapor. So unless you have an air leak between the filter, and the end of the fuel pickup your problem is not the filter staying full.
So what is the engine doing. Surging, running a period and stalling out and dying,