Tough question as every situaton is diffrent.
The more a filter catches the cleaner the air so you won't damage the engine.
I guess you will have to be guided by how the engine is running (after filter tapping/cleaning with compressed air) -
Does it cold start without the choke ? - this might be an indication that the filter is restricting air flow too much - change the filter.
Engine not making full power/rpm ? - could be an indication it's not getting sufficient air for good combustion - change the filter