It turned out to be a cracked diaphragm inside the fuel pump. This is what happened: I removed the fuel line from carburetor, crank it, no fuel. Removed the fuel pump, and put my finger over the pulsing tube and crank it, I can feel that pulsing suction so that's normal. I tried to suck that pulsing port on the fuel pump -- should have blow it first but I forgot, and got a mouthful of fuel which taste really really bad. I immediately realized that is the problem -- if a good diaphragm won't allow you to suck, you should feel the resistance. And there shouldn't be any fuel through the pulsing port at all. Obviously the diaphragm cracked.
Replaced with the one bought from Amazon, replaced the fuel filter, and crank it, it didn't run but I do see fuels coming into the filter, which is a good sign. Sprayed a few puffs of carburetor cleaner to the air intake, and crank again, voila~
Thank you so much to everybody who contributed your valuable insights and opinions. Every tip helped. Love you guys~