I ended up bending a little hook on a paper clip. That answer is funny, because I went through my wife's sewing basket looking for a crochet hook and could not find one. That was when I found the paper clip and thought, this might work.
I pushed the rubber seat in but I am not sure which way it goes. It has a rim on one side and is rounded on the other. I pushed the rim side in and left the rounded side for the needle to seat into. If this is the wrong way please let me know.