The top of the starter slips up into a hole in the block and it has probably oxidized and stuck in the hole. Try wiggling it back and forth to try and break it loose. You may have to take a wooden block and put it against the side of the starter near the bottom and tap on it to break it loose. Do not hit the side of the starter with a hammer it has ceramic magnets in it and they will break and ruin your starter.