There is no set screw , use a 3 pronged puller and put some heat on it - concentrate the heat near the shaft area or you'll bend your pully on the outer area , keep applying pressure with your impact and keep your torch moving.
I don't think a small propane torch will do but maybe worth a try...