I don't think you have any problem. Turning the pulley by hand does make the axles seem very slow. Also, if you hold one axle it will stop turn, just like you experienced with the key missing. Try holding both axles, one with a vice grip and one by hand. I'll bet you will feel a lot of resistance in the one your holding by hand.