Never accept your horse walking off whilst you are mounting or dismounting.

Wait for him to stand still and give you permission first.