I would suggest that clicking unsubscribe should immediately unsubscribe the user and they should be given the option to undo the action if it was a mistake. 

Also, if you want to get some feedback, present it before the unsubscribe button and the remaining sequence should be the same.

<!-- Begin mockup: In order to preserve an editable mockup, please
     don't edit this section directly.
     Click the "edit" link below the image in the preview instead. -->

![mockup](https://i.sstatic.net/aokuN.png)

<!-- End mockup -->