Go to your horse, and the middle button on the upper right side of the horse image is the equipper button. Click that and then you can remove the tack from there. 

Thank you so much