While going through horses to retire I've accidentally hit the surrender button a few times. The buttons are right next to each other, the same color and a warning pops up for both, so it's easy to not notice at all.

If the buttons weren't right next to each other, or were clearly different colors, it would be much easier to make sure you're hitting the correct button.